Jul 09 14:24:37 devstack cinder-volume[75538]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Jul 09 14:24:37 devstack cinder-volume[75538]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 09 14:24:37 devstack cinder-volume[75538]: we strongly recommend against using it for new projects.
Jul 09 14:24:37 devstack cinder-volume[75538]: If you are already using Eventlet, we recommend migrating to a different
Jul 09 14:24:37 devstack cinder-volume[75538]: framework.  For more detail see
Jul 09 14:24:37 devstack cinder-volume[75538]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 09 14:24:37 devstack cinder-volume[75538]:   import eventlet  # noqa
Jul 09 14:24:39 devstack cinder-volume[75538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75538) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 09 14:24:39 devstack cinder-volume[75538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75538) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 09 14:24:39 devstack cinder-volume[75538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75538) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 09 14:24:40 devstack cinder-volume[75538]: INFO dbcounter [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] Registered counter for database cinder
Jul 09 14:24:40 devstack cinder-volume[75538]: DEBUG oslo_db.sqlalchemy.engines [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75538) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 09 14:24:40 devstack cinder-volume[75538]: DEBUG dbcounter [-] [75538] Writer thread running {{(pid=75538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 09 14:24:40 devstack cinder-volume[75538]: INFO cinder.rpc [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jul 09 14:24:40 devstack cinder-volume[75538]: INFO cinder.rpc [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jul 09 14:24:40 devstack cinder-volume[75538]: DEBUG oslo_db.sqlalchemy.engines [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75538) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 09 14:24:40 devstack cinder-volume[75538]: INFO cinder.volume.manager [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] Determined volume DB was empty at startup.
Jul 09 14:24:40 devstack cinder-volume[75538]: DEBUG cinder.volume.manager [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75538) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jul 09 14:24:40 devstack cinder-volume[75538]: INFO cinder.volume.manager [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] Service not found for updating active_backend_id, assuming default for driver init.
Jul 09 14:24:40 devstack cinder-volume[75538]: WARNING stevedore.named [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jul 09 14:24:40 devstack cinder-volume[75538]: WARNING castellan.key_manager [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 09 14:24:40 devstack cinder-volume[75538]: WARNING cinder.keymgr.conf_key_mgr [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 09 14:24:40 devstack cinder-volume[75538]: DEBUG cinder.volume.drivers.lvm [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75538) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}}
Jul 09 14:24:40 devstack cinder-volume[75538]: DEBUG oslo_concurrency.processutils [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_concurrency.processutils [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] CMD "cinder-rtstool verify" returned: 0 in 0.433s {{(pid=75538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_db.sqlalchemy.engines [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75538) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 09 14:24:41 devstack cinder-volume[75538]: INFO cinder.rpc [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Jul 09 14:24:41 devstack cinder-volume[75538]: INFO cinder.rpc [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Jul 09 14:24:41 devstack cinder-volume[75538]: WARNING stevedore.named [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jul 09 14:24:41 devstack cinder-volume[75538]: WARNING castellan.key_manager [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 09 14:24:41 devstack cinder-volume[75538]: INFO cinder.volume.manager [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_db.sqlalchemy.engines [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75538) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 09 14:24:41 devstack cinder-volume[75538]: INFO oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] Starting 1 workers
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] Started child 75717 {{(pid=75538) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] Full set of CONF: {{(pid=75538) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] ******************************************************************************** {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] Configuration options gathered from: {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] ================================================================================ {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] allow_availability_zone_fallback = False {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] allow_compression_on_image_upload = False {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] allowed_direct_url_schemes     = [] {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] api_rate_limit                 = True {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] auth_strategy                  = keystone {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] az_cache_duration              = 3600 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] backend_availability_zone      = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] backend_host                   = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] backend_name                   = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] backend_stats_polling_interval = 60 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] backup_api_class               = cinder.backup.api.API {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75717]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] backup_name_template           = backup-%s {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] backup_use_same_host           = False {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] backup_use_temp_snapshot       = False {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] chap_password                  = **** {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] chap_username                  =  {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] cinder_internal_tenant_project_id = 6b724ea44e104eeba965f1cf49973270 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] cinder_internal_tenant_user_id = c16967c9cde34819931c468b5fa673c7 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] cloned_volume_same_az          = True {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] cluster                        = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] compression_format             = gzip {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] compute_api_class              = cinder.compute.nova.API {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] config_dir                     = [] {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] config_source                  = [] {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] control_exchange               = openstack {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] debug                          = True {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] default_availability_zone      = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] default_group_type             = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] default_volume_type            = lvmdriver-1 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] disk_geometry                  = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] driver_client_cert             = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] driver_client_cert_key         = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] driver_data_namespace          = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] driver_ssl_cert_path           = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] driver_ssl_cert_verify         = False {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] driver_use_ssl                 = False {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] enable_force_upload            = False {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] enable_new_services            = True {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] enable_unsupported_driver      = False {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] enabled_backends               = ['lvmdriver-1'] {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] enforce_multipath_for_image_xfer = False {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] filter_function                = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] glance_api_insecure            = False {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] glance_api_servers             = ['http://192.168.122.239/image'] {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] glance_api_ssl_compression     = False {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] glance_ca_certificates_file    = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] glance_catalog_info            = image:glance:publicURL {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] glance_certfile                = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] glance_keyfile                 = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] glance_num_retries             = 3 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] glance_request_timeout         = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] goodness_function              = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] graceful_shutdown_timeout      = 5 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] group_api_class                = cinder.group.api.API {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] host                           = devstack {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] image_compress_on_upload       = True {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] image_conversion_address_space_limit = 1 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] image_conversion_cpu_limit     = 60 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] image_conversion_disable       = False {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] image_upload_use_cinder_backend = False {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] image_upload_use_internal_tenant = False {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] image_volume_cache_enabled     = False {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] image_volume_cache_max_count   = 0 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] image_volume_cache_max_size_gb = 0 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] init_host_max_objects_retrieval = 0 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] instance_format                = [instance: %(uuid)s]  {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] iscsi_target_flags             =  {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] iscsi_write_cache              = on {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] iser_helper                    = tgtadm {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] iser_ip_address                = 192.168.122.239 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] iser_port                      = 3260 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] log_color                      = False {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] log_config_append              = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] log_dir                        = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] log_file                       = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] log_options                    = True {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] log_rotate_interval            = 1 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] log_rotate_interval_type       = days {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] log_rotation_type              = none {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] max_age                        = 0 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] max_logfile_count              = 30 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] max_logfile_size_mb            = 200 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] max_over_subscription_ratio    = 20.0 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] message_reap_interval          = 86400 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] message_ttl                    = 2592000 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] migration_create_volume_timeout_secs = 300 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] monkey_patch                   = False {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] monkey_patch_modules           = [] {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] my_ip                          = 192.168.122.239 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] no_snapshot_gb_quota           = False {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] num_iser_scan_tries            = 3 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] num_shell_tries                = 3 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] num_volume_device_scan_tries   = 3 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] nvmeof_conn_info_version       = 1 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] nvmet_ns_id                    = 10 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] nvmet_port_id                  = 1 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] osapi_max_limit                = 1000 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] osapi_volume_ext_list          = [] {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] osapi_volume_listen            = 0.0.0.0 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] osapi_volume_listen_port       = 8776 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] osapi_volume_use_ssl           = False {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] osapi_volume_workers           = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75717]: INFO cinder.volume.manager [None req-1480446a-24ee-437b-a06f-e71cc2825f04 None None] Starting volume driver LVMVolumeDriver (3.0.0)
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] per_volume_size_limit          = -1 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] periodic_fuzzy_delay           = 60 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-1480446a-24ee-437b-a06f-e71cc2825f04 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:24:41 devstack sudo[75721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] periodic_interval              = 60 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] project_id_regex               = [0-9a-f\-]+ {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] public_endpoint                = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] publish_errors                 = False {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] quota_backup_gigabytes         = 1000 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] quota_backups                  = 10 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack sudo[75721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] quota_gigabytes                = 1000 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] quota_groups                   = 10 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] quota_snapshots                = 10 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] quota_volumes                  = 10 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] rate_limit_burst               = 0 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] rate_limit_except_level        = CRITICAL {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:41 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] rate_limit_interval            = 0 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] reinit_driver_count            = 3 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] replication_device             = **** {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] report_discard_supported       = False {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] report_interval                = 120 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] reservation_clean_interval     = 86400 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] reservation_expire             = 86400 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] reserved_image_namespaces      = [] {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] reserved_percentage            = 0 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] rpc_response_timeout           = 120 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] run_external_periodic_tasks    = True {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] scst_target_driver             = iscsi {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] scst_target_iqn_name           = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] service_down_time              = 720 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] shell_completion               = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] snapshot_name_template         = snapshot-%s {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] snapshot_same_host             = True {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] split_loggers                  = False {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] state_path                     = /opt/stack/data/cinder {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] storage_availability_zone      = nova {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] storage_protocol               = iSCSI {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] syslog_log_facility            = LOG_USER {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] target_helper                  = lioadm {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] target_ip_address              = 192.168.122.239 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] target_port                    = 3260 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] target_protocol                = iscsi {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] target_secondary_ip_addresses  = [] {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] trace_flags                    = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] transfer_api_class             = cinder.transfer.api.API {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] transport_url                  = **** {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] until_refresh                  = 0 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] use_chap_auth                  = False {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] use_default_quota_class        = True {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] use_journal                    = False {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] use_json                       = False {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] use_multipath_for_image_xfer   = False {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] use_stderr                     = False {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] use_syslog                     = False {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] verify_glance_signatures       = enabled {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] volume_api_class               = cinder.volume.api.API {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] volume_backend_name            = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] volume_clear                   = zero {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] volume_clear_ionice            = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] volume_clear_size              = 0 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] volume_copy_bps_limit          = 0 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] volume_dd_blocksize            = 1M {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] volume_name_template           = volume-%s {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] volume_service_inithost_offload = False {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] volume_usage_audit_period      = month {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] zoning_mode                    = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] oslo_concurrency.disable_process_locking = False {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-1480446a-24ee-437b-a06f-e71cc2825f04 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.060s {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-1480446a-24ee-437b-a06f-e71cc2825f04 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] keystone_authtoken.auth_section = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] keystone_authtoken.auth_type   = password {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] keystone_authtoken.auth_version = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] keystone_authtoken.cache       = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] keystone_authtoken.certfile    = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] keystone_authtoken.delay_auth_decision = False {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] keystone_authtoken.http_connect_timeout = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] keystone_authtoken.include_service_catalog = True {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] keystone_authtoken.insecure    = False {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] keystone_authtoken.interface   = public {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] keystone_authtoken.keyfile     = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] keystone_authtoken.memcache_password =  {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] keystone_authtoken.memcache_username =  {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] keystone_authtoken.region_name = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] keystone_authtoken.service_token_roles_required = True {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] keystone_authtoken.service_type = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] keystone_authtoken.token_cache_time = 300 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.239/identity {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] cache.backend                  = dogpile.cache.null {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-1480446a-24ee-437b-a06f-e71cc2825f04 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.040s {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] cache.backend_argument         = **** {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] cache.backend_expiration_time  = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-1480446a-24ee-437b-a06f-e71cc2825f04 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] cache.config_prefix            = cache.oslo {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] cache.debug_cache_backend      = False {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] cache.enable_retry_client      = False {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] cache.enable_socket_keepalive  = False {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] cache.enabled                  = False {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] cache.expiration_time          = 600 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] cache.hashclient_retry_attempts = 2 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] cache.memcache_dead_retry      = 300 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] cache.memcache_pool_maxsize    = 10 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] cache.memcache_sasl_enabled    = False {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] cache.password                 = **** {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] cache.proxies                  = [] {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] cache.redis_db                 = 0 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] cache.redis_sentinel_service_name = mymaster {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] cache.redis_server             = localhost:6379 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] cache.retry_attempts           = 2 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] cache.retry_delay              = 0.0 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] cache.socket_keepalive_count   = 1 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] cache.socket_keepalive_idle    = 1 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] cache.socket_keepalive_interval = 1 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] cache.socket_timeout           = 1.0 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] cache.tls_allowed_ciphers      = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] cache.tls_cafile               = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] cache.tls_certfile             = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] cache.tls_enabled              = False {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] cache.tls_keyfile              = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] cache.username                 = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] coordination.backend_url       = **** {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] database.asyncio_connection    = **** {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] database.asyncio_slave_connection = **** {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] database.backend               = sqlalchemy {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] database.connection            = **** {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] database.connection_debug      = 0 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] database.connection_parameters =  {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] database.connection_recycle_time = 3600 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] database.connection_trace      = False {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] database.db_inc_retry_interval = True {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] database.db_max_retries        = 20 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] database.db_max_retry_interval = 10 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] database.db_retry_interval     = 1 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] database.max_overflow          = 50 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] database.max_pool_size         = 5 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] database.max_retries           = 10 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] database.mysql_wsrep_sync_wait = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] database.pool_timeout          = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] database.retry_interval        = 10 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] database.slave_connection      = **** {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] database.sqlite_synchronous    = True {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] database.synchronous_reader    = True {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] database.use_db_reconnect      = False {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] profiler.connection_string     = messaging:// {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] profiler.enabled               = False {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] profiler.es_doc_type           = notification {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] profiler.es_scroll_size        = 10000 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] profiler.es_scroll_time        = 2m {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-1480446a-24ee-437b-a06f-e71cc2825f04 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.040s {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] profiler.filter_error_trace    = False {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-1480446a-24ee-437b-a06f-e71cc2825f04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] profiler.hmac_keys             = **** {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] profiler.sentinel_service_name = mymaster {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] profiler.socket_timeout        = 0.1 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] profiler.trace_requests        = False {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] profiler.trace_sqlalchemy      = False {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] profiler_jaeger.process_tags   = {} {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] profiler_jaeger.service_name_prefix = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] profiler_otlp.service_name_prefix = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] oslo_policy.enforce_new_defaults = True {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] oslo_policy.enforce_scope      = False {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] oslo_policy.policy_default_rule = default {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] oslo_policy.policy_file        = policy.yaml {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] oslo_policy.remote_timeout     = 60.0 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] privsep_osbrick.group          = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] privsep_osbrick.helper_command = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] privsep_osbrick.user           = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] cinder_sys_admin.group         = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] cinder_sys_admin.helper_command = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] cinder_sys_admin.user          = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] service_user.auth_section      = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] service_user.auth_type         = password {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] service_user.cafile            = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] service_user.certfile          = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] service_user.collect_timing    = False {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] service_user.insecure          = False {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] service_user.keyfile           = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] service_user.send_service_user_token = True {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] service_user.split_loggers     = False {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] service_user.timeout           = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] glance.auth_section            = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] glance.auth_type               = password {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] glance.certfile                = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] glance.collect_timing          = False {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] glance.insecure                = False {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] glance.keyfile                 = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] glance.region_name             = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] glance.split_loggers           = False {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] glance.timeout                 = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] backend_defaults.backend_availability_zone = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] backend_defaults.chap_password = **** {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] backend_defaults.chap_username =  {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] backend_defaults.disk_geometry = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] backend_defaults.driver_client_cert = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] backend_defaults.driver_client_cert_key = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] backend_defaults.driver_data_namespace = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] backend_defaults.driver_use_ssl = False {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] backend_defaults.enable_unsupported_driver = False {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] backend_defaults.extra_capabilities = {} {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] backend_defaults.filter_function = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] backend_defaults.goodness_function = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] backend_defaults.iscsi_target_flags =  {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] backend_defaults.iscsi_write_cache = on {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] backend_defaults.iser_helper   = tgtadm {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] backend_defaults.iser_ip_address = 192.168.122.239 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] backend_defaults.iser_port     = 3260 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] backend_defaults.lvm_mirrors   = 0 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] backend_defaults.lvm_share_target = False {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] backend_defaults.lvm_type      = auto {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] backend_defaults.num_shell_tries = 3 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] backend_defaults.nvmet_port_id = 1 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] backend_defaults.replication_device = **** {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] backend_defaults.report_discard_supported = False {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] backend_defaults.reserved_percentage = 0 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] backend_defaults.scst_target_driver = iscsi {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] backend_defaults.scst_target_iqn_name = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] backend_defaults.storage_protocol = iSCSI {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] backend_defaults.target_helper = tgtadm {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] backend_defaults.target_ip_address = 192.168.122.239 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] backend_defaults.target_port   = 3260 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] backend_defaults.target_protocol = iscsi {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] backend_defaults.trace_flags   = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] backend_defaults.unique_fqdn_network = True {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] backend_defaults.use_chap_auth = False {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] backend_defaults.volume_backend_name = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] backend_defaults.volume_clear  = zero {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] backend_defaults.volume_clear_ionice = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] backend_defaults.volume_clear_size = 0 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] backend_defaults.volume_group  = cinder-volumes {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] oslo_reports.file_event_handler = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] oslo_reports.log_dir           = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] lvmdriver-1.backend_availability_zone = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] lvmdriver-1.backend_host       = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] lvmdriver-1.chap_password      = **** {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] lvmdriver-1.chap_username      = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] lvmdriver-1.chiscsi_conf       = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] lvmdriver-1.disk_geometry      = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] lvmdriver-1.driver_client_cert = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] lvmdriver-1.driver_data_namespace = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] lvmdriver-1.driver_use_ssl     = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] lvmdriver-1.extra_capabilities = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] lvmdriver-1.filter_function    = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] lvmdriver-1.goodness_function  = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] lvmdriver-1.iser_helper        = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] lvmdriver-1.iser_ip_address    = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] lvmdriver-1.iser_port          = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] lvmdriver-1.iser_target_prefix = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] lvmdriver-1.lvm_conf_file      = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] lvmdriver-1.lvm_mirrors        = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] lvmdriver-1.lvm_share_target   = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] lvmdriver-1.lvm_type           = auto {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] lvmdriver-1.num_shell_tries    = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] lvmdriver-1.nvmet_port_id      = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] lvmdriver-1.replication_device = **** {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] lvmdriver-1.report_discard_supported = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] lvmdriver-1.reserved_percentage = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] lvmdriver-1.scst_target_driver = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] lvmdriver-1.storage_protocol   = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] lvmdriver-1.target_helper      = lioadm {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] lvmdriver-1.target_ip_address  = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] lvmdriver-1.target_port        = 3260 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] lvmdriver-1.target_protocol    = iscsi {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] lvmdriver-1.trace_flags        = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] lvmdriver-1.use_chap_auth      = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] lvmdriver-1.volume_clear       = zero {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] lvmdriver-1.volume_clear_size  = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] lvmdriver-1.volumes_dir        = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] oslo_messaging_rabbit.ssl      = False {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] oslo_messaging_notifications.driver = [] {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] oslo_messaging_notifications.retry = -1 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] oslo_messaging_notifications.transport_url = **** {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] key_manager.fixed_key          = **** {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] barbican.barbican_api_version  = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] barbican.barbican_endpoint     = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] barbican.barbican_endpoint_type = public {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] barbican.barbican_region_name  = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] barbican.cafile                = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] barbican.certfile              = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] barbican.collect_timing        = False {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] barbican.insecure              = False {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] barbican.keyfile               = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] barbican.number_of_retries     = 60 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] barbican.retry_delay           = 1 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] barbican.send_service_user_token = False {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] barbican.split_loggers         = False {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] barbican.timeout               = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] barbican.verify_ssl            = True {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] barbican.verify_ssl_path       = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] barbican_service_user.auth_section = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] barbican_service_user.auth_type = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] barbican_service_user.cafile   = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] barbican_service_user.certfile = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] barbican_service_user.collect_timing = False {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] barbican_service_user.insecure = False {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] barbican_service_user.keyfile  = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] barbican_service_user.split_loggers = False {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] barbican_service_user.timeout  = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] vault.approle_role_id          = **** {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] vault.approle_secret_id        = **** {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] vault.kv_mountpoint            = secret {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] vault.kv_path                  = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] vault.kv_version               = 2 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] vault.namespace                = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] vault.root_token_id            = **** {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] vault.ssl_ca_crt_file          = None {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] vault.timeout                  = 60.0 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] vault.use_ssl                  = False {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:24:42 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] ******************************************************************************** {{(pid=75538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}}
Jul 09 14:24:42 devstack sudo[75721]: pam_unix(sudo:session): session closed for user root
Jul 09 14:24:42 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-1480446a-24ee-437b-a06f-e71cc2825f04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.882s {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:24:42 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-1480446a-24ee-437b-a06f-e71cc2825f04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:24:42 devstack sudo[75727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 09 14:24:42 devstack sudo[75727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:24:43 devstack sudo[75727]: pam_unix(sudo:session): session closed for user root
Jul 09 14:24:43 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-1480446a-24ee-437b-a06f-e71cc2825f04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.647s {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:24:43 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-1480446a-24ee-437b-a06f-e71cc2825f04 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 09 14:24:43 devstack cinder-volume[75717]: INFO cinder.brick.local_dev.lvm [None req-1480446a-24ee-437b-a06f-e71cc2825f04 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Jul 09 14:24:43 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-1480446a-24ee-437b-a06f-e71cc2825f04 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:24:43 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-1480446a-24ee-437b-a06f-e71cc2825f04 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:24:43 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-1480446a-24ee-437b-a06f-e71cc2825f04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:24:43 devstack sudo[75985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 09 14:24:43 devstack sudo[75985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:24:44 devstack sudo[75985]: pam_unix(sudo:session): session closed for user root
Jul 09 14:24:44 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-1480446a-24ee-437b-a06f-e71cc2825f04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.636s {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:24:44 devstack cinder-volume[75717]: DEBUG cinder.brick.local_dev.lvm [None req-1480446a-24ee-437b-a06f-e71cc2825f04 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75717) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}}
Jul 09 14:24:44 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-1480446a-24ee-437b-a06f-e71cc2825f04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:24:44 devstack sudo[76183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 09 14:24:44 devstack sudo[76183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:24:45 devstack sudo[76183]: pam_unix(sudo:session): session closed for user root
Jul 09 14:24:45 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-1480446a-24ee-437b-a06f-e71cc2825f04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.512s {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:24:45 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-1480446a-24ee-437b-a06f-e71cc2825f04 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:24:45 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-1480446a-24ee-437b-a06f-e71cc2825f04 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:24:45 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-1480446a-24ee-437b-a06f-e71cc2825f04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:24:45 devstack sudo[76451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 09 14:24:45 devstack sudo[76451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:24:46 devstack sudo[76451]: pam_unix(sudo:session): session closed for user root
Jul 09 14:24:46 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-1480446a-24ee-437b-a06f-e71cc2825f04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.688s {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:24:46 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-1480446a-24ee-437b-a06f-e71cc2825f04 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:24:46 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-1480446a-24ee-437b-a06f-e71cc2825f04 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:24:46 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-1480446a-24ee-437b-a06f-e71cc2825f04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:24:46 devstack sudo[76503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Jul 09 14:24:46 devstack sudo[76503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:24:47 devstack sudo[76503]: pam_unix(sudo:session): session closed for user root
Jul 09 14:24:47 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-1480446a-24ee-437b-a06f-e71cc2825f04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.708s {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:24:47 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-1480446a-24ee-437b-a06f-e71cc2825f04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:24:47 devstack sudo[76508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 09 14:24:47 devstack sudo[76508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:24:47 devstack sudo[76508]: pam_unix(sudo:session): session closed for user root
Jul 09 14:24:47 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-1480446a-24ee-437b-a06f-e71cc2825f04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.720s {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:24:47 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-1480446a-24ee-437b-a06f-e71cc2825f04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:24:47 devstack sudo[76512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 09 14:24:47 devstack sudo[76512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:24:48 devstack sudo[76512]: pam_unix(sudo:session): session closed for user root
Jul 09 14:24:48 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-1480446a-24ee-437b-a06f-e71cc2825f04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.889s {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:24:48 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-1480446a-24ee-437b-a06f-e71cc2825f04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:24:48 devstack sudo[76524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 09 14:24:48 devstack sudo[76524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:24:49 devstack sudo[76524]: pam_unix(sudo:session): session closed for user root
Jul 09 14:24:49 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-1480446a-24ee-437b-a06f-e71cc2825f04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.819s {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:24:49 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-1480446a-24ee-437b-a06f-e71cc2825f04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:24:49 devstack sudo[76531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 09 14:24:49 devstack sudo[76531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:24:50 devstack sudo[76531]: pam_unix(sudo:session): session closed for user root
Jul 09 14:24:50 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-1480446a-24ee-437b-a06f-e71cc2825f04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.790s {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:24:50 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-1480446a-24ee-437b-a06f-e71cc2825f04 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:24:50 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-1480446a-24ee-437b-a06f-e71cc2825f04 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:24:50 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-1480446a-24ee-437b-a06f-e71cc2825f04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:24:50 devstack sudo[76536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 09 14:24:50 devstack sudo[76536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:24:50 devstack sudo[76536]: pam_unix(sudo:session): session closed for user root
Jul 09 14:24:50 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-1480446a-24ee-437b-a06f-e71cc2825f04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.676s {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:24:50 devstack cinder-volume[75717]: INFO cinder.volume.drivers.lvm [None req-1480446a-24ee-437b-a06f-e71cc2825f04 None None] Enabling LVM thin provisioning by default because a thin pool exists.
Jul 09 14:24:50 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-1480446a-24ee-437b-a06f-e71cc2825f04 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:24:50 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-1480446a-24ee-437b-a06f-e71cc2825f04 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:24:50 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-1480446a-24ee-437b-a06f-e71cc2825f04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:24:51 devstack sudo[76549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 09 14:24:51 devstack sudo[76549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:24:51 devstack cinder-volume[75538]: DEBUG dbcounter [-] [75538] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 14:24:51 devstack sudo[76549]: pam_unix(sudo:session): session closed for user root
Jul 09 14:24:51 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-1480446a-24ee-437b-a06f-e71cc2825f04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.883s {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:24:51 devstack cinder-volume[75717]: DEBUG cinder.volume.drivers.lvm [None req-1480446a-24ee-437b-a06f-e71cc2825f04 None None] Updating volume stats {{(pid=75717) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 09 14:24:51 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-1480446a-24ee-437b-a06f-e71cc2825f04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:24:51 devstack sudo[76667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 09 14:24:51 devstack sudo[76667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:24:52 devstack sudo[76667]: pam_unix(sudo:session): session closed for user root
Jul 09 14:24:52 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-1480446a-24ee-437b-a06f-e71cc2825f04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.631s {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:24:52 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-1480446a-24ee-437b-a06f-e71cc2825f04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:24:52 devstack sudo[76778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 09 14:24:52 devstack sudo[76778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:24:53 devstack sudo[76778]: pam_unix(sudo:session): session closed for user root
Jul 09 14:24:53 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-1480446a-24ee-437b-a06f-e71cc2825f04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.630s {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:24:53 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-1480446a-24ee-437b-a06f-e71cc2825f04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:24:53 devstack sudo[76816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 09 14:24:53 devstack sudo[76816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:24:53 devstack sudo[76816]: pam_unix(sudo:session): session closed for user root
Jul 09 14:24:53 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-1480446a-24ee-437b-a06f-e71cc2825f04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.637s {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:24:53 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-1480446a-24ee-437b-a06f-e71cc2825f04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:24:53 devstack sudo[76819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 09 14:24:53 devstack sudo[76819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:24:54 devstack sudo[76819]: pam_unix(sudo:session): session closed for user root
Jul 09 14:24:54 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-1480446a-24ee-437b-a06f-e71cc2825f04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.625s {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:24:54 devstack cinder-volume[75717]: INFO cinder.volume.driver [None req-1480446a-24ee-437b-a06f-e71cc2825f04 None None] Driver hasn't implemented _init_vendor_properties()
Jul 09 14:24:54 devstack cinder-volume[75717]: DEBUG cinder.volume.driver [None req-1480446a-24ee-437b-a06f-e71cc2825f04 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75717) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jul 09 14:24:54 devstack cinder-volume[75717]: DEBUG oslo_db.sqlalchemy.engines [None req-1480446a-24ee-437b-a06f-e71cc2825f04 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75717) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 09 14:24:54 devstack cinder-volume[75717]: DEBUG dbcounter [-] [75717] Writer thread running {{(pid=75717) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 09 14:24:54 devstack cinder-volume[75717]: DEBUG cinder.db.api [None req-1480446a-24ee-437b-a06f-e71cc2825f04 None None] Building query based on filter {{(pid=75717) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Jul 09 14:24:54 devstack cinder-volume[75717]: DEBUG cinder.image.image_utils [None req-1480446a-24ee-437b-a06f-e71cc2825f04 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75717) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jul 09 14:24:54 devstack cinder-volume[75717]: INFO cinder.keymgr.migration [None req-022bf85b-c7a4-431b-bdbc-35d64539dbee None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jul 09 14:24:54 devstack cinder-volume[75717]: DEBUG cinder.volume.drivers.lvm [None req-1480446a-24ee-437b-a06f-e71cc2825f04 None None] Updating volume stats {{(pid=75717) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 09 14:24:54 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-1480446a-24ee-437b-a06f-e71cc2825f04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:24:54 devstack sudo[76823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 09 14:24:54 devstack sudo[76823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:24:55 devstack sudo[76823]: pam_unix(sudo:session): session closed for user root
Jul 09 14:24:55 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-1480446a-24ee-437b-a06f-e71cc2825f04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.705s {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:24:55 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-1480446a-24ee-437b-a06f-e71cc2825f04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:24:55 devstack sudo[76830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 09 14:24:55 devstack sudo[76830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:24:55 devstack sudo[76830]: pam_unix(sudo:session): session closed for user root
Jul 09 14:24:55 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-1480446a-24ee-437b-a06f-e71cc2825f04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.682s {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:24:55 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-1480446a-24ee-437b-a06f-e71cc2825f04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:24:55 devstack sudo[76834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 09 14:24:55 devstack sudo[76834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:24:56 devstack sudo[76834]: pam_unix(sudo:session): session closed for user root
Jul 09 14:24:56 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-1480446a-24ee-437b-a06f-e71cc2825f04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.707s {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:24:56 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-1480446a-24ee-437b-a06f-e71cc2825f04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:24:56 devstack sudo[76837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 09 14:24:56 devstack sudo[76837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:24:57 devstack sudo[76837]: pam_unix(sudo:session): session closed for user root
Jul 09 14:24:57 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-1480446a-24ee-437b-a06f-e71cc2825f04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.723s {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:24:57 devstack cinder-volume[75717]: DEBUG cinder.manager [None req-1480446a-24ee-437b-a06f-e71cc2825f04 None None] Notifying Schedulers of capabilities ... {{(pid=75717) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:24:57 devstack cinder-volume[75717]: INFO cinder.volume.manager [None req-1480446a-24ee-437b-a06f-e71cc2825f04 None None] Driver initialization completed successfully.
Jul 09 14:24:57 devstack cinder-volume[75717]: INFO cinder.manager [None req-1480446a-24ee-437b-a06f-e71cc2825f04 None None] Initiating service 2 cleanup
Jul 09 14:24:57 devstack cinder-volume[75717]: INFO cinder.manager [None req-1480446a-24ee-437b-a06f-e71cc2825f04 None None] Service 2 cleanup completed.
Jul 09 14:24:57 devstack cinder-volume[75717]: DEBUG cinder.service [None req-1480446a-24ee-437b-a06f-e71cc2825f04 None None] Creating RPC server for service cinder-volume {{(pid=75717) start /opt/stack/cinder/cinder/service.py:231}}
Jul 09 14:24:57 devstack cinder-volume[75717]: DEBUG cinder.service [None req-1480446a-24ee-437b-a06f-e71cc2825f04 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75717) start /opt/stack/cinder/cinder/service.py:237}}
Jul 09 14:24:57 devstack cinder-volume[75717]: INFO cinder.volume.manager [None req-1480446a-24ee-437b-a06f-e71cc2825f04 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Jul 09 14:24:57 devstack cinder-volume[75717]: DEBUG cinder.volume.drivers.lvm [None req-1480446a-24ee-437b-a06f-e71cc2825f04 None None] Updating volume stats {{(pid=75717) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 09 14:24:57 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-1480446a-24ee-437b-a06f-e71cc2825f04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:24:57 devstack sudo[76841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 09 14:24:57 devstack sudo[76841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:24:58 devstack sudo[76841]: pam_unix(sudo:session): session closed for user root
Jul 09 14:24:58 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-1480446a-24ee-437b-a06f-e71cc2825f04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.642s {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:24:58 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-1480446a-24ee-437b-a06f-e71cc2825f04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:24:58 devstack sudo[76845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 09 14:24:58 devstack sudo[76845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:24:58 devstack sudo[76845]: pam_unix(sudo:session): session closed for user root
Jul 09 14:24:58 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-1480446a-24ee-437b-a06f-e71cc2825f04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.673s {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:24:58 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-1480446a-24ee-437b-a06f-e71cc2825f04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:24:58 devstack sudo[76851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 09 14:24:58 devstack sudo[76851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:24:59 devstack sudo[76851]: pam_unix(sudo:session): session closed for user root
Jul 09 14:24:59 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-1480446a-24ee-437b-a06f-e71cc2825f04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.665s {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:24:59 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-1480446a-24ee-437b-a06f-e71cc2825f04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:24:59 devstack sudo[76889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 09 14:24:59 devstack sudo[76889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:25:00 devstack sudo[76889]: pam_unix(sudo:session): session closed for user root
Jul 09 14:25:00 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-1480446a-24ee-437b-a06f-e71cc2825f04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.655s {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:25:00 devstack cinder-volume[75717]: INFO cinder.volume.manager [None req-1480446a-24ee-437b-a06f-e71cc2825f04 None None] Driver post RPC initialization completed successfully.
Jul 09 14:25:10 devstack cinder-volume[75717]: DEBUG dbcounter [-] [75717] Writing DB stats cinder:SELECT=4 {{(pid=75717) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 14:25:10 devstack cinder-volume[75717]: DEBUG dbcounter [-] [75717] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75717) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 14:25:54 devstack cinder-volume[75717]: DEBUG oslo_service.periodic_task [None req-10f98a5b-03ad-418b-9040-e2532346f6c0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75717) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 14:25:54 devstack cinder-volume[75717]: DEBUG cinder.volume.drivers.lvm [None req-10f98a5b-03ad-418b-9040-e2532346f6c0 None None] Updating volume stats {{(pid=75717) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 09 14:25:54 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-10f98a5b-03ad-418b-9040-e2532346f6c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:25:54 devstack sudo[79018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 09 14:25:54 devstack sudo[79018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:25:54 devstack sudo[79018]: pam_unix(sudo:session): session closed for user root
Jul 09 14:25:54 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-10f98a5b-03ad-418b-9040-e2532346f6c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.614s {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:25:54 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-10f98a5b-03ad-418b-9040-e2532346f6c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:25:54 devstack sudo[79021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 09 14:25:54 devstack sudo[79021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:25:55 devstack sudo[79021]: pam_unix(sudo:session): session closed for user root
Jul 09 14:25:55 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-10f98a5b-03ad-418b-9040-e2532346f6c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.615s {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:25:55 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-10f98a5b-03ad-418b-9040-e2532346f6c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:25:55 devstack sudo[79024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 09 14:25:55 devstack sudo[79024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:25:56 devstack sudo[79024]: pam_unix(sudo:session): session closed for user root
Jul 09 14:25:56 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-10f98a5b-03ad-418b-9040-e2532346f6c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.645s {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:25:56 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-10f98a5b-03ad-418b-9040-e2532346f6c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:25:56 devstack sudo[79045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 09 14:25:56 devstack sudo[79045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:25:56 devstack sudo[79045]: pam_unix(sudo:session): session closed for user root
Jul 09 14:25:56 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-10f98a5b-03ad-418b-9040-e2532346f6c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.637s {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:25:56 devstack cinder-volume[75717]: DEBUG cinder.manager [None req-10f98a5b-03ad-418b-9040-e2532346f6c0 None None] Notifying Schedulers of capabilities ... {{(pid=75717) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:25:56 devstack cinder-volume[75717]: DEBUG oslo_service.periodic_task [None req-10f98a5b-03ad-418b-9040-e2532346f6c0 None None] Running periodic task VolumeManager._thread_info {{(pid=75717) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 14:25:56 devstack cinder-volume[75717]: DEBUG cinder.volume.manager [None req-10f98a5b-03ad-418b-9040-e2532346f6c0 None None] thread count: 6 {{(pid=75717) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 09 14:25:56 devstack cinder-volume[75717]: DEBUG cinder.volume.manager [None req-10f98a5b-03ad-418b-9040-e2532346f6c0 None None] thread info: [<_MainThread(MainThread, started 127540911186048)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127540802405632)>, <Thread(Thread-3 (stat_writer), started daemon 127540799527360)>, <Thread(Rabbit-heartbeat, started daemon 127540799014080)>, <Thread(Thread-5 (_runner), started daemon 127540799146816)>, <Thread(Thread-7 (_runner), started daemon 127540799231744)>] {{(pid=75717) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 09 14:26:54 devstack cinder-volume[75717]: DEBUG oslo_service.periodic_task [None req-10f98a5b-03ad-418b-9040-e2532346f6c0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75717) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 14:26:54 devstack cinder-volume[75717]: DEBUG cinder.volume.drivers.lvm [None req-10f98a5b-03ad-418b-9040-e2532346f6c0 None None] Updating volume stats {{(pid=75717) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 09 14:26:54 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-10f98a5b-03ad-418b-9040-e2532346f6c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:26:54 devstack sudo[82304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 09 14:26:54 devstack sudo[82304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:26:54 devstack sudo[82304]: pam_unix(sudo:session): session closed for user root
Jul 09 14:26:54 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-10f98a5b-03ad-418b-9040-e2532346f6c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.646s {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:26:54 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-10f98a5b-03ad-418b-9040-e2532346f6c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:26:54 devstack sudo[82313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 09 14:26:54 devstack sudo[82313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:26:55 devstack sudo[82313]: pam_unix(sudo:session): session closed for user root
Jul 09 14:26:55 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-10f98a5b-03ad-418b-9040-e2532346f6c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.672s {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:26:55 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-10f98a5b-03ad-418b-9040-e2532346f6c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:26:55 devstack sudo[82331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 09 14:26:55 devstack sudo[82331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:26:56 devstack sudo[82331]: pam_unix(sudo:session): session closed for user root
Jul 09 14:26:56 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-10f98a5b-03ad-418b-9040-e2532346f6c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.676s {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:26:56 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-10f98a5b-03ad-418b-9040-e2532346f6c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:26:56 devstack sudo[82334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 09 14:26:56 devstack sudo[82334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:26:56 devstack sudo[82334]: pam_unix(sudo:session): session closed for user root
Jul 09 14:26:56 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-10f98a5b-03ad-418b-9040-e2532346f6c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.661s {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:26:56 devstack cinder-volume[75717]: DEBUG cinder.manager [None req-10f98a5b-03ad-418b-9040-e2532346f6c0 None None] Notifying Schedulers of capabilities ... {{(pid=75717) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:26:56 devstack cinder-volume[75717]: DEBUG oslo_service.periodic_task [None req-10f98a5b-03ad-418b-9040-e2532346f6c0 None None] Running periodic task VolumeManager._thread_info {{(pid=75717) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 14:26:56 devstack cinder-volume[75717]: DEBUG cinder.volume.manager [None req-10f98a5b-03ad-418b-9040-e2532346f6c0 None None] thread count: 6 {{(pid=75717) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 09 14:26:56 devstack cinder-volume[75717]: DEBUG cinder.volume.manager [None req-10f98a5b-03ad-418b-9040-e2532346f6c0 None None] thread info: [<_MainThread(MainThread, started 127540911186048)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127540802405632)>, <Thread(Thread-3 (stat_writer), started daemon 127540799527360)>, <Thread(Rabbit-heartbeat, started daemon 127540799014080)>, <Thread(Thread-5 (_runner), started daemon 127540799146816)>, <Thread(Thread-7 (_runner), started daemon 127540799231744)>] {{(pid=75717) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 09 14:27:10 devstack cinder-volume[75717]: DEBUG dbcounter [-] [75717] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75717) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 14:27:54 devstack cinder-volume[75717]: DEBUG oslo_service.periodic_task [None req-10f98a5b-03ad-418b-9040-e2532346f6c0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75717) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 14:27:54 devstack cinder-volume[75717]: DEBUG cinder.volume.drivers.lvm [None req-10f98a5b-03ad-418b-9040-e2532346f6c0 None None] Updating volume stats {{(pid=75717) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 09 14:27:54 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-10f98a5b-03ad-418b-9040-e2532346f6c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:27:54 devstack sudo[84268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 09 14:27:54 devstack sudo[84268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:27:54 devstack sudo[84268]: pam_unix(sudo:session): session closed for user root
Jul 09 14:27:54 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-10f98a5b-03ad-418b-9040-e2532346f6c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.620s {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:27:54 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-10f98a5b-03ad-418b-9040-e2532346f6c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:27:54 devstack sudo[84293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 09 14:27:54 devstack sudo[84293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:27:55 devstack sudo[84293]: pam_unix(sudo:session): session closed for user root
Jul 09 14:27:55 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-10f98a5b-03ad-418b-9040-e2532346f6c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.636s {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:27:55 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-10f98a5b-03ad-418b-9040-e2532346f6c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:27:55 devstack sudo[84312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 09 14:27:55 devstack sudo[84312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:27:56 devstack sudo[84312]: pam_unix(sudo:session): session closed for user root
Jul 09 14:27:56 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-10f98a5b-03ad-418b-9040-e2532346f6c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.686s {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:27:56 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-10f98a5b-03ad-418b-9040-e2532346f6c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:27:56 devstack sudo[84339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 09 14:27:56 devstack sudo[84339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:27:56 devstack sudo[84339]: pam_unix(sudo:session): session closed for user root
Jul 09 14:27:56 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-10f98a5b-03ad-418b-9040-e2532346f6c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.663s {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:27:56 devstack cinder-volume[75717]: DEBUG cinder.manager [None req-10f98a5b-03ad-418b-9040-e2532346f6c0 None None] Notifying Schedulers of capabilities ... {{(pid=75717) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:28:54 devstack cinder-volume[75717]: DEBUG oslo_service.periodic_task [None req-10f98a5b-03ad-418b-9040-e2532346f6c0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75717) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 14:28:54 devstack cinder-volume[75717]: DEBUG cinder.volume.drivers.lvm [None req-10f98a5b-03ad-418b-9040-e2532346f6c0 None None] Updating volume stats {{(pid=75717) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 09 14:28:54 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-10f98a5b-03ad-418b-9040-e2532346f6c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:28:54 devstack sudo[85639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 09 14:28:54 devstack sudo[85639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:28:54 devstack sudo[85639]: pam_unix(sudo:session): session closed for user root
Jul 09 14:28:54 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-10f98a5b-03ad-418b-9040-e2532346f6c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.633s {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:28:54 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-10f98a5b-03ad-418b-9040-e2532346f6c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:28:54 devstack sudo[85648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 09 14:28:54 devstack sudo[85648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:28:55 devstack sudo[85648]: pam_unix(sudo:session): session closed for user root
Jul 09 14:28:55 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-10f98a5b-03ad-418b-9040-e2532346f6c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.635s {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:28:55 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-10f98a5b-03ad-418b-9040-e2532346f6c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:28:55 devstack sudo[85667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 09 14:28:55 devstack sudo[85667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:28:56 devstack sudo[85667]: pam_unix(sudo:session): session closed for user root
Jul 09 14:28:56 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-10f98a5b-03ad-418b-9040-e2532346f6c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.644s {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:28:56 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-10f98a5b-03ad-418b-9040-e2532346f6c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:28:56 devstack sudo[85693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 09 14:28:56 devstack sudo[85693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:28:56 devstack sudo[85693]: pam_unix(sudo:session): session closed for user root
Jul 09 14:28:56 devstack cinder-volume[75717]: DEBUG oslo_concurrency.processutils [None req-10f98a5b-03ad-418b-9040-e2532346f6c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.669s {{(pid=75717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:28:56 devstack cinder-volume[75717]: DEBUG cinder.manager [None req-10f98a5b-03ad-418b-9040-e2532346f6c0 None None] Notifying Schedulers of capabilities ... {{(pid=75717) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:28:56 devstack cinder-volume[75717]: DEBUG oslo_service.periodic_task [None req-10f98a5b-03ad-418b-9040-e2532346f6c0 None None] Running periodic task VolumeManager._thread_info {{(pid=75717) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 14:28:56 devstack cinder-volume[75717]: DEBUG cinder.volume.manager [None req-10f98a5b-03ad-418b-9040-e2532346f6c0 None None] thread count: 6 {{(pid=75717) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 09 14:28:56 devstack cinder-volume[75717]: DEBUG cinder.volume.manager [None req-10f98a5b-03ad-418b-9040-e2532346f6c0 None None] thread info: [<_MainThread(MainThread, started 127540911186048)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127540802405632)>, <Thread(Thread-3 (stat_writer), started daemon 127540799527360)>, <Thread(Rabbit-heartbeat, started daemon 127540799014080)>, <Thread(Thread-5 (_runner), started daemon 127540799146816)>, <Thread(Thread-7 (_runner), started daemon 127540799231744)>] {{(pid=75717) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 09 14:29:10 devstack cinder-volume[75717]: DEBUG dbcounter [-] [75717] Writing DB stats cinder:SELECT=1 {{(pid=75717) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 14:29:10 devstack cinder-volume[75717]: DEBUG dbcounter [-] [75717] Writing DB stats cinder:UPDATE=1 {{(pid=75717) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 14:29:17 devstack cinder-volume[75538]: INFO oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] Caught SIGTERM, stopping children
Jul 09 14:29:17 devstack cinder-volume[75538]: DEBUG oslo_concurrency.lockutils [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] Acquiring lock "singleton_lock" {{(pid=75538) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 09 14:29:17 devstack cinder-volume[75538]: DEBUG oslo_concurrency.lockutils [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] Acquired lock "singleton_lock" {{(pid=75538) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 09 14:29:17 devstack cinder-volume[75538]: DEBUG oslo_concurrency.lockutils [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] Releasing lock "singleton_lock" {{(pid=75538) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 09 14:29:17 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] Stop services. {{(pid=75538) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Jul 09 14:29:17 devstack cinder-volume[75538]: DEBUG oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] Killing children. {{(pid=75538) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Jul 09 14:29:17 devstack cinder-volume[75538]: INFO oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] Waiting on 1 children to exit
Jul 09 14:29:22 devstack cinder-volume[75717]: DEBUG oslo_concurrency.lockutils [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] Acquiring lock "singleton_lock" {{(pid=75717) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 09 14:29:22 devstack cinder-volume[75717]: DEBUG oslo_concurrency.lockutils [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] Acquired lock "singleton_lock" {{(pid=75717) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 09 14:29:22 devstack cinder-volume[75717]: DEBUG oslo_concurrency.lockutils [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] Releasing lock "singleton_lock" {{(pid=75717) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 09 14:29:22 devstack cinder-volume[75717]: WARNING amqp [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jul 09 14:29:22 devstack cinder-volume[75717]: WARNING amqp [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jul 09 14:29:22 devstack cinder-volume[75538]: INFO oslo_service.backend._eventlet.service [None req-93278edc-0136-4ae2-a38e-33c232ecd20c None None] Child 75717 exited with status 0
Jul 09 14:29:22 devstack cinder-volume[86240]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Jul 09 14:29:22 devstack cinder-volume[86240]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 09 14:29:22 devstack cinder-volume[86240]: we strongly recommend against using it for new projects.
Jul 09 14:29:22 devstack cinder-volume[86240]: If you are already using Eventlet, we recommend migrating to a different
Jul 09 14:29:22 devstack cinder-volume[86240]: framework.  For more detail see
Jul 09 14:29:22 devstack cinder-volume[86240]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 09 14:29:22 devstack cinder-volume[86240]:   import eventlet  # noqa
Jul 09 14:29:24 devstack cinder-volume[86240]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86240) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 09 14:29:24 devstack cinder-volume[86240]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86240) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 09 14:29:24 devstack cinder-volume[86240]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86240) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 09 14:29:25 devstack cinder-volume[86240]: INFO dbcounter [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] Registered counter for database cinder
Jul 09 14:29:25 devstack cinder-volume[86240]: DEBUG oslo_db.sqlalchemy.engines [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86240) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 09 14:29:25 devstack cinder-volume[86240]: DEBUG dbcounter [-] [86240] Writer thread running {{(pid=86240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 09 14:29:25 devstack cinder-volume[86240]: INFO cinder.rpc [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jul 09 14:29:25 devstack cinder-volume[86240]: INFO cinder.rpc [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jul 09 14:29:25 devstack cinder-volume[86240]: DEBUG oslo_db.sqlalchemy.engines [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86240) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 09 14:29:25 devstack cinder-volume[86240]: INFO cinder.volume.manager [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] Determined volume DB was empty at startup.
Jul 09 14:29:25 devstack cinder-volume[86240]: DEBUG cinder.volume.manager [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86240) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jul 09 14:29:26 devstack cinder-volume[86240]: INFO cinder.volume.manager [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] Service not found for updating active_backend_id, assuming default for driver init.
Jul 09 14:29:26 devstack cinder-volume[86240]: WARNING stevedore.named [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jul 09 14:29:26 devstack cinder-volume[86240]: WARNING castellan.key_manager [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 09 14:29:26 devstack cinder-volume[86240]: WARNING cinder.keymgr.conf_key_mgr [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 09 14:29:26 devstack cinder-volume[86240]: INFO cinder.volume.manager [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] Image-volume cache disabled for host devstack@QuobyteHD.
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_db.sqlalchemy.engines [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86240) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 09 14:29:26 devstack cinder-volume[86240]: INFO oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] Starting 1 workers
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] Started child 86457 {{(pid=86240) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] Full set of CONF: {{(pid=86240) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] ******************************************************************************** {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] Configuration options gathered from: {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] ================================================================================ {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] allow_availability_zone_fallback = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] allow_compression_on_image_upload = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] allowed_direct_url_schemes     = [] {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] api_rate_limit                 = True {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] auth_strategy                  = keystone {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] backend_availability_zone      = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] backend_host                   = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] backend_name                   = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] backend_stats_polling_interval = 60 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] backup_api_class               = cinder.backup.api.API {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] backup_name_template           = backup-%s {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] backup_use_same_host           = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] backup_use_temp_snapshot       = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] chap_password                  = **** {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] chap_username                  =  {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] cinder_internal_tenant_project_id = 6b724ea44e104eeba965f1cf49973270 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] cinder_internal_tenant_user_id = c16967c9cde34819931c468b5fa673c7 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] cluster                        = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] compression_format             = gzip {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] compute_api_class              = cinder.compute.nova.API {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] config_dir                     = [] {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] config_source                  = [] {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] control_exchange               = openstack {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] debug                          = True {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] default_availability_zone      = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] default_group_type             = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] default_volume_type            = QuobyteHD {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] disk_geometry                  = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] driver_client_cert             = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] driver_client_cert_key         = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] driver_data_namespace          = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] driver_ssl_cert_path           = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] driver_ssl_cert_verify         = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] driver_use_ssl                 = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] enable_new_services            = True {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] enable_unsupported_driver      = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] enabled_backends               = ['QuobyteHD'] {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] enforce_multipath_for_image_xfer = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] filter_function                = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] glance_api_insecure            = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] glance_api_servers             = ['http://192.168.122.239/image'] {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] glance_api_ssl_compression     = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] glance_ca_certificates_file    = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] glance_catalog_info            = image:glance:publicURL {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] glance_certfile                = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] glance_keyfile                 = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] glance_num_retries             = 3 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] glance_request_timeout         = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] goodness_function              = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86457]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] graceful_shutdown_timeout      = 5 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] group_api_class                = cinder.group.api.API {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] host                           = devstack {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] image_compress_on_upload       = True {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] image_conversion_address_space_limit = 1 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] image_conversion_cpu_limit     = 60 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] image_conversion_disable       = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] image_upload_use_cinder_backend = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] image_upload_use_internal_tenant = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] image_volume_cache_enabled     = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] image_volume_cache_max_count   = 0 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] image_volume_cache_max_size_gb = 0 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] init_host_max_objects_retrieval = 0 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] instance_format                = [instance: %(uuid)s]  {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] iscsi_target_flags             =  {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] iscsi_write_cache              = on {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] iser_helper                    = tgtadm {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] iser_ip_address                = 192.168.122.239 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] iser_port                      = 3260 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] log_color                      = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] log_config_append              = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] log_dir                        = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] log_file                       = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] log_options                    = True {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] log_rotate_interval            = 1 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] log_rotate_interval_type       = days {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] log_rotation_type              = none {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] max_age                        = 0 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] max_logfile_count              = 30 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] max_logfile_size_mb            = 200 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] max_over_subscription_ratio    = 20.0 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] message_reap_interval          = 86400 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] message_ttl                    = 2592000 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] migration_create_volume_timeout_secs = 300 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] monkey_patch                   = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] monkey_patch_modules           = [] {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] my_ip                          = 192.168.122.239 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] no_snapshot_gb_quota           = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] num_iser_scan_tries            = 3 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] num_shell_tries                = 3 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] num_volume_device_scan_tries   = 3 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] nvmeof_conn_info_version       = 1 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] nvmet_ns_id                    = 10 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] nvmet_port_id                  = 1 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] osapi_max_limit                = 1000 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] osapi_volume_ext_list          = [] {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] osapi_volume_listen            = 0.0.0.0 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] osapi_volume_listen_port       = 8776 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] osapi_volume_use_ssl           = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] osapi_volume_workers           = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] per_volume_size_limit          = -1 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] periodic_fuzzy_delay           = 60 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] periodic_interval              = 60 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] project_id_regex               = [0-9a-f\-]+ {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] public_endpoint                = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] publish_errors                 = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] quota_backup_gigabytes         = 1000 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] quota_backups                  = 10 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] quota_gigabytes                = 1000 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] quota_groups                   = 10 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] quota_snapshots                = 10 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] quota_volumes                  = 10 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] rate_limit_burst               = 0 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] rate_limit_except_level        = CRITICAL {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] rate_limit_interval            = 0 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] reinit_driver_count            = 3 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] replication_device             = **** {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] report_discard_supported       = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] report_interval                = 120 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] reservation_clean_interval     = 86400 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] reservation_expire             = 86400 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] reserved_image_namespaces      = [] {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] reserved_percentage            = 0 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] rpc_response_timeout           = 120 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] run_external_periodic_tasks    = True {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] scst_target_driver             = iscsi {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] scst_target_iqn_name           = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] service_down_time              = 720 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] shell_completion               = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] snapshot_name_template         = snapshot-%s {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] split_loggers                  = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] state_path                     = /opt/stack/data/cinder {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] storage_availability_zone      = nova {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] storage_protocol               = iSCSI {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] syslog_log_facility            = LOG_USER {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] target_helper                  = lioadm {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] target_ip_address              = 192.168.122.239 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] target_port                    = 3260 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] target_protocol                = iscsi {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] target_secondary_ip_addresses  = [] {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] trace_flags                    = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] transfer_api_class             = cinder.transfer.api.API {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] transport_url                  = **** {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] until_refresh                  = 0 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] use_chap_auth                  = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] use_default_quota_class        = True {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] use_journal                    = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] use_json                       = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] use_multipath_for_image_xfer   = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] use_stderr                     = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] use_syslog                     = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] verify_glance_signatures       = enabled {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] volume_api_class               = cinder.volume.api.API {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] volume_backend_name            = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] volume_clear                   = zero {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] volume_clear_ionice            = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] volume_clear_size              = 0 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] volume_copy_bps_limit          = 0 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] volume_dd_blocksize            = 1M {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] volume_name_template           = volume-%s {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] volume_service_inithost_offload = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] volume_usage_audit_period      = month {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] zoning_mode                    = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] oslo_concurrency.disable_process_locking = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86457]: INFO cinder.volume.manager [None req-c3d52907-e597-44b4-8956-f0a93ffaeb67 None None] Starting volume driver QuobyteDriver (1.1.14)
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86457]: DEBUG cinder.volume.drivers.remotefs [None req-c3d52907-e597-44b4-8956-f0a93ffaeb67 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86457) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] keystone_authtoken.auth_section = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] keystone_authtoken.auth_type   = password {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] keystone_authtoken.auth_version = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] keystone_authtoken.cache       = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] keystone_authtoken.certfile    = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] keystone_authtoken.delay_auth_decision = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] keystone_authtoken.http_connect_timeout = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] keystone_authtoken.include_service_catalog = True {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] keystone_authtoken.insecure    = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] keystone_authtoken.interface   = public {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] keystone_authtoken.keyfile     = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] keystone_authtoken.memcache_password =  {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] keystone_authtoken.memcache_username =  {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] keystone_authtoken.region_name = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] keystone_authtoken.service_token_roles_required = True {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] keystone_authtoken.service_type = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] keystone_authtoken.token_cache_time = 300 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.239/identity {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] cache.backend                  = dogpile.cache.null {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] cache.backend_argument         = **** {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] cache.backend_expiration_time  = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] cache.config_prefix            = cache.oslo {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] cache.debug_cache_backend      = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] cache.enable_retry_client      = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] cache.enable_socket_keepalive  = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] cache.enabled                  = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] cache.expiration_time          = 600 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] cache.hashclient_retry_attempts = 2 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] cache.memcache_dead_retry      = 300 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] cache.memcache_pool_maxsize    = 10 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] cache.memcache_sasl_enabled    = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] cache.password                 = **** {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] cache.proxies                  = [] {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] cache.redis_db                 = 0 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] cache.redis_sentinel_service_name = mymaster {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] cache.redis_server             = localhost:6379 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] cache.retry_attempts           = 2 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] cache.retry_delay              = 0.0 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] cache.socket_keepalive_count   = 1 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] cache.socket_keepalive_idle    = 1 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] cache.socket_keepalive_interval = 1 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] cache.socket_timeout           = 1.0 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] cache.tls_allowed_ciphers      = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] cache.tls_cafile               = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] cache.tls_certfile             = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] cache.tls_enabled              = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] cache.tls_keyfile              = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] cache.username                 = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] coordination.backend_url       = **** {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] database.asyncio_connection    = **** {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] database.asyncio_slave_connection = **** {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] database.backend               = sqlalchemy {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] database.connection            = **** {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] database.connection_debug      = 0 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] database.connection_parameters =  {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] database.connection_recycle_time = 3600 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] database.connection_trace      = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] database.db_inc_retry_interval = True {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] database.db_max_retries        = 20 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] database.db_max_retry_interval = 10 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] database.db_retry_interval     = 1 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] database.max_overflow          = 50 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] database.max_pool_size         = 5 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] database.max_retries           = 10 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] database.mysql_wsrep_sync_wait = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] database.pool_timeout          = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] database.retry_interval        = 10 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] database.slave_connection      = **** {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] database.sqlite_synchronous    = True {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] database.synchronous_reader    = True {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] database.use_db_reconnect      = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] profiler.connection_string     = messaging:// {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] profiler.enabled               = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] profiler.es_doc_type           = notification {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] profiler.es_scroll_size        = 10000 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] profiler.es_scroll_time        = 2m {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] profiler.filter_error_trace    = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] profiler.hmac_keys             = **** {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] profiler.sentinel_service_name = mymaster {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] profiler.socket_timeout        = 0.1 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] profiler.trace_requests        = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] profiler.trace_sqlalchemy      = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] profiler_jaeger.process_tags   = {} {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] profiler_jaeger.service_name_prefix = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] profiler_otlp.service_name_prefix = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] oslo_policy.enforce_new_defaults = True {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] oslo_policy.enforce_scope      = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] oslo_policy.policy_default_rule = default {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] oslo_policy.policy_file        = policy.yaml {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] oslo_policy.remote_timeout     = 60.0 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] privsep_osbrick.group          = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] privsep_osbrick.helper_command = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] privsep_osbrick.user           = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] cinder_sys_admin.group         = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] cinder_sys_admin.helper_command = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] cinder_sys_admin.user          = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] service_user.auth_section      = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] service_user.auth_type         = password {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] service_user.cafile            = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] service_user.certfile          = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] service_user.collect_timing    = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] service_user.insecure          = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] service_user.keyfile           = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] service_user.send_service_user_token = True {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] service_user.split_loggers     = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] service_user.timeout           = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] glance.auth_section            = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] glance.auth_type               = password {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] glance.certfile                = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] glance.collect_timing          = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] glance.insecure                = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] glance.keyfile                 = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] glance.region_name             = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] glance.split_loggers           = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] glance.timeout                 = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] backend_defaults.backend_availability_zone = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] backend_defaults.chap_password = **** {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] backend_defaults.chap_username =  {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] backend_defaults.disk_geometry = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] backend_defaults.driver_client_cert = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] backend_defaults.driver_client_cert_key = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] backend_defaults.driver_data_namespace = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] backend_defaults.driver_use_ssl = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] backend_defaults.enable_unsupported_driver = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] backend_defaults.extra_capabilities = {} {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] backend_defaults.filter_function = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] backend_defaults.goodness_function = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] backend_defaults.iscsi_target_flags =  {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] backend_defaults.iscsi_write_cache = on {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] backend_defaults.iser_helper   = tgtadm {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] backend_defaults.iser_ip_address = 192.168.122.239 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] backend_defaults.iser_port     = 3260 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] backend_defaults.nas_host      =  {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] backend_defaults.nas_login     = admin {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] backend_defaults.nas_mount_options = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] backend_defaults.nas_password  = **** {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] backend_defaults.nas_private_key =  {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] backend_defaults.nas_share_path =  {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] backend_defaults.nas_ssh_port  = 22 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] backend_defaults.num_shell_tries = 3 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] backend_defaults.nvmet_port_id = 1 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] backend_defaults.quobyte_client_cfg = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] backend_defaults.quobyte_volume_url = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] backend_defaults.replication_device = **** {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] backend_defaults.report_discard_supported = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] backend_defaults.reserved_percentage = 0 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] backend_defaults.scst_target_driver = iscsi {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] backend_defaults.scst_target_iqn_name = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] backend_defaults.storage_protocol = iSCSI {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86457]: DEBUG cinder.volume.drivers.quobyte [None req-c3d52907-e597-44b4-8956-f0a93ffaeb67 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86457) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] backend_defaults.target_helper = tgtadm {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] backend_defaults.target_ip_address = 192.168.122.239 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] backend_defaults.target_port   = 3260 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] backend_defaults.target_protocol = iscsi {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] backend_defaults.trace_flags   = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] backend_defaults.unique_fqdn_network = True {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] backend_defaults.use_chap_auth = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] backend_defaults.volume_backend_name = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] backend_defaults.volume_clear  = zero {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] backend_defaults.volume_clear_ionice = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] backend_defaults.volume_clear_size = 0 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86457]: WARNING cinder.volume.drivers.quobyte [None req-c3d52907-e597-44b4-8956-f0a93ffaeb67 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] oslo_reports.file_event_handler = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] oslo_reports.log_dir           = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86457]: WARNING cinder.volume.drivers.quobyte [None req-c3d52907-e597-44b4-8956-f0a93ffaeb67 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] QuobyteHD.backend_availability_zone = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] QuobyteHD.backend_host         = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86457]: DEBUG oslo_concurrency.processutils [None req-c3d52907-e597-44b4-8956-f0a93ffaeb67 None None] Running cmd (subprocess): mount.quobyte {{(pid=86457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] QuobyteHD.chap_password        = **** {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] QuobyteHD.chap_username        = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] QuobyteHD.chiscsi_conf         = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] QuobyteHD.disk_geometry        = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] QuobyteHD.driver_client_cert   = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] QuobyteHD.driver_client_cert_key = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] QuobyteHD.driver_data_namespace = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] QuobyteHD.driver_use_ssl       = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] QuobyteHD.extra_capabilities   = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] QuobyteHD.filter_function      = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] QuobyteHD.goodness_function    = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] QuobyteHD.iscsi_target_flags   = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] QuobyteHD.iscsi_write_cache    = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] QuobyteHD.iser_helper          = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] QuobyteHD.iser_ip_address      = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] QuobyteHD.iser_port            = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] QuobyteHD.iser_target_prefix   = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] QuobyteHD.nas_host             = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] QuobyteHD.nas_login            = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] QuobyteHD.nas_mount_options    = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] QuobyteHD.nas_password         = **** {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] QuobyteHD.nas_private_key      = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] QuobyteHD.nas_share_path       = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] QuobyteHD.nas_ssh_port         = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] QuobyteHD.num_shell_tries      = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] QuobyteHD.nvmet_ns_id          = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] QuobyteHD.nvmet_port_id        = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] QuobyteHD.replication_device   = **** {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] QuobyteHD.report_discard_supported = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] QuobyteHD.reserved_percentage  = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] QuobyteHD.scst_target_driver   = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] QuobyteHD.storage_protocol     = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] QuobyteHD.target_helper        = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] QuobyteHD.target_ip_address    = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] QuobyteHD.target_port          = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] QuobyteHD.target_prefix        = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] QuobyteHD.target_protocol      = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] QuobyteHD.trace_flags          = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] QuobyteHD.unique_fqdn_network  = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] QuobyteHD.use_chap_auth        = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] QuobyteHD.volume_clear         = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] QuobyteHD.volume_clear_ionice  = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] QuobyteHD.volume_clear_size    = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] QuobyteHD.volumes_dir          = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] oslo_messaging_rabbit.ssl      = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] oslo_messaging_rabbit.ssl_version =  {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] oslo_messaging_notifications.driver = [] {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] oslo_messaging_notifications.retry = -1 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] oslo_messaging_notifications.transport_url = **** {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] key_manager.fixed_key          = **** {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] barbican.barbican_api_version  = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] barbican.barbican_endpoint     = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] barbican.barbican_endpoint_type = public {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] barbican.barbican_region_name  = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] barbican.cafile                = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] barbican.certfile              = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] barbican.collect_timing        = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] barbican.insecure              = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] barbican.keyfile               = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] barbican.number_of_retries     = 60 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] barbican.retry_delay           = 1 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] barbican.send_service_user_token = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] barbican.split_loggers         = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] barbican.timeout               = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] barbican.verify_ssl            = True {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] barbican.verify_ssl_path       = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] barbican_service_user.auth_section = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] barbican_service_user.auth_type = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] barbican_service_user.cafile   = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] barbican_service_user.certfile = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] barbican_service_user.collect_timing = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] barbican_service_user.insecure = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] barbican_service_user.keyfile  = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] barbican_service_user.split_loggers = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] barbican_service_user.timeout  = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] vault.approle_role_id          = **** {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] vault.approle_secret_id        = **** {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] vault.kv_mountpoint            = secret {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] vault.kv_path                  = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] vault.kv_version               = 2 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] vault.namespace                = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] vault.root_token_id            = **** {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] vault.ssl_ca_crt_file          = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] vault.timeout                  = 60.0 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] vault.use_ssl                  = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:26 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] ******************************************************************************** {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}}
Jul 09 14:29:26 devstack quobyte-client[86458]: Reading configuration file: /etc/quobyte/client.cfg
Jul 09 14:29:26 devstack quobyte-client[86458]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Jul 09 14:29:26 devstack cinder-volume[86457]: DEBUG oslo_concurrency.processutils [None req-c3d52907-e597-44b4-8956-f0a93ffaeb67 None None] CMD "mount.quobyte" returned: 1 in 0.166s {{(pid=86457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:29:26 devstack cinder-volume[86457]: DEBUG oslo_concurrency.lockutils [None req-c3d52907-e597-44b4-8956-f0a93ffaeb67 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:29:26 devstack cinder-volume[86457]: DEBUG oslo_concurrency.lockutils [None req-c3d52907-e597-44b4-8956-f0a93ffaeb67 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:29:26 devstack cinder-volume[86457]: DEBUG cinder.volume.drivers.quobyte [None req-c3d52907-e597-44b4-8956-f0a93ffaeb67 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=86457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:29:26 devstack cinder-volume[86457]: INFO cinder.volume.drivers.quobyte [None req-c3d52907-e597-44b4-8956-f0a93ffaeb67 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 ...
Jul 09 14:29:26 devstack cinder-volume[86457]: DEBUG oslo_concurrency.processutils [None req-c3d52907-e597-44b4-8956-f0a93ffaeb67 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd -c /etc/quobyte/client-cinder.cfg {{(pid=86457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:29:26 devstack sudo[86463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd -c /etc/quobyte/client-cinder.cfg
Jul 09 14:29:26 devstack sudo[86463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:29:27 devstack sudo[86463]: pam_unix(sudo:session): session closed for user root
Jul 09 14:29:27 devstack cinder-volume[86457]: DEBUG oslo_concurrency.processutils [None req-c3d52907-e597-44b4-8956-f0a93ffaeb67 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.774s {{(pid=86457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:29:27 devstack cinder-volume[86457]: INFO cinder.volume.drivers.quobyte [None req-c3d52907-e597-44b4-8956-f0a93ffaeb67 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 succeeded
Jul 09 14:29:27 devstack cinder-volume[86457]: DEBUG cinder.volume.drivers.quobyte [None req-c3d52907-e597-44b4-8956-f0a93ffaeb67 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=86457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:29:27 devstack cinder-volume[86457]: DEBUG oslo_concurrency.lockutils [None req-c3d52907-e597-44b4-8956-f0a93ffaeb67 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.785s {{(pid=86457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:29:27 devstack cinder-volume[86457]: DEBUG oslo_concurrency.processutils [None req-c3d52907-e597-44b4-8956-f0a93ffaeb67 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=86457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:29:27 devstack sudo[86532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:29:27 devstack sudo[86532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:29:27 devstack sudo[86532]: pam_unix(sudo:session): session closed for user root
Jul 09 14:29:27 devstack cinder-volume[86457]: DEBUG oslo_concurrency.processutils [None req-c3d52907-e597-44b4-8956-f0a93ffaeb67 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.599s {{(pid=86457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:29:27 devstack cinder-volume[86457]: INFO cinder.volume.driver [None req-c3d52907-e597-44b4-8956-f0a93ffaeb67 None None] Driver hasn't implemented _init_vendor_properties()
Jul 09 14:29:28 devstack cinder-volume[86457]: DEBUG cinder.volume.driver [None req-c3d52907-e597-44b4-8956-f0a93ffaeb67 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.648853302002, 'free_capacity_gb': 1775.648853302002, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86457) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jul 09 14:29:28 devstack cinder-volume[86457]: DEBUG oslo_db.sqlalchemy.engines [None req-c3d52907-e597-44b4-8956-f0a93ffaeb67 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86457) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 09 14:29:28 devstack cinder-volume[86457]: DEBUG dbcounter [-] [86457] Writer thread running {{(pid=86457) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 09 14:29:28 devstack cinder-volume[86457]: DEBUG cinder.db.api [None req-c3d52907-e597-44b4-8956-f0a93ffaeb67 None None] Building query based on filter {{(pid=86457) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Jul 09 14:29:28 devstack cinder-volume[86457]: DEBUG cinder.image.image_utils [None req-c3d52907-e597-44b4-8956-f0a93ffaeb67 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86457) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jul 09 14:29:28 devstack cinder-volume[86457]: INFO cinder.keymgr.migration [None req-d81ce77e-69aa-4a94-a35f-fa3eccbf8850 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jul 09 14:29:28 devstack cinder-volume[86457]: DEBUG oslo_concurrency.lockutils [None req-c3d52907-e597-44b4-8956-f0a93ffaeb67 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:29:28 devstack cinder-volume[86457]: DEBUG oslo_concurrency.lockutils [None req-c3d52907-e597-44b4-8956-f0a93ffaeb67 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:29:28 devstack cinder-volume[86457]: DEBUG cinder.volume.drivers.quobyte [None req-c3d52907-e597-44b4-8956-f0a93ffaeb67 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=86457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:29:28 devstack cinder-volume[86457]: DEBUG cinder.volume.drivers.quobyte [None req-c3d52907-e597-44b4-8956-f0a93ffaeb67 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=86457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:29:28 devstack cinder-volume[86457]: DEBUG oslo_concurrency.lockutils [None req-c3d52907-e597-44b4-8956-f0a93ffaeb67 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:29:28 devstack cinder-volume[86457]: DEBUG oslo_concurrency.processutils [None req-c3d52907-e597-44b4-8956-f0a93ffaeb67 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=86457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:29:28 devstack sudo[86535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:29:28 devstack sudo[86535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:29:28 devstack sudo[86535]: pam_unix(sudo:session): session closed for user root
Jul 09 14:29:28 devstack cinder-volume[86457]: DEBUG oslo_concurrency.processutils [None req-c3d52907-e597-44b4-8956-f0a93ffaeb67 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.600s {{(pid=86457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:29:28 devstack cinder-volume[86457]: DEBUG cinder.manager [None req-c3d52907-e597-44b4-8956-f0a93ffaeb67 None None] Notifying Schedulers of capabilities ... {{(pid=86457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:29:28 devstack cinder-volume[86457]: INFO cinder.volume.manager [None req-c3d52907-e597-44b4-8956-f0a93ffaeb67 None None] Driver initialization completed successfully.
Jul 09 14:29:28 devstack cinder-volume[86457]: INFO cinder.manager [None req-c3d52907-e597-44b4-8956-f0a93ffaeb67 None None] Initiating service 3 cleanup
Jul 09 14:29:28 devstack cinder-volume[86457]: INFO cinder.manager [None req-c3d52907-e597-44b4-8956-f0a93ffaeb67 None None] Service 3 cleanup completed.
Jul 09 14:29:28 devstack cinder-volume[86457]: DEBUG cinder.service [None req-c3d52907-e597-44b4-8956-f0a93ffaeb67 None None] Creating RPC server for service cinder-volume {{(pid=86457) start /opt/stack/cinder/cinder/service.py:231}}
Jul 09 14:29:28 devstack cinder-volume[86457]: DEBUG cinder.service [None req-c3d52907-e597-44b4-8956-f0a93ffaeb67 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86457) start /opt/stack/cinder/cinder/service.py:237}}
Jul 09 14:29:28 devstack cinder-volume[86457]: INFO cinder.volume.manager [None req-c3d52907-e597-44b4-8956-f0a93ffaeb67 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Jul 09 14:29:28 devstack cinder-volume[86457]: DEBUG oslo_concurrency.lockutils [None req-c3d52907-e597-44b4-8956-f0a93ffaeb67 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:29:28 devstack cinder-volume[86457]: DEBUG oslo_concurrency.lockutils [None req-c3d52907-e597-44b4-8956-f0a93ffaeb67 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:29:28 devstack cinder-volume[86457]: DEBUG cinder.volume.drivers.quobyte [None req-c3d52907-e597-44b4-8956-f0a93ffaeb67 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=86457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:29:28 devstack cinder-volume[86457]: DEBUG cinder.volume.drivers.quobyte [None req-c3d52907-e597-44b4-8956-f0a93ffaeb67 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=86457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:29:28 devstack cinder-volume[86457]: DEBUG oslo_concurrency.lockutils [None req-c3d52907-e597-44b4-8956-f0a93ffaeb67 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:29:28 devstack cinder-volume[86457]: DEBUG oslo_concurrency.processutils [None req-c3d52907-e597-44b4-8956-f0a93ffaeb67 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=86457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:29:28 devstack sudo[86542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:29:28 devstack sudo[86542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:29:29 devstack sudo[86542]: pam_unix(sudo:session): session closed for user root
Jul 09 14:29:29 devstack cinder-volume[86457]: DEBUG oslo_concurrency.processutils [None req-c3d52907-e597-44b4-8956-f0a93ffaeb67 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.899s {{(pid=86457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:29:29 devstack cinder-volume[86457]: INFO cinder.volume.manager [None req-c3d52907-e597-44b4-8956-f0a93ffaeb67 None None] Driver post RPC initialization completed successfully.
Jul 09 14:29:33 devstack cinder-volume[86457]: DEBUG oslo_concurrency.lockutils [None req-7ab97595-4c87-4468-a404-2a0591722b19 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:29:33 devstack cinder-volume[86457]: DEBUG oslo_concurrency.lockutils [None req-7ab97595-4c87-4468-a404-2a0591722b19 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:29:33 devstack cinder-volume[86457]: DEBUG cinder.volume.drivers.quobyte [None req-7ab97595-4c87-4468-a404-2a0591722b19 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=86457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:29:33 devstack cinder-volume[86457]: DEBUG cinder.volume.drivers.quobyte [None req-7ab97595-4c87-4468-a404-2a0591722b19 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=86457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:29:33 devstack cinder-volume[86457]: DEBUG oslo_concurrency.lockutils [None req-7ab97595-4c87-4468-a404-2a0591722b19 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:29:33 devstack cinder-volume[86457]: DEBUG oslo_concurrency.processutils [None req-7ab97595-4c87-4468-a404-2a0591722b19 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=86457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:29:33 devstack sudo[86762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:29:33 devstack sudo[86762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:29:34 devstack sudo[86762]: pam_unix(sudo:session): session closed for user root
Jul 09 14:29:34 devstack cinder-volume[86457]: DEBUG oslo_concurrency.processutils [None req-7ab97595-4c87-4468-a404-2a0591722b19 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.609s {{(pid=86457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:29:34 devstack cinder-volume[86457]: DEBUG cinder.manager [None req-7ab97595-4c87-4468-a404-2a0591722b19 None None] Notifying Schedulers of capabilities ... {{(pid=86457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:29:36 devstack cinder-volume[86240]: DEBUG dbcounter [-] [86240] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=86240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 14:29:36 devstack cinder-volume[86240]: INFO oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] Caught SIGTERM, stopping children
Jul 09 14:29:36 devstack cinder-volume[86240]: DEBUG oslo_concurrency.lockutils [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] Acquiring lock "singleton_lock" {{(pid=86240) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 09 14:29:36 devstack cinder-volume[86240]: DEBUG oslo_concurrency.lockutils [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] Acquired lock "singleton_lock" {{(pid=86240) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 09 14:29:36 devstack cinder-volume[86240]: DEBUG oslo_concurrency.lockutils [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] Releasing lock "singleton_lock" {{(pid=86240) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 09 14:29:36 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] Stop services. {{(pid=86240) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Jul 09 14:29:36 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] Killing children. {{(pid=86240) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Jul 09 14:29:36 devstack cinder-volume[86240]: INFO oslo_service.backend._eventlet.service [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] Waiting on 1 children to exit
Jul 09 14:29:39 devstack cinder-volume[86457]: DEBUG dbcounter [-] [86457] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=86457) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 14:29:39 devstack cinder-volume[86457]: DEBUG dbcounter [-] [86457] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=86457) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 14:29:41 devstack cinder-volume[86457]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting
Jul 09 14:29:42 devstack cinder-volume[86457]: DEBUG oslo_concurrency.lockutils [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] Acquiring lock "singleton_lock" {{(pid=86457) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 09 14:29:42 devstack cinder-volume[86457]: DEBUG oslo_concurrency.lockutils [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] Acquired lock "singleton_lock" {{(pid=86457) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 09 14:29:42 devstack cinder-volume[86457]: DEBUG oslo_concurrency.lockutils [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] Releasing lock "singleton_lock" {{(pid=86457) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 09 14:29:42 devstack cinder-volume[86457]: WARNING amqp [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jul 09 14:29:42 devstack cinder-volume[86457]: WARNING amqp [None req-db0b367a-145a-4aa3-82f0-1407c8ea1b1c None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jul 09 14:29:42 devstack cinder-volume[86979]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Jul 09 14:29:42 devstack cinder-volume[86979]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 09 14:29:42 devstack cinder-volume[86979]: we strongly recommend against using it for new projects.
Jul 09 14:29:42 devstack cinder-volume[86979]: If you are already using Eventlet, we recommend migrating to a different
Jul 09 14:29:42 devstack cinder-volume[86979]: framework.  For more detail see
Jul 09 14:29:42 devstack cinder-volume[86979]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 09 14:29:42 devstack cinder-volume[86979]:   import eventlet  # noqa
Jul 09 14:29:44 devstack cinder-volume[86979]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86979) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 09 14:29:44 devstack cinder-volume[86979]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86979) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 09 14:29:44 devstack cinder-volume[86979]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86979) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 09 14:29:45 devstack cinder-volume[86979]: INFO dbcounter [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] Registered counter for database cinder
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_db.sqlalchemy.engines [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86979) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG dbcounter [-] [86979] Writer thread running {{(pid=86979) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 09 14:29:45 devstack cinder-volume[86979]: INFO cinder.rpc [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jul 09 14:29:45 devstack cinder-volume[86979]: INFO cinder.rpc [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_db.sqlalchemy.engines [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86979) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 09 14:29:45 devstack cinder-volume[86979]: INFO cinder.volume.manager [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] Determined volume DB was empty at startup.
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG cinder.volume.manager [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86979) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jul 09 14:29:45 devstack cinder-volume[86979]: WARNING stevedore.named [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jul 09 14:29:45 devstack cinder-volume[86979]: WARNING castellan.key_manager [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 09 14:29:45 devstack cinder-volume[86979]: WARNING cinder.keymgr.conf_key_mgr [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 09 14:29:45 devstack cinder-volume[86979]: INFO cinder.volume.manager [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] Image-volume cache disabled for host devstack@QuobyteHD.
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_db.sqlalchemy.engines [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86979) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 09 14:29:45 devstack cinder-volume[86979]: INFO oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] Starting 1 workers
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] Started child 87230 {{(pid=86979) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] Full set of CONF: {{(pid=86979) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] ******************************************************************************** {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] Configuration options gathered from: {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] ================================================================================ {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] allow_availability_zone_fallback = False {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] allow_compression_on_image_upload = False {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] allowed_direct_url_schemes     = [] {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] api_rate_limit                 = True {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:45 devstack cinder-volume[87230]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] auth_strategy                  = keystone {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] backend_availability_zone      = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] backend_host                   = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] backend_name                   = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] backend_stats_polling_interval = 60 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] backup_api_class               = cinder.backup.api.API {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] backup_name_template           = backup-%s {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] backup_use_same_host           = False {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] backup_use_temp_snapshot       = False {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] chap_password                  = **** {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] chap_username                  =  {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] cinder_internal_tenant_project_id = 6b724ea44e104eeba965f1cf49973270 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] cinder_internal_tenant_user_id = c16967c9cde34819931c468b5fa673c7 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] cluster                        = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] compression_format             = gzip {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] compute_api_class              = cinder.compute.nova.API {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] config_dir                     = [] {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] config_source                  = [] {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] control_exchange               = openstack {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] debug                          = True {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] default_availability_zone      = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] default_group_type             = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] default_volume_type            = QuobyteHD {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] disk_geometry                  = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] driver_client_cert             = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] driver_client_cert_key         = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] driver_data_namespace          = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] driver_ssl_cert_path           = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] driver_ssl_cert_verify         = False {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] driver_use_ssl                 = False {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] enable_new_services            = True {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] enable_unsupported_driver      = False {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] enabled_backends               = ['QuobyteHD'] {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] enforce_multipath_for_image_xfer = False {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] filter_function                = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] glance_api_insecure            = False {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] glance_api_servers             = ['http://192.168.122.239/image'] {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] glance_api_ssl_compression     = False {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] glance_ca_certificates_file    = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] glance_catalog_info            = image:glance:publicURL {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] glance_certfile                = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] glance_keyfile                 = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] glance_num_retries             = 3 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] glance_request_timeout         = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] goodness_function              = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] graceful_shutdown_timeout      = 5 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] group_api_class                = cinder.group.api.API {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] host                           = devstack {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] image_compress_on_upload       = True {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] image_conversion_address_space_limit = 1 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] image_conversion_cpu_limit     = 60 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] image_conversion_disable       = False {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] image_upload_use_cinder_backend = False {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] image_upload_use_internal_tenant = False {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] image_volume_cache_enabled     = False {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] image_volume_cache_max_count   = 0 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] image_volume_cache_max_size_gb = 0 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] init_host_max_objects_retrieval = 0 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] instance_format                = [instance: %(uuid)s]  {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] iscsi_target_flags             =  {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] iscsi_write_cache              = on {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] iser_helper                    = tgtadm {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] iser_ip_address                = 192.168.122.239 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] iser_port                      = 3260 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] log_color                      = False {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] log_config_append              = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] log_dir                        = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] log_file                       = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] log_options                    = True {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] log_rotate_interval            = 1 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] log_rotate_interval_type       = days {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] log_rotation_type              = none {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:45 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] max_age                        = 0 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] max_logfile_count              = 30 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] max_logfile_size_mb            = 200 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] max_over_subscription_ratio    = 20.0 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] message_reap_interval          = 86400 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] message_ttl                    = 2592000 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] migration_create_volume_timeout_secs = 300 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] monkey_patch                   = False {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] monkey_patch_modules           = [] {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] my_ip                          = 192.168.122.239 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] no_snapshot_gb_quota           = False {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] num_iser_scan_tries            = 3 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] num_shell_tries                = 3 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] num_volume_device_scan_tries   = 3 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] nvmeof_conn_info_version       = 1 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] nvmet_ns_id                    = 10 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] nvmet_port_id                  = 1 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] osapi_max_limit                = 1000 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-a938b2a4-63ca-4904-93e7-d022a08ac898 None None] Starting volume driver QuobyteDriver (1.1.14)
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] osapi_volume_ext_list          = [] {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-a938b2a4-63ca-4904-93e7-d022a08ac898 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87230) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] osapi_volume_listen            = 0.0.0.0 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] osapi_volume_listen_port       = 8776 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] osapi_volume_use_ssl           = False {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] osapi_volume_workers           = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] per_volume_size_limit          = -1 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] periodic_fuzzy_delay           = 60 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] periodic_interval              = 60 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] project_id_regex               = [0-9a-f\-]+ {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] public_endpoint                = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] publish_errors                 = False {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] quota_backup_gigabytes         = 1000 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] quota_backups                  = 10 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] quota_gigabytes                = 1000 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] quota_groups                   = 10 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] quota_snapshots                = 10 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] quota_volumes                  = 10 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] rate_limit_burst               = 0 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] rate_limit_except_level        = CRITICAL {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] rate_limit_interval            = 0 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] reinit_driver_count            = 3 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] replication_device             = **** {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] report_discard_supported       = False {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] report_interval                = 120 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] reservation_clean_interval     = 86400 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] reservation_expire             = 86400 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] reserved_image_namespaces      = [] {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] reserved_percentage            = 0 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] rpc_response_timeout           = 120 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] run_external_periodic_tasks    = True {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] scst_target_driver             = iscsi {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] scst_target_iqn_name           = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] service_down_time              = 720 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] shell_completion               = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] snapshot_name_template         = snapshot-%s {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] split_loggers                  = False {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] state_path                     = /opt/stack/data/cinder {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] storage_availability_zone      = nova {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] storage_protocol               = iSCSI {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] syslog_log_facility            = LOG_USER {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] target_helper                  = lioadm {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] target_ip_address              = 192.168.122.239 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] target_port                    = 3260 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] target_protocol                = iscsi {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] target_secondary_ip_addresses  = [] {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] trace_flags                    = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] transfer_api_class             = cinder.transfer.api.API {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] transport_url                  = **** {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] until_refresh                  = 0 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] use_chap_auth                  = False {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] use_default_quota_class        = True {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] use_journal                    = False {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] use_json                       = False {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] use_multipath_for_image_xfer   = False {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] use_stderr                     = False {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] use_syslog                     = False {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] verify_glance_signatures       = enabled {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] volume_api_class               = cinder.volume.api.API {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] volume_backend_name            = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] volume_clear                   = zero {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] volume_clear_ionice            = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] volume_clear_size              = 0 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] volume_copy_bps_limit          = 0 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] volume_dd_blocksize            = 1M {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] volume_name_template           = volume-%s {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] volume_service_inithost_offload = False {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] volume_usage_audit_period      = month {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] zoning_mode                    = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] oslo_concurrency.disable_process_locking = False {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] keystone_authtoken.auth_section = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] keystone_authtoken.auth_type   = password {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] keystone_authtoken.auth_version = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] keystone_authtoken.cache       = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] keystone_authtoken.certfile    = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] keystone_authtoken.delay_auth_decision = False {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] keystone_authtoken.http_connect_timeout = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] keystone_authtoken.include_service_catalog = True {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] keystone_authtoken.insecure    = False {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] keystone_authtoken.interface   = public {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] keystone_authtoken.keyfile     = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] keystone_authtoken.memcache_password =  {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] keystone_authtoken.memcache_username =  {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] keystone_authtoken.region_name = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] keystone_authtoken.service_token_roles_required = True {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] keystone_authtoken.service_type = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] keystone_authtoken.token_cache_time = 300 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.239/identity {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] cache.backend                  = dogpile.cache.null {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] cache.backend_argument         = **** {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] cache.backend_expiration_time  = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] cache.config_prefix            = cache.oslo {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] cache.debug_cache_backend      = False {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] cache.enable_retry_client      = False {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] cache.enable_socket_keepalive  = False {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] cache.enabled                  = False {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] cache.expiration_time          = 600 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] cache.hashclient_retry_attempts = 2 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] cache.memcache_dead_retry      = 300 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] cache.memcache_pool_maxsize    = 10 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] cache.memcache_sasl_enabled    = False {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] cache.password                 = **** {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] cache.proxies                  = [] {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] cache.redis_db                 = 0 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] cache.redis_sentinel_service_name = mymaster {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] cache.redis_server             = localhost:6379 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] cache.retry_attempts           = 2 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] cache.retry_delay              = 0.0 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] cache.socket_keepalive_count   = 1 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] cache.socket_keepalive_idle    = 1 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] cache.socket_keepalive_interval = 1 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] cache.socket_timeout           = 1.0 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] cache.tls_allowed_ciphers      = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] cache.tls_cafile               = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] cache.tls_certfile             = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] cache.tls_enabled              = False {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] cache.tls_keyfile              = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] cache.username                 = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] coordination.backend_url       = **** {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] database.asyncio_connection    = **** {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] database.asyncio_slave_connection = **** {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] database.backend               = sqlalchemy {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] database.connection            = **** {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] database.connection_debug      = 0 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] database.connection_parameters =  {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] database.connection_recycle_time = 3600 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] database.connection_trace      = False {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] database.db_inc_retry_interval = True {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] database.db_max_retries        = 20 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] database.db_max_retry_interval = 10 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] database.db_retry_interval     = 1 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] database.max_overflow          = 50 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] database.max_pool_size         = 5 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] database.max_retries           = 10 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] database.mysql_wsrep_sync_wait = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] database.pool_timeout          = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] database.retry_interval        = 10 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] database.slave_connection      = **** {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] database.sqlite_synchronous    = True {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] database.synchronous_reader    = True {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] database.use_db_reconnect      = False {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a938b2a4-63ca-4904-93e7-d022a08ac898 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87230) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Jul 09 14:29:46 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.quobyte [None req-a938b2a4-63ca-4904-93e7-d022a08ac898 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.quobyte [None req-a938b2a4-63ca-4904-93e7-d022a08ac898 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] profiler.connection_string     = messaging:// {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] profiler.enabled               = False {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] profiler.es_doc_type           = notification {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] profiler.es_scroll_size        = 10000 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] profiler.es_scroll_time        = 2m {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] profiler.filter_error_trace    = False {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] profiler.hmac_keys             = **** {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] profiler.sentinel_service_name = mymaster {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] profiler.socket_timeout        = 0.1 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] profiler.trace_requests        = False {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] profiler.trace_sqlalchemy      = False {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] profiler_jaeger.process_tags   = {} {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] profiler_jaeger.service_name_prefix = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] profiler_otlp.service_name_prefix = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a938b2a4-63ca-4904-93e7-d022a08ac898 None None] Running cmd (subprocess): mount.quobyte {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] oslo_policy.enforce_new_defaults = True {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] oslo_policy.enforce_scope      = False {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] oslo_policy.policy_default_rule = default {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] oslo_policy.policy_file        = policy.yaml {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] oslo_policy.remote_timeout     = 60.0 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] privsep_osbrick.group          = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] privsep_osbrick.helper_command = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] privsep_osbrick.user           = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] cinder_sys_admin.group         = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] cinder_sys_admin.helper_command = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] cinder_sys_admin.user          = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] service_user.auth_section      = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] service_user.auth_type         = password {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] service_user.cafile            = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] service_user.certfile          = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] service_user.collect_timing    = False {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] service_user.insecure          = False {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] service_user.keyfile           = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] service_user.send_service_user_token = True {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] service_user.split_loggers     = False {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] service_user.timeout           = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] glance.auth_section            = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] glance.auth_type               = password {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] glance.certfile                = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] glance.collect_timing          = False {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] glance.insecure                = False {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] glance.keyfile                 = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] glance.region_name             = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] glance.split_loggers           = False {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] glance.timeout                 = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] backend_defaults.backend_availability_zone = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] backend_defaults.chap_password = **** {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] backend_defaults.chap_username =  {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] backend_defaults.disk_geometry = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] backend_defaults.driver_client_cert = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] backend_defaults.driver_client_cert_key = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] backend_defaults.driver_data_namespace = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] backend_defaults.driver_use_ssl = False {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] backend_defaults.enable_unsupported_driver = False {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] backend_defaults.extra_capabilities = {} {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] backend_defaults.filter_function = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] backend_defaults.goodness_function = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] backend_defaults.iscsi_target_flags =  {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] backend_defaults.iscsi_write_cache = on {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] backend_defaults.iser_helper   = tgtadm {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] backend_defaults.iser_ip_address = 192.168.122.239 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] backend_defaults.iser_port     = 3260 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] backend_defaults.nas_host      =  {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] backend_defaults.nas_login     = admin {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] backend_defaults.nas_mount_options = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] backend_defaults.nas_password  = **** {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] backend_defaults.nas_private_key =  {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] backend_defaults.nas_share_path =  {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] backend_defaults.nas_ssh_port  = 22 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] backend_defaults.num_shell_tries = 3 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] backend_defaults.nvmet_port_id = 1 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] backend_defaults.quobyte_client_cfg = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] backend_defaults.quobyte_volume_url = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] backend_defaults.replication_device = **** {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] backend_defaults.report_discard_supported = False {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] backend_defaults.reserved_percentage = 0 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] backend_defaults.scst_target_driver = iscsi {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] backend_defaults.scst_target_iqn_name = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] backend_defaults.storage_protocol = iSCSI {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] backend_defaults.target_helper = tgtadm {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] backend_defaults.target_ip_address = 192.168.122.239 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] backend_defaults.target_port   = 3260 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] backend_defaults.target_protocol = iscsi {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] backend_defaults.trace_flags   = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] backend_defaults.unique_fqdn_network = True {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] backend_defaults.use_chap_auth = False {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] backend_defaults.volume_backend_name = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] backend_defaults.volume_clear  = zero {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] backend_defaults.volume_clear_ionice = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] backend_defaults.volume_clear_size = 0 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] oslo_reports.file_event_handler = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] oslo_reports.log_dir           = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] QuobyteHD.backend_availability_zone = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] QuobyteHD.backend_host         = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] QuobyteHD.chap_password        = **** {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] QuobyteHD.chap_username        = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] QuobyteHD.chiscsi_conf         = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] QuobyteHD.disk_geometry        = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] QuobyteHD.driver_client_cert   = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] QuobyteHD.driver_client_cert_key = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] QuobyteHD.driver_data_namespace = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] QuobyteHD.driver_use_ssl       = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] QuobyteHD.extra_capabilities   = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] QuobyteHD.filter_function      = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] QuobyteHD.goodness_function    = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] QuobyteHD.iscsi_target_flags   = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] QuobyteHD.iscsi_write_cache    = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] QuobyteHD.iser_helper          = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] QuobyteHD.iser_ip_address      = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] QuobyteHD.iser_port            = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] QuobyteHD.iser_target_prefix   = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] QuobyteHD.nas_host             = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] QuobyteHD.nas_login            = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] QuobyteHD.nas_mount_options    = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] QuobyteHD.nas_password         = **** {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] QuobyteHD.nas_private_key      = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] QuobyteHD.nas_share_path       = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] QuobyteHD.nas_ssh_port         = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] QuobyteHD.num_shell_tries      = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] QuobyteHD.nvmet_ns_id          = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] QuobyteHD.nvmet_port_id        = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] QuobyteHD.replication_device   = **** {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] QuobyteHD.report_discard_supported = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] QuobyteHD.reserved_percentage  = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] QuobyteHD.scst_target_driver   = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] QuobyteHD.storage_protocol     = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] QuobyteHD.target_helper        = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] QuobyteHD.target_ip_address    = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] QuobyteHD.target_port          = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack quobyte-client[87234]: Reading configuration file: /etc/quobyte/client.cfg
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] QuobyteHD.target_prefix        = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] QuobyteHD.target_protocol      = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] QuobyteHD.trace_flags          = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack quobyte-client[87234]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] QuobyteHD.unique_fqdn_network  = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] QuobyteHD.use_chap_auth        = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] QuobyteHD.volume_clear         = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] QuobyteHD.volume_clear_ionice  = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] QuobyteHD.volume_clear_size    = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] QuobyteHD.volumes_dir          = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a938b2a4-63ca-4904-93e7-d022a08ac898 None None] CMD "mount.quobyte" returned: 1 in 0.086s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a938b2a4-63ca-4904-93e7-d022a08ac898 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] oslo_messaging_rabbit.ssl      = False {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a938b2a4-63ca-4904-93e7-d022a08ac898 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a938b2a4-63ca-4904-93e7-d022a08ac898 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] oslo_messaging_rabbit.ssl_version =  {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] oslo_messaging_notifications.driver = [] {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] oslo_messaging_notifications.retry = -1 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] oslo_messaging_notifications.transport_url = **** {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] key_manager.fixed_key          = **** {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a938b2a4-63ca-4904-93e7-d022a08ac898 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a938b2a4-63ca-4904-93e7-d022a08ac898 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] barbican.barbican_api_version  = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a938b2a4-63ca-4904-93e7-d022a08ac898 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] barbican.barbican_endpoint     = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] barbican.barbican_endpoint_type = public {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] barbican.barbican_region_name  = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] barbican.cafile                = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] barbican.certfile              = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] barbican.collect_timing        = False {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] barbican.insecure              = False {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] barbican.keyfile               = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] barbican.number_of_retries     = 60 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] barbican.retry_delay           = 1 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] barbican.send_service_user_token = False {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] barbican.split_loggers         = False {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] barbican.timeout               = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] barbican.verify_ssl            = True {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] barbican.verify_ssl_path       = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] barbican_service_user.auth_section = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] barbican_service_user.auth_type = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] barbican_service_user.cafile   = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] barbican_service_user.certfile = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] barbican_service_user.collect_timing = False {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] barbican_service_user.insecure = False {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] barbican_service_user.keyfile  = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] barbican_service_user.split_loggers = False {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] barbican_service_user.timeout  = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] vault.approle_role_id          = **** {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] vault.approle_secret_id        = **** {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] vault.kv_mountpoint            = secret {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] vault.kv_path                  = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] vault.kv_version               = 2 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] vault.namespace                = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] vault.root_token_id            = **** {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] vault.ssl_ca_crt_file          = None {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] vault.timeout                  = 60.0 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] vault.use_ssl                  = False {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 14:29:46 devstack cinder-volume[86979]: DEBUG oslo_service.backend._eventlet.service [None req-60df386f-1a59-4407-a6b0-a114825a777c None None] ******************************************************************************** {{(pid=86979) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}}
Jul 09 14:29:46 devstack sudo[87235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:29:46 devstack sudo[87235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:29:46 devstack sudo[87235]: pam_unix(sudo:session): session closed for user root
Jul 09 14:29:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a938b2a4-63ca-4904-93e7-d022a08ac898 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.622s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:29:46 devstack cinder-volume[87230]: INFO cinder.volume.driver [None req-a938b2a4-63ca-4904-93e7-d022a08ac898 None None] Driver hasn't implemented _init_vendor_properties()
Jul 09 14:29:46 devstack cinder-volume[87230]: DEBUG cinder.volume.driver [None req-a938b2a4-63ca-4904-93e7-d022a08ac898 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.648853302002, 'free_capacity_gb': 1775.648853302002, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87230) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jul 09 14:29:46 devstack cinder-volume[87230]: DEBUG oslo_db.sqlalchemy.engines [None req-a938b2a4-63ca-4904-93e7-d022a08ac898 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87230) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 09 14:29:46 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writer thread running {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 09 14:29:46 devstack cinder-volume[87230]: DEBUG cinder.db.api [None req-a938b2a4-63ca-4904-93e7-d022a08ac898 None None] Building query based on filter {{(pid=87230) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Jul 09 14:29:46 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-a938b2a4-63ca-4904-93e7-d022a08ac898 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87230) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jul 09 14:29:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a938b2a4-63ca-4904-93e7-d022a08ac898 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:29:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a938b2a4-63ca-4904-93e7-d022a08ac898 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:29:46 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a938b2a4-63ca-4904-93e7-d022a08ac898 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:29:46 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a938b2a4-63ca-4904-93e7-d022a08ac898 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:29:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a938b2a4-63ca-4904-93e7-d022a08ac898 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:29:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a938b2a4-63ca-4904-93e7-d022a08ac898 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:29:46 devstack cinder-volume[87230]: INFO cinder.keymgr.migration [None req-fbe13289-e4f7-4381-8338-af94b541dc89 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jul 09 14:29:46 devstack sudo[87240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:29:46 devstack sudo[87240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:29:47 devstack sudo[87240]: pam_unix(sudo:session): session closed for user root
Jul 09 14:29:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a938b2a4-63ca-4904-93e7-d022a08ac898 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.611s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:29:47 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-a938b2a4-63ca-4904-93e7-d022a08ac898 None None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:29:47 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-a938b2a4-63ca-4904-93e7-d022a08ac898 None None] Driver initialization completed successfully.
Jul 09 14:29:47 devstack cinder-volume[87230]: INFO cinder.manager [None req-a938b2a4-63ca-4904-93e7-d022a08ac898 None None] Initiating service 3 cleanup
Jul 09 14:29:47 devstack cinder-volume[87230]: INFO cinder.manager [None req-a938b2a4-63ca-4904-93e7-d022a08ac898 None None] Service 3 cleanup completed.
Jul 09 14:29:47 devstack cinder-volume[87230]: DEBUG cinder.service [None req-a938b2a4-63ca-4904-93e7-d022a08ac898 None None] Creating RPC server for service cinder-volume {{(pid=87230) start /opt/stack/cinder/cinder/service.py:231}}
Jul 09 14:29:47 devstack cinder-volume[87230]: DEBUG cinder.service [None req-a938b2a4-63ca-4904-93e7-d022a08ac898 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87230) start /opt/stack/cinder/cinder/service.py:237}}
Jul 09 14:29:47 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-a938b2a4-63ca-4904-93e7-d022a08ac898 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Jul 09 14:29:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a938b2a4-63ca-4904-93e7-d022a08ac898 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:29:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a938b2a4-63ca-4904-93e7-d022a08ac898 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:29:47 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a938b2a4-63ca-4904-93e7-d022a08ac898 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:29:47 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a938b2a4-63ca-4904-93e7-d022a08ac898 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:29:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a938b2a4-63ca-4904-93e7-d022a08ac898 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:29:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a938b2a4-63ca-4904-93e7-d022a08ac898 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:29:47 devstack sudo[87275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:29:47 devstack sudo[87275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:29:48 devstack sudo[87275]: pam_unix(sudo:session): session closed for user root
Jul 09 14:29:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a938b2a4-63ca-4904-93e7-d022a08ac898 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.625s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:29:48 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-a938b2a4-63ca-4904-93e7-d022a08ac898 None None] Driver post RPC initialization completed successfully.
Jul 09 14:29:52 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Running periodic task VolumeManager._thread_info {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 14:29:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] thread count: 6 {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 09 14:29:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] thread info: [<_MainThread(MainThread, started 125388812103808)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125388713797504)>, <Thread(Thread-3 (stat_writer), started daemon 125388699995392)>, <Thread(Rabbit-heartbeat, started daemon 125388700522560)>, <Thread(Thread-5 (_runner), started daemon 125388698545216)>, <Thread(Thread-7 (_runner), started daemon 125388698611264)>] {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 09 14:29:55 devstack cinder-volume[86979]: DEBUG dbcounter [-] [86979] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86979) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 14:29:56 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 14:29:58 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=4 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 14:30:52 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 14:30:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:30:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:30:52 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:30:52 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:30:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:30:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:30:52 devstack sudo[87839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:30:52 devstack sudo[87839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:30:54 devstack sudo[87839]: pam_unix(sudo:session): session closed for user root
Jul 09 14:30:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 2.412s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:30:54 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:30:54 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Running periodic task VolumeManager._thread_info {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 14:30:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] thread count: 6 {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 09 14:30:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] thread info: [<_MainThread(MainThread, started 125388812103808)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125388713797504)>, <Thread(Thread-3 (stat_writer), started daemon 125388699995392)>, <Thread(Rabbit-heartbeat, started daemon 125388700522560)>, <Thread(Thread-5 (_runner), started daemon 125388698545216)>, <Thread(Thread-7 (_runner), started daemon 125388698611264)>] {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 09 14:31:01 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f166265-5368-46ac-a7ba-cbc1ba7d4c32 tempest-DeleteServersTestJSON-438163135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:31:01 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5f166265-5368-46ac-a7ba-cbc1ba7d4c32 tempest-DeleteServersTestJSON-438163135 None] Flow 'volume_create_manager' (f5fc6c75-624e-4aef-9dd4-10b87148b05f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:31:01 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5f166265-5368-46ac-a7ba-cbc1ba7d4c32 tempest-DeleteServersTestJSON-438163135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3bacb10-4fc0-47a0-9c8a-1f38ac97e90e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:31:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5f166265-5368-46ac-a7ba-cbc1ba7d4c32 tempest-DeleteServersTestJSON-438163135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3bacb10-4fc0-47a0-9c8a-1f38ac97e90e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:30:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1815005287',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=186f1824-7a1a-4fe6-aac9-f643431a2880,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65222d80aa964899871003a244b722c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:31:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:31:02Z,use_quota=True,user_id='8bf0e630c18a407c9191f57f6c408261',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:31:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5f166265-5368-46ac-a7ba-cbc1ba7d4c32 tempest-DeleteServersTestJSON-438163135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb829416-579b-425a-a1ec-faa9f361287d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:31:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5f166265-5368-46ac-a7ba-cbc1ba7d4c32 tempest-DeleteServersTestJSON-438163135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb829416-579b-425a-a1ec-faa9f361287d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:31:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5f166265-5368-46ac-a7ba-cbc1ba7d4c32 tempest-DeleteServersTestJSON-438163135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (827e058c-d4cd-4577-844b-97983e6a0e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:31:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5f166265-5368-46ac-a7ba-cbc1ba7d4c32 tempest-DeleteServersTestJSON-438163135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (827e058c-d4cd-4577-844b-97983e6a0e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '186f1824-7a1a-4fe6-aac9-f643431a2880', 'volume_name': 'volume-186f1824-7a1a-4fe6-aac9-f643431a2880', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:31:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5f166265-5368-46ac-a7ba-cbc1ba7d4c32 tempest-DeleteServersTestJSON-438163135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2cc222c-5291-4504-a85f-6bb7ee199dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:31:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5f166265-5368-46ac-a7ba-cbc1ba7d4c32 tempest-DeleteServersTestJSON-438163135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2cc222c-5291-4504-a85f-6bb7ee199dff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:31:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5f166265-5368-46ac-a7ba-cbc1ba7d4c32 tempest-DeleteServersTestJSON-438163135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b7ef4de-b27c-43b9-b614-3d935e7bc4ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:31:02 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-5f166265-5368-46ac-a7ba-cbc1ba7d4c32 tempest-DeleteServersTestJSON-438163135 None] Volume 186f1824-7a1a-4fe6-aac9-f643431a2880: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-186f1824-7a1a-4fe6-aac9-f643431a2880', 'volume_size': 1}
Jul 09 14:31:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5f166265-5368-46ac-a7ba-cbc1ba7d4c32 tempest-DeleteServersTestJSON-438163135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:31:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5f166265-5368-46ac-a7ba-cbc1ba7d4c32 tempest-DeleteServersTestJSON-438163135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:31:02 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-5f166265-5368-46ac-a7ba-cbc1ba7d4c32 tempest-DeleteServersTestJSON-438163135 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:30:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1815005287',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=186f1824-7a1a-4fe6-aac9-f643431a2880,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65222d80aa964899871003a244b722c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:31:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:31:02Z,use_quota=True,user_id='8bf0e630c18a407c9191f57f6c408261',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:31:02 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-5f166265-5368-46ac-a7ba-cbc1ba7d4c32 tempest-DeleteServersTestJSON-438163135 None] Creating volume 186f1824-7a1a-4fe6-aac9-f643431a2880 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:31:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5f166265-5368-46ac-a7ba-cbc1ba7d4c32 tempest-DeleteServersTestJSON-438163135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:31:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5f166265-5368-46ac-a7ba-cbc1ba7d4c32 tempest-DeleteServersTestJSON-438163135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:31:02 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-5f166265-5368-46ac-a7ba-cbc1ba7d4c32 tempest-DeleteServersTestJSON-438163135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:31:02 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-5f166265-5368-46ac-a7ba-cbc1ba7d4c32 tempest-DeleteServersTestJSON-438163135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:31:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5f166265-5368-46ac-a7ba-cbc1ba7d4c32 tempest-DeleteServersTestJSON-438163135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:31:02 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-5f166265-5368-46ac-a7ba-cbc1ba7d4c32 tempest-DeleteServersTestJSON-438163135 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:31:02 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-5f166265-5368-46ac-a7ba-cbc1ba7d4c32 tempest-DeleteServersTestJSON-438163135 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:31:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5f166265-5368-46ac-a7ba-cbc1ba7d4c32 tempest-DeleteServersTestJSON-438163135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-186f1824-7a1a-4fe6-aac9-f643431a2880 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:31:02 devstack sudo[87972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-186f1824-7a1a-4fe6-aac9-f643431a2880 1073741824
Jul 09 14:31:02 devstack sudo[87972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:31:04 devstack sudo[87972]: pam_unix(sudo:session): session closed for user root
Jul 09 14:31:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5f166265-5368-46ac-a7ba-cbc1ba7d4c32 tempest-DeleteServersTestJSON-438163135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-186f1824-7a1a-4fe6-aac9-f643431a2880 1073741824" returned: 0 in 2.277s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:31:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5f166265-5368-46ac-a7ba-cbc1ba7d4c32 tempest-DeleteServersTestJSON-438163135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-186f1824-7a1a-4fe6-aac9-f643431a2880 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:31:04 devstack sudo[88294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-186f1824-7a1a-4fe6-aac9-f643431a2880
Jul 09 14:31:04 devstack sudo[88294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:31:06 devstack sudo[88294]: pam_unix(sudo:session): session closed for user root
Jul 09 14:31:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5f166265-5368-46ac-a7ba-cbc1ba7d4c32 tempest-DeleteServersTestJSON-438163135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-186f1824-7a1a-4fe6-aac9-f643431a2880" returned: 0 in 1.733s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:31:06 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-5f166265-5368-46ac-a7ba-cbc1ba7d4c32 tempest-DeleteServersTestJSON-438163135 None] <== create_volume: return (4151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:31:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5f166265-5368-46ac-a7ba-cbc1ba7d4c32 tempest-DeleteServersTestJSON-438163135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.159s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:31:06 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5f166265-5368-46ac-a7ba-cbc1ba7d4c32 tempest-DeleteServersTestJSON-438163135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b7ef4de-b27c-43b9-b614-3d935e7bc4ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-186f1824-7a1a-4fe6-aac9-f643431a2880', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:31:06 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5f166265-5368-46ac-a7ba-cbc1ba7d4c32 tempest-DeleteServersTestJSON-438163135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16094b55-677f-46e2-a984-860adc03e53a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:31:06 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-5f166265-5368-46ac-a7ba-cbc1ba7d4c32 tempest-DeleteServersTestJSON-438163135 None] Volume volume-186f1824-7a1a-4fe6-aac9-f643431a2880 (186f1824-7a1a-4fe6-aac9-f643431a2880): created successfully
Jul 09 14:31:06 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5f166265-5368-46ac-a7ba-cbc1ba7d4c32 tempest-DeleteServersTestJSON-438163135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16094b55-677f-46e2-a984-860adc03e53a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:31:06 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5f166265-5368-46ac-a7ba-cbc1ba7d4c32 tempest-DeleteServersTestJSON-438163135 None] Flow 'volume_create_manager' (f5fc6c75-624e-4aef-9dd4-10b87148b05f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:31:06 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-5f166265-5368-46ac-a7ba-cbc1ba7d4c32 tempest-DeleteServersTestJSON-438163135 None] Created volume successfully.
Jul 09 14:31:14 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-496b6079-656d-481c-bf95-9b8eb9cc2487 tempest-ServerRescueNegativeTestJSON-1008482296 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:31:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-496b6079-656d-481c-bf95-9b8eb9cc2487 tempest-ServerRescueNegativeTestJSON-1008482296 None] Flow 'volume_create_manager' (b4698c74-50ef-48e3-8147-f917ee4620d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:31:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-496b6079-656d-481c-bf95-9b8eb9cc2487 tempest-ServerRescueNegativeTestJSON-1008482296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91be5cd4-bef0-41b7-a6aa-4979a2606d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:31:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-496b6079-656d-481c-bf95-9b8eb9cc2487 tempest-ServerRescueNegativeTestJSON-1008482296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91be5cd4-bef0-41b7-a6aa-4979a2606d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:31:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1958394825',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcc0dd68-5975-41b6-b641-1236eba4cbcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c933b0ce13134afdb5191cdad291672a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:31:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:31:15Z,use_quota=True,user_id='9fb0d51aaf6b4f34bcf2a73fb767b9e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:31:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-496b6079-656d-481c-bf95-9b8eb9cc2487 tempest-ServerRescueNegativeTestJSON-1008482296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b231f166-c36d-4025-94dc-ef8b891b00bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:31:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-496b6079-656d-481c-bf95-9b8eb9cc2487 tempest-ServerRescueNegativeTestJSON-1008482296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b231f166-c36d-4025-94dc-ef8b891b00bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:31:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-496b6079-656d-481c-bf95-9b8eb9cc2487 tempest-ServerRescueNegativeTestJSON-1008482296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d65c7539-ad89-48a3-8159-b07e7cdd8bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:31:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-496b6079-656d-481c-bf95-9b8eb9cc2487 tempest-ServerRescueNegativeTestJSON-1008482296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d65c7539-ad89-48a3-8159-b07e7cdd8bab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcc0dd68-5975-41b6-b641-1236eba4cbcc', 'volume_name': 'volume-dcc0dd68-5975-41b6-b641-1236eba4cbcc', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:31:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-496b6079-656d-481c-bf95-9b8eb9cc2487 tempest-ServerRescueNegativeTestJSON-1008482296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (060b024d-436a-4652-a826-ae3f6ded3d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:31:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-496b6079-656d-481c-bf95-9b8eb9cc2487 tempest-ServerRescueNegativeTestJSON-1008482296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (060b024d-436a-4652-a826-ae3f6ded3d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:31:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-496b6079-656d-481c-bf95-9b8eb9cc2487 tempest-ServerRescueNegativeTestJSON-1008482296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (746eca50-f032-4b8a-b193-3601e21ef94f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:31:14 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-496b6079-656d-481c-bf95-9b8eb9cc2487 tempest-ServerRescueNegativeTestJSON-1008482296 None] Volume dcc0dd68-5975-41b6-b641-1236eba4cbcc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcc0dd68-5975-41b6-b641-1236eba4cbcc', 'volume_size': 1}
Jul 09 14:31:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-496b6079-656d-481c-bf95-9b8eb9cc2487 tempest-ServerRescueNegativeTestJSON-1008482296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:31:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-496b6079-656d-481c-bf95-9b8eb9cc2487 tempest-ServerRescueNegativeTestJSON-1008482296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:31:14 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-496b6079-656d-481c-bf95-9b8eb9cc2487 tempest-ServerRescueNegativeTestJSON-1008482296 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:31:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1958394825',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcc0dd68-5975-41b6-b641-1236eba4cbcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c933b0ce13134afdb5191cdad291672a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:31:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:31:15Z,use_quota=True,user_id='9fb0d51aaf6b4f34bcf2a73fb767b9e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:31:14 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-496b6079-656d-481c-bf95-9b8eb9cc2487 tempest-ServerRescueNegativeTestJSON-1008482296 None] Creating volume dcc0dd68-5975-41b6-b641-1236eba4cbcc {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:31:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-496b6079-656d-481c-bf95-9b8eb9cc2487 tempest-ServerRescueNegativeTestJSON-1008482296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:31:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-496b6079-656d-481c-bf95-9b8eb9cc2487 tempest-ServerRescueNegativeTestJSON-1008482296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:31:14 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-496b6079-656d-481c-bf95-9b8eb9cc2487 tempest-ServerRescueNegativeTestJSON-1008482296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:31:14 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-496b6079-656d-481c-bf95-9b8eb9cc2487 tempest-ServerRescueNegativeTestJSON-1008482296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:31:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-496b6079-656d-481c-bf95-9b8eb9cc2487 tempest-ServerRescueNegativeTestJSON-1008482296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:31:14 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-496b6079-656d-481c-bf95-9b8eb9cc2487 tempest-ServerRescueNegativeTestJSON-1008482296 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:31:14 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-496b6079-656d-481c-bf95-9b8eb9cc2487 tempest-ServerRescueNegativeTestJSON-1008482296 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:31:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-496b6079-656d-481c-bf95-9b8eb9cc2487 tempest-ServerRescueNegativeTestJSON-1008482296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-dcc0dd68-5975-41b6-b641-1236eba4cbcc 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:31:14 devstack sudo[88420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-dcc0dd68-5975-41b6-b641-1236eba4cbcc 1073741824
Jul 09 14:31:14 devstack sudo[88420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:31:17 devstack sudo[88420]: pam_unix(sudo:session): session closed for user root
Jul 09 14:31:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-496b6079-656d-481c-bf95-9b8eb9cc2487 tempest-ServerRescueNegativeTestJSON-1008482296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-dcc0dd68-5975-41b6-b641-1236eba4cbcc 1073741824" returned: 0 in 2.358s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:31:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-496b6079-656d-481c-bf95-9b8eb9cc2487 tempest-ServerRescueNegativeTestJSON-1008482296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-dcc0dd68-5975-41b6-b641-1236eba4cbcc {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:31:17 devstack sudo[88433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-dcc0dd68-5975-41b6-b641-1236eba4cbcc
Jul 09 14:31:17 devstack sudo[88433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:31:19 devstack sudo[88433]: pam_unix(sudo:session): session closed for user root
Jul 09 14:31:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-496b6079-656d-481c-bf95-9b8eb9cc2487 tempest-ServerRescueNegativeTestJSON-1008482296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-dcc0dd68-5975-41b6-b641-1236eba4cbcc" returned: 0 in 2.103s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:31:19 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-496b6079-656d-481c-bf95-9b8eb9cc2487 tempest-ServerRescueNegativeTestJSON-1008482296 None] <== create_volume: return (4613ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:31:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-496b6079-656d-481c-bf95-9b8eb9cc2487 tempest-ServerRescueNegativeTestJSON-1008482296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.623s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:31:19 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-496b6079-656d-481c-bf95-9b8eb9cc2487 tempest-ServerRescueNegativeTestJSON-1008482296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (746eca50-f032-4b8a-b193-3601e21ef94f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcc0dd68-5975-41b6-b641-1236eba4cbcc', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:31:19 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-496b6079-656d-481c-bf95-9b8eb9cc2487 tempest-ServerRescueNegativeTestJSON-1008482296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07f3e4af-2ac3-47e3-b80b-982b3d738866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:31:19 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-496b6079-656d-481c-bf95-9b8eb9cc2487 tempest-ServerRescueNegativeTestJSON-1008482296 None] Volume volume-dcc0dd68-5975-41b6-b641-1236eba4cbcc (dcc0dd68-5975-41b6-b641-1236eba4cbcc): created successfully
Jul 09 14:31:19 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-496b6079-656d-481c-bf95-9b8eb9cc2487 tempest-ServerRescueNegativeTestJSON-1008482296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07f3e4af-2ac3-47e3-b80b-982b3d738866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:31:19 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-496b6079-656d-481c-bf95-9b8eb9cc2487 tempest-ServerRescueNegativeTestJSON-1008482296 None] Flow 'volume_create_manager' (b4698c74-50ef-48e3-8147-f917ee4620d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:31:19 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-496b6079-656d-481c-bf95-9b8eb9cc2487 tempest-ServerRescueNegativeTestJSON-1008482296 None] Created volume successfully.
Jul 09 14:31:20 devstack cinder-volume[87230]: WARNING py.warnings [req-05dac180-833c-4616-b98c-7f567f5e727c req-f68a84d8-a39c-4446-9974-b12f40b45901 tempest-DeleteServersTestJSON-438163135 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1".  Apply join condition(s) between each element to resolve.
Jul 09 14:31:20 devstack cinder-volume[87230]:   .first()
Jul 09 14:31:20 devstack cinder-volume[87230]: 
Jul 09 14:31:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-05dac180-833c-4616-b98c-7f567f5e727c req-f68a84d8-a39c-4446-9974-b12f40b45901 tempest-DeleteServersTestJSON-438163135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:31:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-05dac180-833c-4616-b98c-7f567f5e727c req-f68a84d8-a39c-4446-9974-b12f40b45901 tempest-DeleteServersTestJSON-438163135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:31:20 devstack cinder-volume[87230]: INFO oslo.privsep.daemon [req-05dac180-833c-4616-b98c-7f567f5e727c req-f68a84d8-a39c-4446-9974-b12f40b45901 tempest-DeleteServersTestJSON-438163135 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpi_hdtw_y/privsep.sock']
Jul 09 14:31:20 devstack sudo[88510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpi_hdtw_y/privsep.sock
Jul 09 14:31:20 devstack sudo[88510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:31:22 devstack cinder-volume[87230]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
Jul 09 14:31:22 devstack cinder-volume[87230]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 09 14:31:22 devstack cinder-volume[87230]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Jul 09 14:31:22 devstack cinder-volume[87230]: WARNING oslo.privsep.daemon [-] privsep log: 
Jul 09 14:31:22 devstack cinder-volume[87230]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Jul 09 14:31:22 devstack cinder-volume[87230]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Jul 09 14:31:22 devstack cinder-volume[87230]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 09 14:31:22 devstack cinder-volume[87230]: WARNING oslo.privsep.daemon [-] privsep log: 
Jul 09 14:31:22 devstack cinder-volume[87230]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
Jul 09 14:31:23 devstack cinder-volume[87230]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning:
Jul 09 14:31:23 devstack cinder-volume[87230]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 09 14:31:23 devstack cinder-volume[87230]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Jul 09 14:31:23 devstack cinder-volume[87230]: WARNING oslo.privsep.daemon [-] privsep log: 
Jul 09 14:31:23 devstack cinder-volume[87230]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Jul 09 14:31:23 devstack cinder-volume[87230]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Jul 09 14:31:23 devstack cinder-volume[87230]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 09 14:31:23 devstack cinder-volume[87230]: WARNING oslo.privsep.daemon [-] privsep log: 
Jul 09 14:31:23 devstack cinder-volume[87230]: WARNING oslo.privsep.daemon [-] privsep log:   __import__(import_str)
Jul 09 14:31:24 devstack sudo[88510]: pam_unix(sudo:session): session closed for user root
Jul 09 14:31:24 devstack cinder-volume[87230]: INFO oslo.privsep.daemon [req-05dac180-833c-4616-b98c-7f567f5e727c req-f68a84d8-a39c-4446-9974-b12f40b45901 tempest-DeleteServersTestJSON-438163135 None] Spawned new privsep daemon via rootwrap
Jul 09 14:31:24 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [req-05dac180-833c-4616-b98c-7f567f5e727c req-f68a84d8-a39c-4446-9974-b12f40b45901 tempest-DeleteServersTestJSON-438163135 None] Accepted privsep connection to /tmp/tmpi_hdtw_y/privsep.sock {{(pid=87230) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}}
Jul 09 14:31:24 devstack cinder-volume[87230]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jul 09 14:31:24 devstack cinder-volume[87230]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jul 09 14:31:24 devstack cinder-volume[87230]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Jul 09 14:31:24 devstack cinder-volume[87230]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88541
Jul 09 14:31:24 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[1220cf46-dbec-441a-b0a1-b8812c7d68e1]: (2,) {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:31:24 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8aaf951-e493-45c7-b025-dca78f04059a]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:31:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-05dac180-833c-4616-b98c-7f567f5e727c req-f68a84d8-a39c-4446-9974-b12f40b45901 tempest-DeleteServersTestJSON-438163135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-186f1824-7a1a-4fe6-aac9-f643431a2880 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:31:24 devstack sudo[88544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-186f1824-7a1a-4fe6-aac9-f643431a2880
Jul 09 14:31:24 devstack sudo[88544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:31:25 devstack sudo[88544]: pam_unix(sudo:session): session closed for user root
Jul 09 14:31:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-05dac180-833c-4616-b98c-7f567f5e727c req-f68a84d8-a39c-4446-9974-b12f40b45901 tempest-DeleteServersTestJSON-438163135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-186f1824-7a1a-4fe6-aac9-f643431a2880" returned: 0 in 1.349s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:31:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-05dac180-833c-4616-b98c-7f567f5e727c req-f68a84d8-a39c-4446-9974-b12f40b45901 tempest-DeleteServersTestJSON-438163135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 4.681s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:31:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-05dac180-833c-4616-b98c-7f567f5e727c req-f68a84d8-a39c-4446-9974-b12f40b45901 tempest-DeleteServersTestJSON-438163135 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653', 'name': 'volume-186f1824-7a1a-4fe6-aac9-f643431a2880', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0eb45852-e154-4137-97ea-74d17642640f', 'enforce_multipath': True} {{(pid=87230) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 09 14:31:25 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-05dac180-833c-4616-b98c-7f567f5e727c req-f68a84d8-a39c-4446-9974-b12f40b45901 tempest-DeleteServersTestJSON-438163135 None] attachment_update completed successfully.
Jul 09 14:31:30 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e9a9c73-11d6-4c50-aae7-252e6256c354 tempest-ServersNegativeTestJSON-1546869337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:31:30 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3e9a9c73-11d6-4c50-aae7-252e6256c354 tempest-ServersNegativeTestJSON-1546869337 None] Flow 'volume_create_manager' (93c913f7-5c34-453c-8d83-f2a2d1a4a0e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:31:30 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3e9a9c73-11d6-4c50-aae7-252e6256c354 tempest-ServersNegativeTestJSON-1546869337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00be04ad-8997-4f19-9d1a-e961d274fc1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:31:30 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3e9a9c73-11d6-4c50-aae7-252e6256c354 tempest-ServersNegativeTestJSON-1546869337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00be04ad-8997-4f19-9d1a-e961d274fc1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:31:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-872806522',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ea34b4f-be88-4ad7-b461-46f0db9b10d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24014bb37c4f4b07b2dc3e71f591f28b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:31:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:31:30Z,use_quota=True,user_id='78ae4229eda74c1e912c7ce8e453b911',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:31:30 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3e9a9c73-11d6-4c50-aae7-252e6256c354 tempest-ServersNegativeTestJSON-1546869337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc955647-b9c3-4b3f-8d37-1cf1f0a28ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:31:30 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3e9a9c73-11d6-4c50-aae7-252e6256c354 tempest-ServersNegativeTestJSON-1546869337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc955647-b9c3-4b3f-8d37-1cf1f0a28ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:31:30 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3e9a9c73-11d6-4c50-aae7-252e6256c354 tempest-ServersNegativeTestJSON-1546869337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5ba5be8-bf9d-4bdd-b329-4bcb290b0804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:31:30 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3e9a9c73-11d6-4c50-aae7-252e6256c354 tempest-ServersNegativeTestJSON-1546869337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5ba5be8-bf9d-4bdd-b329-4bcb290b0804) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ea34b4f-be88-4ad7-b461-46f0db9b10d0', 'volume_name': 'volume-5ea34b4f-be88-4ad7-b461-46f0db9b10d0', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:31:30 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3e9a9c73-11d6-4c50-aae7-252e6256c354 tempest-ServersNegativeTestJSON-1546869337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77329c46-21b0-4561-9ad5-6e446b1101f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:31:30 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3e9a9c73-11d6-4c50-aae7-252e6256c354 tempest-ServersNegativeTestJSON-1546869337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77329c46-21b0-4561-9ad5-6e446b1101f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:31:30 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3e9a9c73-11d6-4c50-aae7-252e6256c354 tempest-ServersNegativeTestJSON-1546869337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64ebb21c-a654-4652-ad49-de56bb87db1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:31:30 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-3e9a9c73-11d6-4c50-aae7-252e6256c354 tempest-ServersNegativeTestJSON-1546869337 None] Volume 5ea34b4f-be88-4ad7-b461-46f0db9b10d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ea34b4f-be88-4ad7-b461-46f0db9b10d0', 'volume_size': 1}
Jul 09 14:31:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3e9a9c73-11d6-4c50-aae7-252e6256c354 tempest-ServersNegativeTestJSON-1546869337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:31:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3e9a9c73-11d6-4c50-aae7-252e6256c354 tempest-ServersNegativeTestJSON-1546869337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:31:30 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3e9a9c73-11d6-4c50-aae7-252e6256c354 tempest-ServersNegativeTestJSON-1546869337 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:31:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-872806522',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ea34b4f-be88-4ad7-b461-46f0db9b10d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24014bb37c4f4b07b2dc3e71f591f28b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:31:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:31:30Z,use_quota=True,user_id='78ae4229eda74c1e912c7ce8e453b911',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:31:30 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-3e9a9c73-11d6-4c50-aae7-252e6256c354 tempest-ServersNegativeTestJSON-1546869337 None] Creating volume 5ea34b4f-be88-4ad7-b461-46f0db9b10d0 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:31:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3e9a9c73-11d6-4c50-aae7-252e6256c354 tempest-ServersNegativeTestJSON-1546869337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:31:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3e9a9c73-11d6-4c50-aae7-252e6256c354 tempest-ServersNegativeTestJSON-1546869337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:31:30 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3e9a9c73-11d6-4c50-aae7-252e6256c354 tempest-ServersNegativeTestJSON-1546869337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:31:30 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3e9a9c73-11d6-4c50-aae7-252e6256c354 tempest-ServersNegativeTestJSON-1546869337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:31:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3e9a9c73-11d6-4c50-aae7-252e6256c354 tempest-ServersNegativeTestJSON-1546869337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:31:30 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3e9a9c73-11d6-4c50-aae7-252e6256c354 tempest-ServersNegativeTestJSON-1546869337 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:31:30 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-3e9a9c73-11d6-4c50-aae7-252e6256c354 tempest-ServersNegativeTestJSON-1546869337 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:31:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3e9a9c73-11d6-4c50-aae7-252e6256c354 tempest-ServersNegativeTestJSON-1546869337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-5ea34b4f-be88-4ad7-b461-46f0db9b10d0 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:31:30 devstack sudo[88994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-5ea34b4f-be88-4ad7-b461-46f0db9b10d0 1073741824
Jul 09 14:31:30 devstack sudo[88994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:31:32 devstack sudo[88994]: pam_unix(sudo:session): session closed for user root
Jul 09 14:31:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3e9a9c73-11d6-4c50-aae7-252e6256c354 tempest-ServersNegativeTestJSON-1546869337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-5ea34b4f-be88-4ad7-b461-46f0db9b10d0 1073741824" returned: 0 in 1.304s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:31:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3e9a9c73-11d6-4c50-aae7-252e6256c354 tempest-ServersNegativeTestJSON-1546869337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-5ea34b4f-be88-4ad7-b461-46f0db9b10d0 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:31:32 devstack sudo[89016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-5ea34b4f-be88-4ad7-b461-46f0db9b10d0
Jul 09 14:31:32 devstack sudo[89016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:31:33 devstack sudo[89016]: pam_unix(sudo:session): session closed for user root
Jul 09 14:31:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3e9a9c73-11d6-4c50-aae7-252e6256c354 tempest-ServersNegativeTestJSON-1546869337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-5ea34b4f-be88-4ad7-b461-46f0db9b10d0" returned: 0 in 1.519s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:31:33 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3e9a9c73-11d6-4c50-aae7-252e6256c354 tempest-ServersNegativeTestJSON-1546869337 None] <== create_volume: return (2920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:31:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3e9a9c73-11d6-4c50-aae7-252e6256c354 tempest-ServersNegativeTestJSON-1546869337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.924s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:31:33 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3e9a9c73-11d6-4c50-aae7-252e6256c354 tempest-ServersNegativeTestJSON-1546869337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64ebb21c-a654-4652-ad49-de56bb87db1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ea34b4f-be88-4ad7-b461-46f0db9b10d0', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:31:33 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3e9a9c73-11d6-4c50-aae7-252e6256c354 tempest-ServersNegativeTestJSON-1546869337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33bb4285-59f2-42f2-a590-75ab7ef4ff84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:31:33 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-3e9a9c73-11d6-4c50-aae7-252e6256c354 tempest-ServersNegativeTestJSON-1546869337 None] Volume volume-5ea34b4f-be88-4ad7-b461-46f0db9b10d0 (5ea34b4f-be88-4ad7-b461-46f0db9b10d0): created successfully
Jul 09 14:31:33 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3e9a9c73-11d6-4c50-aae7-252e6256c354 tempest-ServersNegativeTestJSON-1546869337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33bb4285-59f2-42f2-a590-75ab7ef4ff84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:31:33 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3e9a9c73-11d6-4c50-aae7-252e6256c354 tempest-ServersNegativeTestJSON-1546869337 None] Flow 'volume_create_manager' (93c913f7-5c34-453c-8d83-f2a2d1a4a0e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:31:33 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-3e9a9c73-11d6-4c50-aae7-252e6256c354 tempest-ServersNegativeTestJSON-1546869337 None] Created volume successfully.
Jul 09 14:31:36 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-e0da2c1b-66c1-497d-b8d4-ac6e9b4380d0 req-5b6b050a-e0f9-4fe5-ac85-bcfa9ac2d95c tempest-DeleteServersTestJSON-438163135 None] Terminate volume connection completed successfully.
Jul 09 14:31:36 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-e0da2c1b-66c1-497d-b8d4-ac6e9b4380d0 req-5b6b050a-e0f9-4fe5-ac85-bcfa9ac2d95c tempest-DeleteServersTestJSON-438163135 None] Deleting attachment 0eb45852-e154-4137-97ea-74d17642640f. {{(pid=87230) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 09 14:31:37 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6283d8d-1d0d-46c7-b224-ad1687261494 tempest-ServersNegativeTestJSON-1546869337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:31:37 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f6283d8d-1d0d-46c7-b224-ad1687261494 tempest-ServersNegativeTestJSON-1546869337 None] Flow 'volume_create_manager' (5d470d96-fa96-4277-ab54-b4819016cb59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:31:37 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f6283d8d-1d0d-46c7-b224-ad1687261494 tempest-ServersNegativeTestJSON-1546869337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (420d5bfd-f7f3-4517-888e-4d5e10edd6e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:31:37 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f6283d8d-1d0d-46c7-b224-ad1687261494 tempest-ServersNegativeTestJSON-1546869337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (420d5bfd-f7f3-4517-888e-4d5e10edd6e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:31:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1924992032',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=639c7b94-32d8-4d42-8b87-083a9fac21e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24014bb37c4f4b07b2dc3e71f591f28b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:31:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:31:38Z,use_quota=True,user_id='78ae4229eda74c1e912c7ce8e453b911',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:31:37 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f6283d8d-1d0d-46c7-b224-ad1687261494 tempest-ServersNegativeTestJSON-1546869337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53d4177c-28db-47d5-9a56-60638fcb67b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:31:37 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f6283d8d-1d0d-46c7-b224-ad1687261494 tempest-ServersNegativeTestJSON-1546869337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53d4177c-28db-47d5-9a56-60638fcb67b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:31:37 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f6283d8d-1d0d-46c7-b224-ad1687261494 tempest-ServersNegativeTestJSON-1546869337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (860d578c-181c-46cd-a9d8-2bae9f0239f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:31:37 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f6283d8d-1d0d-46c7-b224-ad1687261494 tempest-ServersNegativeTestJSON-1546869337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (860d578c-181c-46cd-a9d8-2bae9f0239f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '639c7b94-32d8-4d42-8b87-083a9fac21e6', 'volume_name': 'volume-639c7b94-32d8-4d42-8b87-083a9fac21e6', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:31:37 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f6283d8d-1d0d-46c7-b224-ad1687261494 tempest-ServersNegativeTestJSON-1546869337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e706141-f89f-44ac-becb-21f87b41d08e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:31:37 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f6283d8d-1d0d-46c7-b224-ad1687261494 tempest-ServersNegativeTestJSON-1546869337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e706141-f89f-44ac-becb-21f87b41d08e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:31:37 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f6283d8d-1d0d-46c7-b224-ad1687261494 tempest-ServersNegativeTestJSON-1546869337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15f72c78-2c33-4474-9adb-665a76f63eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:31:37 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-f6283d8d-1d0d-46c7-b224-ad1687261494 tempest-ServersNegativeTestJSON-1546869337 None] Volume 639c7b94-32d8-4d42-8b87-083a9fac21e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-639c7b94-32d8-4d42-8b87-083a9fac21e6', 'volume_size': 1}
Jul 09 14:31:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f6283d8d-1d0d-46c7-b224-ad1687261494 tempest-ServersNegativeTestJSON-1546869337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:31:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f6283d8d-1d0d-46c7-b224-ad1687261494 tempest-ServersNegativeTestJSON-1546869337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:31:37 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f6283d8d-1d0d-46c7-b224-ad1687261494 tempest-ServersNegativeTestJSON-1546869337 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:31:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1924992032',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=639c7b94-32d8-4d42-8b87-083a9fac21e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24014bb37c4f4b07b2dc3e71f591f28b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:31:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:31:38Z,use_quota=True,user_id='78ae4229eda74c1e912c7ce8e453b911',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:31:37 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-f6283d8d-1d0d-46c7-b224-ad1687261494 tempest-ServersNegativeTestJSON-1546869337 None] Creating volume 639c7b94-32d8-4d42-8b87-083a9fac21e6 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:31:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f6283d8d-1d0d-46c7-b224-ad1687261494 tempest-ServersNegativeTestJSON-1546869337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:31:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f6283d8d-1d0d-46c7-b224-ad1687261494 tempest-ServersNegativeTestJSON-1546869337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:31:37 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f6283d8d-1d0d-46c7-b224-ad1687261494 tempest-ServersNegativeTestJSON-1546869337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:31:37 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f6283d8d-1d0d-46c7-b224-ad1687261494 tempest-ServersNegativeTestJSON-1546869337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:31:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f6283d8d-1d0d-46c7-b224-ad1687261494 tempest-ServersNegativeTestJSON-1546869337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:31:37 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f6283d8d-1d0d-46c7-b224-ad1687261494 tempest-ServersNegativeTestJSON-1546869337 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:31:37 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-f6283d8d-1d0d-46c7-b224-ad1687261494 tempest-ServersNegativeTestJSON-1546869337 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:31:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f6283d8d-1d0d-46c7-b224-ad1687261494 tempest-ServersNegativeTestJSON-1546869337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-639c7b94-32d8-4d42-8b87-083a9fac21e6 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:31:37 devstack sudo[89115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-639c7b94-32d8-4d42-8b87-083a9fac21e6 1073741824
Jul 09 14:31:37 devstack sudo[89115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:31:38 devstack sudo[89115]: pam_unix(sudo:session): session closed for user root
Jul 09 14:31:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f6283d8d-1d0d-46c7-b224-ad1687261494 tempest-ServersNegativeTestJSON-1546869337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-639c7b94-32d8-4d42-8b87-083a9fac21e6 1073741824" returned: 0 in 1.154s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:31:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f6283d8d-1d0d-46c7-b224-ad1687261494 tempest-ServersNegativeTestJSON-1546869337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-639c7b94-32d8-4d42-8b87-083a9fac21e6 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:31:39 devstack sudo[89141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-639c7b94-32d8-4d42-8b87-083a9fac21e6
Jul 09 14:31:39 devstack sudo[89141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:31:40 devstack sudo[89141]: pam_unix(sudo:session): session closed for user root
Jul 09 14:31:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f6283d8d-1d0d-46c7-b224-ad1687261494 tempest-ServersNegativeTestJSON-1546869337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-639c7b94-32d8-4d42-8b87-083a9fac21e6" returned: 0 in 1.067s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:31:40 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f6283d8d-1d0d-46c7-b224-ad1687261494 tempest-ServersNegativeTestJSON-1546869337 None] <== create_volume: return (2305ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:31:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f6283d8d-1d0d-46c7-b224-ad1687261494 tempest-ServersNegativeTestJSON-1546869337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.312s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:31:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f6283d8d-1d0d-46c7-b224-ad1687261494 tempest-ServersNegativeTestJSON-1546869337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15f72c78-2c33-4474-9adb-665a76f63eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-639c7b94-32d8-4d42-8b87-083a9fac21e6', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:31:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f6283d8d-1d0d-46c7-b224-ad1687261494 tempest-ServersNegativeTestJSON-1546869337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09251b24-45a4-4dce-a16b-2a016a8da7f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:31:40 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-f6283d8d-1d0d-46c7-b224-ad1687261494 tempest-ServersNegativeTestJSON-1546869337 None] Volume volume-639c7b94-32d8-4d42-8b87-083a9fac21e6 (639c7b94-32d8-4d42-8b87-083a9fac21e6): created successfully
Jul 09 14:31:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f6283d8d-1d0d-46c7-b224-ad1687261494 tempest-ServersNegativeTestJSON-1546869337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09251b24-45a4-4dce-a16b-2a016a8da7f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:31:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f6283d8d-1d0d-46c7-b224-ad1687261494 tempest-ServersNegativeTestJSON-1546869337 None] Flow 'volume_create_manager' (5d470d96-fa96-4277-ab54-b4819016cb59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:31:40 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-f6283d8d-1d0d-46c7-b224-ad1687261494 tempest-ServersNegativeTestJSON-1546869337 None] Created volume successfully.
Jul 09 14:31:40 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-2c1c50cd-f6be-4083-99db-54cf73065578 tempest-DeleteServersTestJSON-438163135 None] Acquiring lock "cinder-186f1824-7a1a-4fe6-aac9-f643431a2880-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:31:40 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-2c1c50cd-f6be-4083-99db-54cf73065578 tempest-DeleteServersTestJSON-438163135 None] Lock "cinder-186f1824-7a1a-4fe6-aac9-f643431a2880-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:31:40 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-2c1c50cd-f6be-4083-99db-54cf73065578 tempest-DeleteServersTestJSON-438163135 None] Acquiring lock "cinder-quobyte-186f1824-7a1a-4fe6-aac9-f643431a2880" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:31:40 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-2c1c50cd-f6be-4083-99db-54cf73065578 tempest-DeleteServersTestJSON-438163135 None] Lock "cinder-quobyte-186f1824-7a1a-4fe6-aac9-f643431a2880" acquired by "delete_volume" :: waited 0.016s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:31:40 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[af725374-9d97-4d0d-ab38-be28a6145234]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:31:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2c1c50cd-f6be-4083-99db-54cf73065578 tempest-DeleteServersTestJSON-438163135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-186f1824-7a1a-4fe6-aac9-f643431a2880 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:31:41 devstack sudo[89147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-186f1824-7a1a-4fe6-aac9-f643431a2880
Jul 09 14:31:41 devstack sudo[89147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:31:41 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a977d04a-b554-4443-a0bf-2f59c792ef0b tempest-ServersNegativeTestJSON-1546869337 None] Acquiring lock "cinder-639c7b94-32d8-4d42-8b87-083a9fac21e6-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:31:41 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a977d04a-b554-4443-a0bf-2f59c792ef0b tempest-ServersNegativeTestJSON-1546869337 None] Lock "cinder-639c7b94-32d8-4d42-8b87-083a9fac21e6-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:31:42 devstack sudo[89147]: pam_unix(sudo:session): session closed for user root
Jul 09 14:31:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2c1c50cd-f6be-4083-99db-54cf73065578 tempest-DeleteServersTestJSON-438163135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-186f1824-7a1a-4fe6-aac9-f643431a2880" returned: 0 in 1.123s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:31:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2c1c50cd-f6be-4083-99db-54cf73065578 tempest-DeleteServersTestJSON-438163135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-186f1824-7a1a-4fe6-aac9-f643431a2880 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:31:42 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a977d04a-b554-4443-a0bf-2f59c792ef0b tempest-ServersNegativeTestJSON-1546869337 None] Acquiring lock "cinder-quobyte-639c7b94-32d8-4d42-8b87-083a9fac21e6" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:31:42 devstack sudo[89152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-186f1824-7a1a-4fe6-aac9-f643431a2880
Jul 09 14:31:42 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a977d04a-b554-4443-a0bf-2f59c792ef0b tempest-ServersNegativeTestJSON-1546869337 None] Lock "cinder-quobyte-639c7b94-32d8-4d42-8b87-083a9fac21e6" acquired by "delete_volume" :: waited 0.029s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:31:42 devstack sudo[89152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:31:42 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd5f7ea-d181-43a6-bdfa-4e73fb00d608]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:31:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a977d04a-b554-4443-a0bf-2f59c792ef0b tempest-ServersNegativeTestJSON-1546869337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-639c7b94-32d8-4d42-8b87-083a9fac21e6 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:31:42 devstack sudo[89154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-639c7b94-32d8-4d42-8b87-083a9fac21e6
Jul 09 14:31:42 devstack sudo[89154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:31:43 devstack sudo[89152]: pam_unix(sudo:session): session closed for user root
Jul 09 14:31:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2c1c50cd-f6be-4083-99db-54cf73065578 tempest-DeleteServersTestJSON-438163135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-186f1824-7a1a-4fe6-aac9-f643431a2880" returned: 0 in 0.977s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:31:43 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-2c1c50cd-f6be-4083-99db-54cf73065578 tempest-DeleteServersTestJSON-438163135 None] Lock "cinder-quobyte-186f1824-7a1a-4fe6-aac9-f643431a2880" released by "delete_volume" :: held 2.167s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:31:43 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-01dad1b6-91f1-42e2-893b-35305234a59d tempest-ServerRescueNegativeTestJSON-1008482296 None] Acquiring lock "cinder-dcc0dd68-5975-41b6-b641-1236eba4cbcc-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:31:43 devstack cinder-volume[87230]: WARNING cinder.quota [None req-2c1c50cd-f6be-4083-99db-54cf73065578 tempest-DeleteServersTestJSON-438163135 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jul 09 14:31:43 devstack cinder-volume[87230]: WARNING cinder.quota [None req-2c1c50cd-f6be-4083-99db-54cf73065578 tempest-DeleteServersTestJSON-438163135 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jul 09 14:31:43 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-01dad1b6-91f1-42e2-893b-35305234a59d tempest-ServerRescueNegativeTestJSON-1008482296 None] Lock "cinder-dcc0dd68-5975-41b6-b641-1236eba4cbcc-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:31:43 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-2c1c50cd-f6be-4083-99db-54cf73065578 tempest-DeleteServersTestJSON-438163135 None] Created reservations ['6efd4ab6-f65b-4411-b7bd-97e522cda785', '2ed010b1-e0f0-48e2-9919-fd73e2abb52d', 'f66355a6-4df1-4a81-bfc8-47699d87b794', 'cdf8268c-58df-4f55-bbf0-5a71b2268783'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:31:43 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-01dad1b6-91f1-42e2-893b-35305234a59d tempest-ServerRescueNegativeTestJSON-1008482296 None] Acquiring lock "cinder-quobyte-dcc0dd68-5975-41b6-b641-1236eba4cbcc" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:31:43 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-01dad1b6-91f1-42e2-893b-35305234a59d tempest-ServerRescueNegativeTestJSON-1008482296 None] Lock "cinder-quobyte-dcc0dd68-5975-41b6-b641-1236eba4cbcc" acquired by "delete_volume" :: waited 0.031s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:31:43 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a87d32a-73cd-42bf-ae27-6884830c9564]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:31:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-01dad1b6-91f1-42e2-893b-35305234a59d tempest-ServerRescueNegativeTestJSON-1008482296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-dcc0dd68-5975-41b6-b641-1236eba4cbcc {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:31:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-2c1c50cd-f6be-4083-99db-54cf73065578 tempest-DeleteServersTestJSON-438163135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:31:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-2c1c50cd-f6be-4083-99db-54cf73065578 tempest-DeleteServersTestJSON-438163135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:31:43 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-2c1c50cd-f6be-4083-99db-54cf73065578 tempest-DeleteServersTestJSON-438163135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:31:43 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-2c1c50cd-f6be-4083-99db-54cf73065578 tempest-DeleteServersTestJSON-438163135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:31:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-2c1c50cd-f6be-4083-99db-54cf73065578 tempest-DeleteServersTestJSON-438163135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:31:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2c1c50cd-f6be-4083-99db-54cf73065578 tempest-DeleteServersTestJSON-438163135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:31:43 devstack sudo[89162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:31:43 devstack sudo[89162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:31:43 devstack sudo[89159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-dcc0dd68-5975-41b6-b641-1236eba4cbcc
Jul 09 14:31:43 devstack sudo[89159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:31:43 devstack sudo[89154]: pam_unix(sudo:session): session closed for user root
Jul 09 14:31:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a977d04a-b554-4443-a0bf-2f59c792ef0b tempest-ServersNegativeTestJSON-1546869337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-639c7b94-32d8-4d42-8b87-083a9fac21e6" returned: 0 in 1.722s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:31:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a977d04a-b554-4443-a0bf-2f59c792ef0b tempest-ServersNegativeTestJSON-1546869337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-639c7b94-32d8-4d42-8b87-083a9fac21e6 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:31:43 devstack sudo[89165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-639c7b94-32d8-4d42-8b87-083a9fac21e6
Jul 09 14:31:43 devstack sudo[89165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:31:44 devstack sudo[89162]: pam_unix(sudo:session): session closed for user root
Jul 09 14:31:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2c1c50cd-f6be-4083-99db-54cf73065578 tempest-DeleteServersTestJSON-438163135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 1.261s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:31:44 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-2c1c50cd-f6be-4083-99db-54cf73065578 tempest-DeleteServersTestJSON-438163135 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:31:44 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-2c1c50cd-f6be-4083-99db-54cf73065578 tempest-DeleteServersTestJSON-438163135 None] Deleted volume successfully.
Jul 09 14:31:44 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-2c1c50cd-f6be-4083-99db-54cf73065578 tempest-DeleteServersTestJSON-438163135 None] Lock "cinder-186f1824-7a1a-4fe6-aac9-f643431a2880-delete_volume" released by "delete_volume" :: held 4.114s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:31:45 devstack sudo[89165]: pam_unix(sudo:session): session closed for user root
Jul 09 14:31:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a977d04a-b554-4443-a0bf-2f59c792ef0b tempest-ServersNegativeTestJSON-1546869337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-639c7b94-32d8-4d42-8b87-083a9fac21e6" returned: 0 in 1.158s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:31:45 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a977d04a-b554-4443-a0bf-2f59c792ef0b tempest-ServersNegativeTestJSON-1546869337 None] Lock "cinder-quobyte-639c7b94-32d8-4d42-8b87-083a9fac21e6" released by "delete_volume" :: held 2.978s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:31:45 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-a977d04a-b554-4443-a0bf-2f59c792ef0b tempest-ServersNegativeTestJSON-1546869337 None] Created reservations ['a55b86be-5cd8-45a6-a865-ec46c851c91f', 'f1faa919-0c12-4fc6-b46a-5021be22cc16', 'beed78b6-3e31-4f48-9190-2e00a12723a9', '50c21991-a1e4-44e0-aa5e-63d02a3a783d'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:31:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a977d04a-b554-4443-a0bf-2f59c792ef0b tempest-ServersNegativeTestJSON-1546869337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:31:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a977d04a-b554-4443-a0bf-2f59c792ef0b tempest-ServersNegativeTestJSON-1546869337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:31:45 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a977d04a-b554-4443-a0bf-2f59c792ef0b tempest-ServersNegativeTestJSON-1546869337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:31:45 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a977d04a-b554-4443-a0bf-2f59c792ef0b tempest-ServersNegativeTestJSON-1546869337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:31:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a977d04a-b554-4443-a0bf-2f59c792ef0b tempest-ServersNegativeTestJSON-1546869337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:31:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a977d04a-b554-4443-a0bf-2f59c792ef0b tempest-ServersNegativeTestJSON-1546869337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:31:45 devstack sudo[89172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:31:45 devstack sudo[89172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:31:45 devstack sudo[89159]: pam_unix(sudo:session): session closed for user root
Jul 09 14:31:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-01dad1b6-91f1-42e2-893b-35305234a59d tempest-ServerRescueNegativeTestJSON-1008482296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-dcc0dd68-5975-41b6-b641-1236eba4cbcc" returned: 0 in 2.136s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:31:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-01dad1b6-91f1-42e2-893b-35305234a59d tempest-ServerRescueNegativeTestJSON-1008482296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-dcc0dd68-5975-41b6-b641-1236eba4cbcc {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:31:45 devstack sudo[89174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-dcc0dd68-5975-41b6-b641-1236eba4cbcc
Jul 09 14:31:45 devstack sudo[89174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:31:45 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-042582d3-1a4c-4392-812d-8f5818285623 tempest-ServersNegativeTestJSON-1546869337 None] Acquiring lock "cinder-5ea34b4f-be88-4ad7-b461-46f0db9b10d0-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:31:45 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-042582d3-1a4c-4392-812d-8f5818285623 tempest-ServersNegativeTestJSON-1546869337 None] Lock "cinder-5ea34b4f-be88-4ad7-b461-46f0db9b10d0-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:31:46 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-042582d3-1a4c-4392-812d-8f5818285623 tempest-ServersNegativeTestJSON-1546869337 None] Acquiring lock "cinder-quobyte-5ea34b4f-be88-4ad7-b461-46f0db9b10d0" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:31:46 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-042582d3-1a4c-4392-812d-8f5818285623 tempest-ServersNegativeTestJSON-1546869337 None] Lock "cinder-quobyte-5ea34b4f-be88-4ad7-b461-46f0db9b10d0" acquired by "delete_volume" :: waited 0.052s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:31:46 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f3e6270-d6fc-4c56-b6ca-285519471e11]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:31:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-042582d3-1a4c-4392-812d-8f5818285623 tempest-ServersNegativeTestJSON-1546869337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-5ea34b4f-be88-4ad7-b461-46f0db9b10d0 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:31:46 devstack sudo[89176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-5ea34b4f-be88-4ad7-b461-46f0db9b10d0
Jul 09 14:31:46 devstack sudo[89176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:31:46 devstack sudo[89174]: pam_unix(sudo:session): session closed for user root
Jul 09 14:31:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-01dad1b6-91f1-42e2-893b-35305234a59d tempest-ServerRescueNegativeTestJSON-1008482296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-dcc0dd68-5975-41b6-b641-1236eba4cbcc" returned: 0 in 1.336s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:31:47 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-01dad1b6-91f1-42e2-893b-35305234a59d tempest-ServerRescueNegativeTestJSON-1008482296 None] Lock "cinder-quobyte-dcc0dd68-5975-41b6-b641-1236eba4cbcc" released by "delete_volume" :: held 3.558s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:31:47 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-01dad1b6-91f1-42e2-893b-35305234a59d tempest-ServerRescueNegativeTestJSON-1008482296 None] Created reservations ['0ecffd66-a2d6-4f88-8eef-69465e15868d', '92043e04-4c26-4d2f-a073-55c3753d9164', '485b5a66-dd23-4578-9602-66f40d6b3ab3', '236cf0aa-20bf-4393-a0ce-978fbc74d53b'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:31:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-01dad1b6-91f1-42e2-893b-35305234a59d tempest-ServerRescueNegativeTestJSON-1008482296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:31:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-01dad1b6-91f1-42e2-893b-35305234a59d tempest-ServerRescueNegativeTestJSON-1008482296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:31:47 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-01dad1b6-91f1-42e2-893b-35305234a59d tempest-ServerRescueNegativeTestJSON-1008482296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:31:47 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-01dad1b6-91f1-42e2-893b-35305234a59d tempest-ServerRescueNegativeTestJSON-1008482296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:31:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-01dad1b6-91f1-42e2-893b-35305234a59d tempest-ServerRescueNegativeTestJSON-1008482296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:31:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-01dad1b6-91f1-42e2-893b-35305234a59d tempest-ServerRescueNegativeTestJSON-1008482296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:31:47 devstack sudo[89180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:31:47 devstack sudo[89180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:31:47 devstack sudo[89172]: pam_unix(sudo:session): session closed for user root
Jul 09 14:31:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a977d04a-b554-4443-a0bf-2f59c792ef0b tempest-ServersNegativeTestJSON-1546869337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 2.197s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:31:47 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-a977d04a-b554-4443-a0bf-2f59c792ef0b tempest-ServersNegativeTestJSON-1546869337 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:31:47 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-a977d04a-b554-4443-a0bf-2f59c792ef0b tempest-ServersNegativeTestJSON-1546869337 None] Deleted volume successfully.
Jul 09 14:31:47 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a977d04a-b554-4443-a0bf-2f59c792ef0b tempest-ServersNegativeTestJSON-1546869337 None] Lock "cinder-639c7b94-32d8-4d42-8b87-083a9fac21e6-delete_volume" released by "delete_volume" :: held 5.621s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:31:48 devstack sudo[89176]: pam_unix(sudo:session): session closed for user root
Jul 09 14:31:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-042582d3-1a4c-4392-812d-8f5818285623 tempest-ServersNegativeTestJSON-1546869337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-5ea34b4f-be88-4ad7-b461-46f0db9b10d0" returned: 0 in 1.842s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:31:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-042582d3-1a4c-4392-812d-8f5818285623 tempest-ServersNegativeTestJSON-1546869337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-5ea34b4f-be88-4ad7-b461-46f0db9b10d0 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:31:48 devstack sudo[89187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-5ea34b4f-be88-4ad7-b461-46f0db9b10d0
Jul 09 14:31:48 devstack sudo[89187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:31:48 devstack sudo[89180]: pam_unix(sudo:session): session closed for user root
Jul 09 14:31:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-01dad1b6-91f1-42e2-893b-35305234a59d tempest-ServerRescueNegativeTestJSON-1008482296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.976s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:31:48 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-01dad1b6-91f1-42e2-893b-35305234a59d tempest-ServerRescueNegativeTestJSON-1008482296 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:31:48 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-01dad1b6-91f1-42e2-893b-35305234a59d tempest-ServerRescueNegativeTestJSON-1008482296 None] Deleted volume successfully.
Jul 09 14:31:48 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-01dad1b6-91f1-42e2-893b-35305234a59d tempest-ServerRescueNegativeTestJSON-1008482296 None] Lock "cinder-dcc0dd68-5975-41b6-b641-1236eba4cbcc-delete_volume" released by "delete_volume" :: held 5.156s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:31:48 devstack sudo[89187]: pam_unix(sudo:session): session closed for user root
Jul 09 14:31:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-042582d3-1a4c-4392-812d-8f5818285623 tempest-ServersNegativeTestJSON-1546869337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-5ea34b4f-be88-4ad7-b461-46f0db9b10d0" returned: 0 in 0.874s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:31:49 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-042582d3-1a4c-4392-812d-8f5818285623 tempest-ServersNegativeTestJSON-1546869337 None] Lock "cinder-quobyte-5ea34b4f-be88-4ad7-b461-46f0db9b10d0" released by "delete_volume" :: held 2.884s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:31:49 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-042582d3-1a4c-4392-812d-8f5818285623 tempest-ServersNegativeTestJSON-1546869337 None] Created reservations ['6d2bf691-5cc9-4d9b-b8f8-7ba5956eb30a', '355b95c2-4956-47b1-851c-36624cb4981a', 'd8455c41-d38d-4e3b-8a6b-fccaecb713cd', '8312f9cc-a22e-415d-be18-33de784df05a'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:31:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-042582d3-1a4c-4392-812d-8f5818285623 tempest-ServersNegativeTestJSON-1546869337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:31:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-042582d3-1a4c-4392-812d-8f5818285623 tempest-ServersNegativeTestJSON-1546869337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:31:49 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-042582d3-1a4c-4392-812d-8f5818285623 tempest-ServersNegativeTestJSON-1546869337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:31:49 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-042582d3-1a4c-4392-812d-8f5818285623 tempest-ServersNegativeTestJSON-1546869337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:31:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-042582d3-1a4c-4392-812d-8f5818285623 tempest-ServersNegativeTestJSON-1546869337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:31:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-042582d3-1a4c-4392-812d-8f5818285623 tempest-ServersNegativeTestJSON-1546869337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:31:49 devstack sudo[89192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:31:49 devstack sudo[89192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:31:50 devstack sudo[89192]: pam_unix(sudo:session): session closed for user root
Jul 09 14:31:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-042582d3-1a4c-4392-812d-8f5818285623 tempest-ServersNegativeTestJSON-1546869337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 1.559s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:31:50 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-042582d3-1a4c-4392-812d-8f5818285623 tempest-ServersNegativeTestJSON-1546869337 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:31:50 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-042582d3-1a4c-4392-812d-8f5818285623 tempest-ServersNegativeTestJSON-1546869337 None] Deleted volume successfully.
Jul 09 14:31:50 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-042582d3-1a4c-4392-812d-8f5818285623 tempest-ServersNegativeTestJSON-1546869337 None] Lock "cinder-5ea34b4f-be88-4ad7-b461-46f0db9b10d0-delete_volume" released by "delete_volume" :: held 4.996s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:31:52 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 14:31:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:31:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:31:52 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:31:52 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:31:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:31:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:31:52 devstack sudo[89242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:31:52 devstack sudo[89242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:31:53 devstack sudo[89242]: pam_unix(sudo:session): session closed for user root
Jul 09 14:31:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.958s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:31:53 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:31:58 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-6b67f0f4-ac4e-4829-a8f7-0e73ead3f637 tempest-GroupSnapshotsTest-1020571071 None] Group tempest-GroupSnapshotsTest-Group-1815848794: creating
Jul 09 14:31:58 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=38,cinder:UPDATE=44,cinder:INSERT=12,cinder:DELETE=5 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 14:31:58 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-6b67f0f4-ac4e-4829-a8f7-0e73ead3f637 tempest-GroupSnapshotsTest-1020571071 None] Group tempest-GroupSnapshotsTest-Group-1815848794: created successfully
Jul 09 14:31:58 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-6b67f0f4-ac4e-4829-a8f7-0e73ead3f637 tempest-GroupSnapshotsTest-1020571071 None] Create group completed successfully.
Jul 09 14:31:59 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:UPDATE=51,cinder:SELECT=34,cinder:DELETE=3,cinder:INSERT=8 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 14:31:59 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c8c7b20-24ba-4e50-a32f-56ff49ff6633 tempest-GroupSnapshotsTest-1020571071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:31:59 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0c8c7b20-24ba-4e50-a32f-56ff49ff6633 tempest-GroupSnapshotsTest-1020571071 None] Flow 'volume_create_manager' (e662c061-8616-4c1b-be9c-f67196d02427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:31:59 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0c8c7b20-24ba-4e50-a32f-56ff49ff6633 tempest-GroupSnapshotsTest-1020571071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcd0e522-56c4-42be-950f-d291e9c77c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:31:59 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0c8c7b20-24ba-4e50-a32f-56ff49ff6633 tempest-GroupSnapshotsTest-1020571071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcd0e522-56c4-42be-950f-d291e9c77c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:31:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2113856146',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=78459869-f075-4ffe-a0c7-f621cc035f69,host='devstack@QuobyteHD#QuobyteHD',id=94effae8-1ce7-455f-a4eb-cd3052cb07b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='531740d4ee6f4b94a699d04a7eddb233',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:32:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:32:00Z,use_quota=True,user_id='6438d0684a2f482489697f50bffe8f8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38934564-e7ff-4caa-8e0b-597eefb41772),volume_type_id=38934564-e7ff-4caa-8e0b-597eefb41772)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:31:59 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0c8c7b20-24ba-4e50-a32f-56ff49ff6633 tempest-GroupSnapshotsTest-1020571071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48bc14a5-4114-4bdd-a606-00ee9743873e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:31:59 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0c8c7b20-24ba-4e50-a32f-56ff49ff6633 tempest-GroupSnapshotsTest-1020571071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48bc14a5-4114-4bdd-a606-00ee9743873e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:31:59 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0c8c7b20-24ba-4e50-a32f-56ff49ff6633 tempest-GroupSnapshotsTest-1020571071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4803eac-284f-4708-b511-c6d61397a1b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:31:59 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0c8c7b20-24ba-4e50-a32f-56ff49ff6633 tempest-GroupSnapshotsTest-1020571071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4803eac-284f-4708-b511-c6d61397a1b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94effae8-1ce7-455f-a4eb-cd3052cb07b9', 'volume_name': 'volume-94effae8-1ce7-455f-a4eb-cd3052cb07b9', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:31:59 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0c8c7b20-24ba-4e50-a32f-56ff49ff6633 tempest-GroupSnapshotsTest-1020571071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca866de6-5564-4fcf-8e39-df62fddc01f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:31:59 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0c8c7b20-24ba-4e50-a32f-56ff49ff6633 tempest-GroupSnapshotsTest-1020571071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca866de6-5564-4fcf-8e39-df62fddc01f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:31:59 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0c8c7b20-24ba-4e50-a32f-56ff49ff6633 tempest-GroupSnapshotsTest-1020571071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fd64ef3-31df-445d-9913-e4f9149d98fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:31:59 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-0c8c7b20-24ba-4e50-a32f-56ff49ff6633 tempest-GroupSnapshotsTest-1020571071 None] Volume 94effae8-1ce7-455f-a4eb-cd3052cb07b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94effae8-1ce7-455f-a4eb-cd3052cb07b9', 'volume_size': 1}
Jul 09 14:31:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0c8c7b20-24ba-4e50-a32f-56ff49ff6633 tempest-GroupSnapshotsTest-1020571071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:31:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0c8c7b20-24ba-4e50-a32f-56ff49ff6633 tempest-GroupSnapshotsTest-1020571071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:31:59 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-0c8c7b20-24ba-4e50-a32f-56ff49ff6633 tempest-GroupSnapshotsTest-1020571071 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=78459869-f075-4ffe-a0c7-f621cc035f69,created_at=2026-07-09T12:31:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2113856146',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=78459869-f075-4ffe-a0c7-f621cc035f69,host='devstack@QuobyteHD#QuobyteHD',id=94effae8-1ce7-455f-a4eb-cd3052cb07b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='531740d4ee6f4b94a699d04a7eddb233',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:32:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:32:00Z,use_quota=True,user_id='6438d0684a2f482489697f50bffe8f8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38934564-e7ff-4caa-8e0b-597eefb41772),volume_type_id=38934564-e7ff-4caa-8e0b-597eefb41772)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:31:59 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-0c8c7b20-24ba-4e50-a32f-56ff49ff6633 tempest-GroupSnapshotsTest-1020571071 None] Creating volume 94effae8-1ce7-455f-a4eb-cd3052cb07b9 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:31:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0c8c7b20-24ba-4e50-a32f-56ff49ff6633 tempest-GroupSnapshotsTest-1020571071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:31:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0c8c7b20-24ba-4e50-a32f-56ff49ff6633 tempest-GroupSnapshotsTest-1020571071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:31:59 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-0c8c7b20-24ba-4e50-a32f-56ff49ff6633 tempest-GroupSnapshotsTest-1020571071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:31:59 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-0c8c7b20-24ba-4e50-a32f-56ff49ff6633 tempest-GroupSnapshotsTest-1020571071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:31:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0c8c7b20-24ba-4e50-a32f-56ff49ff6633 tempest-GroupSnapshotsTest-1020571071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:31:59 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-0c8c7b20-24ba-4e50-a32f-56ff49ff6633 tempest-GroupSnapshotsTest-1020571071 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:31:59 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-0c8c7b20-24ba-4e50-a32f-56ff49ff6633 tempest-GroupSnapshotsTest-1020571071 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:31:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0c8c7b20-24ba-4e50-a32f-56ff49ff6633 tempest-GroupSnapshotsTest-1020571071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-94effae8-1ce7-455f-a4eb-cd3052cb07b9 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:32:00 devstack sudo[89276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-94effae8-1ce7-455f-a4eb-cd3052cb07b9 1073741824
Jul 09 14:32:00 devstack sudo[89276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:32:01 devstack sudo[89276]: pam_unix(sudo:session): session closed for user root
Jul 09 14:32:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0c8c7b20-24ba-4e50-a32f-56ff49ff6633 tempest-GroupSnapshotsTest-1020571071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-94effae8-1ce7-455f-a4eb-cd3052cb07b9 1073741824" returned: 0 in 1.327s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:32:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0c8c7b20-24ba-4e50-a32f-56ff49ff6633 tempest-GroupSnapshotsTest-1020571071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-94effae8-1ce7-455f-a4eb-cd3052cb07b9 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:32:01 devstack sudo[89299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-94effae8-1ce7-455f-a4eb-cd3052cb07b9
Jul 09 14:32:01 devstack sudo[89299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:32:02 devstack sudo[89299]: pam_unix(sudo:session): session closed for user root
Jul 09 14:32:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0c8c7b20-24ba-4e50-a32f-56ff49ff6633 tempest-GroupSnapshotsTest-1020571071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-94effae8-1ce7-455f-a4eb-cd3052cb07b9" returned: 0 in 0.683s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:32:02 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-0c8c7b20-24ba-4e50-a32f-56ff49ff6633 tempest-GroupSnapshotsTest-1020571071 None] <== create_volume: return (2072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:32:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0c8c7b20-24ba-4e50-a32f-56ff49ff6633 tempest-GroupSnapshotsTest-1020571071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.075s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:32:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0c8c7b20-24ba-4e50-a32f-56ff49ff6633 tempest-GroupSnapshotsTest-1020571071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fd64ef3-31df-445d-9913-e4f9149d98fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94effae8-1ce7-455f-a4eb-cd3052cb07b9', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:32:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0c8c7b20-24ba-4e50-a32f-56ff49ff6633 tempest-GroupSnapshotsTest-1020571071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2bfcf46-07db-4cc8-9b4c-68a0294ec526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:32:02 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-0c8c7b20-24ba-4e50-a32f-56ff49ff6633 tempest-GroupSnapshotsTest-1020571071 None] Volume volume-94effae8-1ce7-455f-a4eb-cd3052cb07b9 (94effae8-1ce7-455f-a4eb-cd3052cb07b9): created successfully
Jul 09 14:32:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0c8c7b20-24ba-4e50-a32f-56ff49ff6633 tempest-GroupSnapshotsTest-1020571071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2bfcf46-07db-4cc8-9b4c-68a0294ec526) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:32:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0c8c7b20-24ba-4e50-a32f-56ff49ff6633 tempest-GroupSnapshotsTest-1020571071 None] Flow 'volume_create_manager' (e662c061-8616-4c1b-be9c-f67196d02427) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:32:02 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-0c8c7b20-24ba-4e50-a32f-56ff49ff6633 tempest-GroupSnapshotsTest-1020571071 None] Created volume successfully.
Jul 09 14:32:03 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-2a6e2c35-621c-4126-b844-26e2cbcd09e6 tempest-GroupSnapshotsTest-1020571071 None] GroupSnapshot a4191150-714a-4b57-9780-94c742b379ba: creating.
Jul 09 14:32:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2a6e2c35-621c-4126-b844-26e2cbcd09e6 tempest-GroupSnapshotsTest-1020571071 None] Group snapshot a4191150-714a-4b57-9780-94c742b379ba: creating. {{(pid=87230) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jul 09 14:32:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-2a6e2c35-621c-4126-b844-26e2cbcd09e6 tempest-GroupSnapshotsTest-1020571071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:32:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-2a6e2c35-621c-4126-b844-26e2cbcd09e6 tempest-GroupSnapshotsTest-1020571071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:32:03 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-2a6e2c35-621c-4126-b844-26e2cbcd09e6 tempest-GroupSnapshotsTest-1020571071 None] Creating offline snapshot 015629f5-a8a3-43de-8f80-36fbb71de4bc of volume 94effae8-1ce7-455f-a4eb-cd3052cb07b9 {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 14:32:03 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[9720494a-6f1b-4174-adbd-436accbbd8ef]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:32:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2a6e2c35-621c-4126-b844-26e2cbcd09e6 tempest-GroupSnapshotsTest-1020571071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-94effae8-1ce7-455f-a4eb-cd3052cb07b9 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:32:03 devstack sudo[89304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-94effae8-1ce7-455f-a4eb-cd3052cb07b9
Jul 09 14:32:03 devstack sudo[89304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:32:04 devstack sudo[89304]: pam_unix(sudo:session): session closed for user root
Jul 09 14:32:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2a6e2c35-621c-4126-b844-26e2cbcd09e6 tempest-GroupSnapshotsTest-1020571071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-94effae8-1ce7-455f-a4eb-cd3052cb07b9" returned: 0 in 0.971s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:32:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2a6e2c35-621c-4126-b844-26e2cbcd09e6 tempest-GroupSnapshotsTest-1020571071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-94effae8-1ce7-455f-a4eb-cd3052cb07b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-94effae8-1ce7-455f-a4eb-cd3052cb07b9.015629f5-a8a3-43de-8f80-36fbb71de4bc 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:32:04 devstack sudo[89311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-94effae8-1ce7-455f-a4eb-cd3052cb07b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-94effae8-1ce7-455f-a4eb-cd3052cb07b9.015629f5-a8a3-43de-8f80-36fbb71de4bc 1G
Jul 09 14:32:04 devstack sudo[89311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:32:05 devstack sudo[89311]: pam_unix(sudo:session): session closed for user root
Jul 09 14:32:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2a6e2c35-621c-4126-b844-26e2cbcd09e6 tempest-GroupSnapshotsTest-1020571071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-94effae8-1ce7-455f-a4eb-cd3052cb07b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-94effae8-1ce7-455f-a4eb-cd3052cb07b9.015629f5-a8a3-43de-8f80-36fbb71de4bc 1G" returned: 0 in 1.203s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:32:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2a6e2c35-621c-4126-b844-26e2cbcd09e6 tempest-GroupSnapshotsTest-1020571071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94effae8-1ce7-455f-a4eb-cd3052cb07b9 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-94effae8-1ce7-455f-a4eb-cd3052cb07b9.015629f5-a8a3-43de-8f80-36fbb71de4bc {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:32:05 devstack sudo[89319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94effae8-1ce7-455f-a4eb-cd3052cb07b9 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-94effae8-1ce7-455f-a4eb-cd3052cb07b9.015629f5-a8a3-43de-8f80-36fbb71de4bc
Jul 09 14:32:05 devstack sudo[89319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:32:06 devstack sudo[89319]: pam_unix(sudo:session): session closed for user root
Jul 09 14:32:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2a6e2c35-621c-4126-b844-26e2cbcd09e6 tempest-GroupSnapshotsTest-1020571071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94effae8-1ce7-455f-a4eb-cd3052cb07b9 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-94effae8-1ce7-455f-a4eb-cd3052cb07b9.015629f5-a8a3-43de-8f80-36fbb71de4bc" returned: 0 in 0.888s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:32:06 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-2a6e2c35-621c-4126-b844-26e2cbcd09e6 tempest-GroupSnapshotsTest-1020571071 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-94effae8-1ce7-455f-a4eb-cd3052cb07b9.015629f5-a8a3-43de-8f80-36fbb71de4bc is being set with open permissions: ugo+rw: NotImplementedError
Jul 09 14:32:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2a6e2c35-621c-4126-b844-26e2cbcd09e6 tempest-GroupSnapshotsTest-1020571071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-94effae8-1ce7-455f-a4eb-cd3052cb07b9.015629f5-a8a3-43de-8f80-36fbb71de4bc {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:32:06 devstack sudo[89326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-94effae8-1ce7-455f-a4eb-cd3052cb07b9.015629f5-a8a3-43de-8f80-36fbb71de4bc
Jul 09 14:32:06 devstack sudo[89326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:32:07 devstack sudo[89326]: pam_unix(sudo:session): session closed for user root
Jul 09 14:32:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2a6e2c35-621c-4126-b844-26e2cbcd09e6 tempest-GroupSnapshotsTest-1020571071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-94effae8-1ce7-455f-a4eb-cd3052cb07b9.015629f5-a8a3-43de-8f80-36fbb71de4bc" returned: 0 in 0.755s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:32:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2a6e2c35-621c-4126-b844-26e2cbcd09e6 tempest-GroupSnapshotsTest-1020571071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-94effae8-1ce7-455f-a4eb-cd3052cb07b9.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:32:07 devstack sudo[89329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-94effae8-1ce7-455f-a4eb-cd3052cb07b9.info
Jul 09 14:32:07 devstack sudo[89329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:32:08 devstack sudo[89329]: pam_unix(sudo:session): session closed for user root
Jul 09 14:32:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2a6e2c35-621c-4126-b844-26e2cbcd09e6 tempest-GroupSnapshotsTest-1020571071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-94effae8-1ce7-455f-a4eb-cd3052cb07b9.info" returned: 0 in 0.826s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:32:08 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-2a6e2c35-621c-4126-b844-26e2cbcd09e6 tempest-GroupSnapshotsTest-1020571071 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-94effae8-1ce7-455f-a4eb-cd3052cb07b9.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 09 14:32:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2a6e2c35-621c-4126-b844-26e2cbcd09e6 tempest-GroupSnapshotsTest-1020571071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-94effae8-1ce7-455f-a4eb-cd3052cb07b9.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:32:08 devstack sudo[89332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-94effae8-1ce7-455f-a4eb-cd3052cb07b9.info
Jul 09 14:32:08 devstack sudo[89332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:32:08 devstack sudo[89332]: pam_unix(sudo:session): session closed for user root
Jul 09 14:32:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2a6e2c35-621c-4126-b844-26e2cbcd09e6 tempest-GroupSnapshotsTest-1020571071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-94effae8-1ce7-455f-a4eb-cd3052cb07b9.info" returned: 0 in 0.743s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:32:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-2a6e2c35-621c-4126-b844-26e2cbcd09e6 tempest-GroupSnapshotsTest-1020571071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.512s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:32:09 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-2a6e2c35-621c-4126-b844-26e2cbcd09e6 tempest-GroupSnapshotsTest-1020571071 None] group_snapshot a4191150-714a-4b57-9780-94c742b379ba: created successfully
Jul 09 14:32:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-22c8e5a6-17f4-44ea-b75f-f2f7bc8e6f3e tempest-GroupSnapshotsTest-1020571071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:32:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-22c8e5a6-17f4-44ea-b75f-f2f7bc8e6f3e tempest-GroupSnapshotsTest-1020571071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:32:11 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-22c8e5a6-17f4-44ea-b75f-f2f7bc8e6f3e tempest-GroupSnapshotsTest-1020571071 None] Acquiring lock "cinder-quobyte-015629f5-a8a3-43de-8f80-36fbb71de4bc-bbb4c920-d2eb-4cb9-8a5d-231a64379bc7" by "_create_volume_from_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:32:11 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-22c8e5a6-17f4-44ea-b75f-f2f7bc8e6f3e tempest-GroupSnapshotsTest-1020571071 None] Lock "cinder-quobyte-015629f5-a8a3-43de-8f80-36fbb71de4bc-bbb4c920-d2eb-4cb9-8a5d-231a64379bc7" acquired by "_create_volume_from_snapshot" :: waited 0.039s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:32:11 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-22c8e5a6-17f4-44ea-b75f-f2f7bc8e6f3e tempest-GroupSnapshotsTest-1020571071 None] Creating volume bbb4c920-d2eb-4cb9-8a5d-231a64379bc7 from snapshot 015629f5-a8a3-43de-8f80-36fbb71de4bc {{(pid=87230) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 09 14:32:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-22c8e5a6-17f4-44ea-b75f-f2f7bc8e6f3e tempest-GroupSnapshotsTest-1020571071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:32:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-22c8e5a6-17f4-44ea-b75f-f2f7bc8e6f3e tempest-GroupSnapshotsTest-1020571071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:32:11 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-22c8e5a6-17f4-44ea-b75f-f2f7bc8e6f3e tempest-GroupSnapshotsTest-1020571071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:32:11 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-22c8e5a6-17f4-44ea-b75f-f2f7bc8e6f3e tempest-GroupSnapshotsTest-1020571071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:32:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-22c8e5a6-17f4-44ea-b75f-f2f7bc8e6f3e tempest-GroupSnapshotsTest-1020571071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:32:11 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-22c8e5a6-17f4-44ea-b75f-f2f7bc8e6f3e tempest-GroupSnapshotsTest-1020571071 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:32:11 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-22c8e5a6-17f4-44ea-b75f-f2f7bc8e6f3e tempest-GroupSnapshotsTest-1020571071 None] Acquiring lock "cinder-quobyte-bbb4c920-d2eb-4cb9-8a5d-231a64379bc7" by "_copy_volume_from_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:32:11 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-22c8e5a6-17f4-44ea-b75f-f2f7bc8e6f3e tempest-GroupSnapshotsTest-1020571071 None] Lock "cinder-quobyte-bbb4c920-d2eb-4cb9-8a5d-231a64379bc7" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:32:11 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-22c8e5a6-17f4-44ea-b75f-f2f7bc8e6f3e tempest-GroupSnapshotsTest-1020571071 None] snapshot: 015629f5-a8a3-43de-8f80-36fbb71de4bc, volume: bbb4c920-d2eb-4cb9-8a5d-231a64379bc7,  {{(pid=87230) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 09 14:32:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-22c8e5a6-17f4-44ea-b75f-f2f7bc8e6f3e tempest-GroupSnapshotsTest-1020571071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:32:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-22c8e5a6-17f4-44ea-b75f-f2f7bc8e6f3e tempest-GroupSnapshotsTest-1020571071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:32:11 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-22c8e5a6-17f4-44ea-b75f-f2f7bc8e6f3e tempest-GroupSnapshotsTest-1020571071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:32:11 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-22c8e5a6-17f4-44ea-b75f-f2f7bc8e6f3e tempest-GroupSnapshotsTest-1020571071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:32:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-22c8e5a6-17f4-44ea-b75f-f2f7bc8e6f3e tempest-GroupSnapshotsTest-1020571071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:32:11 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[d825f597-8130-4a33-8c94-bdb88476dc70]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:32:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-22c8e5a6-17f4-44ea-b75f-f2f7bc8e6f3e tempest-GroupSnapshotsTest-1020571071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-94effae8-1ce7-455f-a4eb-cd3052cb07b9.015629f5-a8a3-43de-8f80-36fbb71de4bc {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:32:11 devstack sudo[89339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-94effae8-1ce7-455f-a4eb-cd3052cb07b9.015629f5-a8a3-43de-8f80-36fbb71de4bc
Jul 09 14:32:11 devstack sudo[89339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:32:12 devstack sudo[89339]: pam_unix(sudo:session): session closed for user root
Jul 09 14:32:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-22c8e5a6-17f4-44ea-b75f-f2f7bc8e6f3e tempest-GroupSnapshotsTest-1020571071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-94effae8-1ce7-455f-a4eb-cd3052cb07b9.015629f5-a8a3-43de-8f80-36fbb71de4bc" returned: 0 in 0.866s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:32:12 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-22c8e5a6-17f4-44ea-b75f-f2f7bc8e6f3e tempest-GroupSnapshotsTest-1020571071 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94effae8-1ce7-455f-a4eb-cd3052cb07b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 14:32:12 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-22c8e5a6-17f4-44ea-b75f-f2f7bc8e6f3e tempest-GroupSnapshotsTest-1020571071 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-94effae8-1ce7-455f-a4eb-cd3052cb07b9 {{(pid=87230) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 09 14:32:12 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-22c8e5a6-17f4-44ea-b75f-f2f7bc8e6f3e tempest-GroupSnapshotsTest-1020571071 None] Creating direct copy from snapshot {{(pid=87230) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 09 14:32:12 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a1b4b9-2ca5-49aa-8189-0057ff22a7f4]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:32:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-22c8e5a6-17f4-44ea-b75f-f2f7bc8e6f3e tempest-GroupSnapshotsTest-1020571071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-94effae8-1ce7-455f-a4eb-cd3052cb07b9 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:32:12 devstack sudo[89344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-94effae8-1ce7-455f-a4eb-cd3052cb07b9
Jul 09 14:32:12 devstack sudo[89344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:32:13 devstack sudo[89344]: pam_unix(sudo:session): session closed for user root
Jul 09 14:32:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-22c8e5a6-17f4-44ea-b75f-f2f7bc8e6f3e tempest-GroupSnapshotsTest-1020571071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-94effae8-1ce7-455f-a4eb-cd3052cb07b9" returned: 0 in 1.063s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:32:13 devstack cinder-volume[87230]: DEBUG cinder.utils [None req-22c8e5a6-17f4-44ea-b75f-f2f7bc8e6f3e tempest-GroupSnapshotsTest-1020571071 None] Path /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bbb4c920-d2eb-4cb9-8a5d-231a64379bc7 not found in is_blk_device check {{(pid=87230) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 09 14:32:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-22c8e5a6-17f4-44ea-b75f-f2f7bc8e6f3e tempest-GroupSnapshotsTest-1020571071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-94effae8-1ce7-455f-a4eb-cd3052cb07b9 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bbb4c920-d2eb-4cb9-8a5d-231a64379bc7 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:32:13 devstack sudo[89349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-94effae8-1ce7-455f-a4eb-cd3052cb07b9 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bbb4c920-d2eb-4cb9-8a5d-231a64379bc7
Jul 09 14:32:13 devstack sudo[89349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:32:18 devstack sudo[89349]: pam_unix(sudo:session): session closed for user root
Jul 09 14:32:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-22c8e5a6-17f4-44ea-b75f-f2f7bc8e6f3e tempest-GroupSnapshotsTest-1020571071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-94effae8-1ce7-455f-a4eb-cd3052cb07b9 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bbb4c920-d2eb-4cb9-8a5d-231a64379bc7" returned: 0 in 4.795s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:32:18 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f67c310-6a6e-4aac-975d-12597b4a4487]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:32:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-22c8e5a6-17f4-44ea-b75f-f2f7bc8e6f3e tempest-GroupSnapshotsTest-1020571071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-94effae8-1ce7-455f-a4eb-cd3052cb07b9 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:32:18 devstack sudo[89387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-94effae8-1ce7-455f-a4eb-cd3052cb07b9
Jul 09 14:32:18 devstack sudo[89387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:32:19 devstack sudo[89387]: pam_unix(sudo:session): session closed for user root
Jul 09 14:32:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-22c8e5a6-17f4-44ea-b75f-f2f7bc8e6f3e tempest-GroupSnapshotsTest-1020571071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-94effae8-1ce7-455f-a4eb-cd3052cb07b9" returned: 0 in 0.991s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:32:19 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-22c8e5a6-17f4-44ea-b75f-f2f7bc8e6f3e tempest-GroupSnapshotsTest-1020571071 None] Image conversion details: src /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-94effae8-1ce7-455f-a4eb-cd3052cb07b9, size 1024.00 MB, duration 4.80 sec, destination /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bbb4c920-d2eb-4cb9-8a5d-231a64379bc7 {{(pid=87230) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 09 14:32:19 devstack cinder-volume[87230]: INFO cinder.image.image_utils [None req-22c8e5a6-17f4-44ea-b75f-f2f7bc8e6f3e tempest-GroupSnapshotsTest-1020571071 None] Converted 1024.00 MB image at 213.50 MB/s
Jul 09 14:32:19 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-22c8e5a6-17f4-44ea-b75f-f2f7bc8e6f3e tempest-GroupSnapshotsTest-1020571071 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bbb4c920-d2eb-4cb9-8a5d-231a64379bc7 is being set with open permissions: ugo+rw: NotImplementedError
Jul 09 14:32:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-22c8e5a6-17f4-44ea-b75f-f2f7bc8e6f3e tempest-GroupSnapshotsTest-1020571071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bbb4c920-d2eb-4cb9-8a5d-231a64379bc7 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:32:19 devstack sudo[89393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bbb4c920-d2eb-4cb9-8a5d-231a64379bc7
Jul 09 14:32:19 devstack sudo[89393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:32:19 devstack sudo[89393]: pam_unix(sudo:session): session closed for user root
Jul 09 14:32:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-22c8e5a6-17f4-44ea-b75f-f2f7bc8e6f3e tempest-GroupSnapshotsTest-1020571071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bbb4c920-d2eb-4cb9-8a5d-231a64379bc7" returned: 0 in 0.703s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:32:19 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-22c8e5a6-17f4-44ea-b75f-f2f7bc8e6f3e tempest-GroupSnapshotsTest-1020571071 None] Lock "cinder-quobyte-bbb4c920-d2eb-4cb9-8a5d-231a64379bc7" released by "_copy_volume_from_snapshot" :: held 8.556s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:32:19 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-22c8e5a6-17f4-44ea-b75f-f2f7bc8e6f3e tempest-GroupSnapshotsTest-1020571071 None] Lock "cinder-quobyte-015629f5-a8a3-43de-8f80-36fbb71de4bc-bbb4c920-d2eb-4cb9-8a5d-231a64379bc7" released by "_create_volume_from_snapshot" :: held 8.610s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:32:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-22c8e5a6-17f4-44ea-b75f-f2f7bc8e6f3e tempest-GroupSnapshotsTest-1020571071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.650s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:32:19 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-22c8e5a6-17f4-44ea-b75f-f2f7bc8e6f3e tempest-GroupSnapshotsTest-1020571071 None] Create group from source-snapshot-a4191150-714a-4b57-9780-94c742b379ba completed successfully.
Jul 09 14:32:20 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-07899340-a8a5-4c2a-b430-9b9aa16794c5 tempest-GroupSnapshotsTest-1020571071 None] Acquiring lock "cinder-quobyte-bbb4c920-d2eb-4cb9-8a5d-231a64379bc7" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:32:20 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-07899340-a8a5-4c2a-b430-9b9aa16794c5 tempest-GroupSnapshotsTest-1020571071 None] Lock "cinder-quobyte-bbb4c920-d2eb-4cb9-8a5d-231a64379bc7" acquired by "delete_volume" :: waited 0.018s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:32:20 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[624ed9cc-b228-4e27-92df-b4d4d3095503]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:32:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-07899340-a8a5-4c2a-b430-9b9aa16794c5 tempest-GroupSnapshotsTest-1020571071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bbb4c920-d2eb-4cb9-8a5d-231a64379bc7 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:32:21 devstack sudo[89397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bbb4c920-d2eb-4cb9-8a5d-231a64379bc7
Jul 09 14:32:21 devstack sudo[89397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:32:22 devstack sudo[89397]: pam_unix(sudo:session): session closed for user root
Jul 09 14:32:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-07899340-a8a5-4c2a-b430-9b9aa16794c5 tempest-GroupSnapshotsTest-1020571071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bbb4c920-d2eb-4cb9-8a5d-231a64379bc7" returned: 0 in 1.098s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:32:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-07899340-a8a5-4c2a-b430-9b9aa16794c5 tempest-GroupSnapshotsTest-1020571071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bbb4c920-d2eb-4cb9-8a5d-231a64379bc7 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:32:22 devstack sudo[89404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bbb4c920-d2eb-4cb9-8a5d-231a64379bc7
Jul 09 14:32:22 devstack sudo[89404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:32:22 devstack sudo[89404]: pam_unix(sudo:session): session closed for user root
Jul 09 14:32:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-07899340-a8a5-4c2a-b430-9b9aa16794c5 tempest-GroupSnapshotsTest-1020571071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bbb4c920-d2eb-4cb9-8a5d-231a64379bc7" returned: 0 in 0.776s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:32:22 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-07899340-a8a5-4c2a-b430-9b9aa16794c5 tempest-GroupSnapshotsTest-1020571071 None] Lock "cinder-quobyte-bbb4c920-d2eb-4cb9-8a5d-231a64379bc7" released by "delete_volume" :: held 1.957s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:32:22 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-07899340-a8a5-4c2a-b430-9b9aa16794c5 tempest-GroupSnapshotsTest-1020571071 None] Created reservations ['8c73c14b-b317-4a73-9279-dc144683aad9'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:32:22 devstack cinder-volume[87230]: WARNING cinder.quota [None req-07899340-a8a5-4c2a-b430-9b9aa16794c5 tempest-GroupSnapshotsTest-1020571071 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-66360521 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-66360521, it is now deprecated. Please use the default quota class for default quota.
Jul 09 14:32:22 devstack cinder-volume[87230]: WARNING cinder.quota [None req-07899340-a8a5-4c2a-b430-9b9aa16794c5 tempest-GroupSnapshotsTest-1020571071 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-66360521 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-66360521, it is now deprecated. Please use the default quota class for default quota.
Jul 09 14:32:22 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-07899340-a8a5-4c2a-b430-9b9aa16794c5 tempest-GroupSnapshotsTest-1020571071 None] Created reservations ['f09207a6-20e2-4d44-8c30-f97a7e97954a', '7e068f29-9292-4673-82e2-027d0e037b09', '91e8980e-eb4f-4aa8-8097-569c4185752a', 'a7151480-c189-4879-9589-c2245aac160b'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:32:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-07899340-a8a5-4c2a-b430-9b9aa16794c5 tempest-GroupSnapshotsTest-1020571071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:32:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-07899340-a8a5-4c2a-b430-9b9aa16794c5 tempest-GroupSnapshotsTest-1020571071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:32:23 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-07899340-a8a5-4c2a-b430-9b9aa16794c5 tempest-GroupSnapshotsTest-1020571071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:32:23 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-07899340-a8a5-4c2a-b430-9b9aa16794c5 tempest-GroupSnapshotsTest-1020571071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:32:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-07899340-a8a5-4c2a-b430-9b9aa16794c5 tempest-GroupSnapshotsTest-1020571071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:32:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-07899340-a8a5-4c2a-b430-9b9aa16794c5 tempest-GroupSnapshotsTest-1020571071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:32:23 devstack sudo[89408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:32:23 devstack sudo[89408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:32:23 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-196b7c9c-b875-470d-86ef-84af1ea164f8 tempest-GroupSnapshotsTest-1020571071 None] group_snapshot a4191150-714a-4b57-9780-94c742b379ba: deleting
Jul 09 14:32:23 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-196b7c9c-b875-470d-86ef-84af1ea164f8 tempest-GroupSnapshotsTest-1020571071 None] group_snapshot a4191150-714a-4b57-9780-94c742b379ba: deleting {{(pid=87230) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jul 09 14:32:23 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-196b7c9c-b875-470d-86ef-84af1ea164f8 tempest-GroupSnapshotsTest-1020571071 None] Acquiring lock "cinder-quobyte-94effae8-1ce7-455f-a4eb-cd3052cb07b9" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:32:23 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-196b7c9c-b875-470d-86ef-84af1ea164f8 tempest-GroupSnapshotsTest-1020571071 None] Lock "cinder-quobyte-94effae8-1ce7-455f-a4eb-cd3052cb07b9" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:32:23 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-196b7c9c-b875-470d-86ef-84af1ea164f8 tempest-GroupSnapshotsTest-1020571071 None] Acquiring lock "cinder-quobyte-015629f5-a8a3-43de-8f80-36fbb71de4bc" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:32:23 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-196b7c9c-b875-470d-86ef-84af1ea164f8 tempest-GroupSnapshotsTest-1020571071 None] Lock "cinder-quobyte-015629f5-a8a3-43de-8f80-36fbb71de4bc" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:32:23 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-196b7c9c-b875-470d-86ef-84af1ea164f8 tempest-GroupSnapshotsTest-1020571071 None] Deleting offline snapshot 015629f5-a8a3-43de-8f80-36fbb71de4bc of volume 94effae8-1ce7-455f-a4eb-cd3052cb07b9 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 14:32:23 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-196b7c9c-b875-470d-86ef-84af1ea164f8 tempest-GroupSnapshotsTest-1020571071 None] snapshot_file for this snap is: volume-94effae8-1ce7-455f-a4eb-cd3052cb07b9.015629f5-a8a3-43de-8f80-36fbb71de4bc {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 14:32:23 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[13eca13b-fb87-483a-ba84-c4d2f2a847cf]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:32:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-196b7c9c-b875-470d-86ef-84af1ea164f8 tempest-GroupSnapshotsTest-1020571071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-94effae8-1ce7-455f-a4eb-cd3052cb07b9.015629f5-a8a3-43de-8f80-36fbb71de4bc {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:32:24 devstack sudo[89410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-94effae8-1ce7-455f-a4eb-cd3052cb07b9.015629f5-a8a3-43de-8f80-36fbb71de4bc
Jul 09 14:32:24 devstack sudo[89410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:32:24 devstack sudo[89408]: pam_unix(sudo:session): session closed for user root
Jul 09 14:32:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-07899340-a8a5-4c2a-b430-9b9aa16794c5 tempest-GroupSnapshotsTest-1020571071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 1.190s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:32:24 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-07899340-a8a5-4c2a-b430-9b9aa16794c5 tempest-GroupSnapshotsTest-1020571071 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:32:24 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-07899340-a8a5-4c2a-b430-9b9aa16794c5 tempest-GroupSnapshotsTest-1020571071 None] Delete group completed successfully.
Jul 09 14:32:25 devstack sudo[89410]: pam_unix(sudo:session): session closed for user root
Jul 09 14:32:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-196b7c9c-b875-470d-86ef-84af1ea164f8 tempest-GroupSnapshotsTest-1020571071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-94effae8-1ce7-455f-a4eb-cd3052cb07b9.015629f5-a8a3-43de-8f80-36fbb71de4bc" returned: 0 in 1.062s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:32:25 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-196b7c9c-b875-470d-86ef-84af1ea164f8 tempest-GroupSnapshotsTest-1020571071 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94effae8-1ce7-455f-a4eb-cd3052cb07b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 14:32:25 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[da7c34dd-771b-4661-ac97-7e33de725b9a]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:32:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-196b7c9c-b875-470d-86ef-84af1ea164f8 tempest-GroupSnapshotsTest-1020571071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-94effae8-1ce7-455f-a4eb-cd3052cb07b9 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:32:25 devstack sudo[89416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-94effae8-1ce7-455f-a4eb-cd3052cb07b9
Jul 09 14:32:25 devstack sudo[89416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:32:26 devstack sudo[89416]: pam_unix(sudo:session): session closed for user root
Jul 09 14:32:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-196b7c9c-b875-470d-86ef-84af1ea164f8 tempest-GroupSnapshotsTest-1020571071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-94effae8-1ce7-455f-a4eb-cd3052cb07b9" returned: 0 in 1.181s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:32:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-196b7c9c-b875-470d-86ef-84af1ea164f8 tempest-GroupSnapshotsTest-1020571071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-94effae8-1ce7-455f-a4eb-cd3052cb07b9.015629f5-a8a3-43de-8f80-36fbb71de4bc {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:32:26 devstack sudo[89423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-94effae8-1ce7-455f-a4eb-cd3052cb07b9.015629f5-a8a3-43de-8f80-36fbb71de4bc
Jul 09 14:32:26 devstack sudo[89423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:32:27 devstack sudo[89423]: pam_unix(sudo:session): session closed for user root
Jul 09 14:32:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-196b7c9c-b875-470d-86ef-84af1ea164f8 tempest-GroupSnapshotsTest-1020571071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-94effae8-1ce7-455f-a4eb-cd3052cb07b9.015629f5-a8a3-43de-8f80-36fbb71de4bc" returned: 0 in 1.112s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:32:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-196b7c9c-b875-470d-86ef-84af1ea164f8 tempest-GroupSnapshotsTest-1020571071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-94effae8-1ce7-455f-a4eb-cd3052cb07b9.015629f5-a8a3-43de-8f80-36fbb71de4bc {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:32:27 devstack sudo[89432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-94effae8-1ce7-455f-a4eb-cd3052cb07b9.015629f5-a8a3-43de-8f80-36fbb71de4bc
Jul 09 14:32:27 devstack sudo[89432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:32:28 devstack sudo[89432]: pam_unix(sudo:session): session closed for user root
Jul 09 14:32:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-196b7c9c-b875-470d-86ef-84af1ea164f8 tempest-GroupSnapshotsTest-1020571071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-94effae8-1ce7-455f-a4eb-cd3052cb07b9.015629f5-a8a3-43de-8f80-36fbb71de4bc" returned: 0 in 0.928s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:32:28 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-196b7c9c-b875-470d-86ef-84af1ea164f8 tempest-GroupSnapshotsTest-1020571071 None] Lock "cinder-quobyte-015629f5-a8a3-43de-8f80-36fbb71de4bc" released by "_delete_snapshot" :: held 4.512s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:32:28 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-196b7c9c-b875-470d-86ef-84af1ea164f8 tempest-GroupSnapshotsTest-1020571071 None] Lock "cinder-quobyte-94effae8-1ce7-455f-a4eb-cd3052cb07b9" released by "delete_snapshot" :: held 4.552s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:32:28 devstack cinder-volume[87230]: WARNING cinder.quota [None req-196b7c9c-b875-470d-86ef-84af1ea164f8 tempest-GroupSnapshotsTest-1020571071 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-66360521 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-66360521, it is now deprecated. Please use the default quota class for default quota.
Jul 09 14:32:28 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-196b7c9c-b875-470d-86ef-84af1ea164f8 tempest-GroupSnapshotsTest-1020571071 None] Created reservations ['67ea05e8-1649-4fac-a7b9-f6523e64738c', 'e1c726f7-7454-4407-a50b-0e43004cca4c', '90ea7bce-c154-46e1-831f-c6904d841e3f', '29a20979-907d-49b0-9e6c-d361580017d9'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:32:28 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-196b7c9c-b875-470d-86ef-84af1ea164f8 tempest-GroupSnapshotsTest-1020571071 None] group_snapshot a4191150-714a-4b57-9780-94c742b379ba: deleted successfully
Jul 09 14:32:29 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a507f49a-feb3-409f-b027-2d0f75a8f658 tempest-GroupSnapshotsTest-1020571071 None] Acquiring lock "cinder-quobyte-94effae8-1ce7-455f-a4eb-cd3052cb07b9" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:32:29 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a507f49a-feb3-409f-b027-2d0f75a8f658 tempest-GroupSnapshotsTest-1020571071 None] Lock "cinder-quobyte-94effae8-1ce7-455f-a4eb-cd3052cb07b9" acquired by "delete_volume" :: waited 0.020s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:32:29 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f4eb10-b21d-4148-98d5-d35ae8b0711e]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:32:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a507f49a-feb3-409f-b027-2d0f75a8f658 tempest-GroupSnapshotsTest-1020571071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-94effae8-1ce7-455f-a4eb-cd3052cb07b9 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:32:30 devstack sudo[89438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-94effae8-1ce7-455f-a4eb-cd3052cb07b9
Jul 09 14:32:30 devstack sudo[89438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:32:30 devstack sudo[89438]: pam_unix(sudo:session): session closed for user root
Jul 09 14:32:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a507f49a-feb3-409f-b027-2d0f75a8f658 tempest-GroupSnapshotsTest-1020571071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-94effae8-1ce7-455f-a4eb-cd3052cb07b9" returned: 0 in 0.928s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:32:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a507f49a-feb3-409f-b027-2d0f75a8f658 tempest-GroupSnapshotsTest-1020571071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-94effae8-1ce7-455f-a4eb-cd3052cb07b9 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:32:30 devstack sudo[89443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-94effae8-1ce7-455f-a4eb-cd3052cb07b9
Jul 09 14:32:30 devstack sudo[89443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:32:31 devstack sudo[89443]: pam_unix(sudo:session): session closed for user root
Jul 09 14:32:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a507f49a-feb3-409f-b027-2d0f75a8f658 tempest-GroupSnapshotsTest-1020571071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-94effae8-1ce7-455f-a4eb-cd3052cb07b9" returned: 0 in 0.711s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:32:31 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a507f49a-feb3-409f-b027-2d0f75a8f658 tempest-GroupSnapshotsTest-1020571071 None] Lock "cinder-quobyte-94effae8-1ce7-455f-a4eb-cd3052cb07b9" released by "delete_volume" :: held 1.713s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:32:31 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-a507f49a-feb3-409f-b027-2d0f75a8f658 tempest-GroupSnapshotsTest-1020571071 None] Created reservations ['6fec3045-b885-4594-aacf-e61af6af21af'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:32:31 devstack cinder-volume[87230]: WARNING cinder.db.api [None req-a507f49a-feb3-409f-b027-2d0f75a8f658 tempest-GroupSnapshotsTest-1020571071 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-66360521']
Jul 09 14:32:31 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-a507f49a-feb3-409f-b027-2d0f75a8f658 tempest-GroupSnapshotsTest-1020571071 None] Created reservations ['63b7c78b-7361-48f2-ae02-b84ab8609077', 'b3623405-7ceb-48c7-be58-11530b776040', '9458f4e4-4d7f-418f-9907-514d8c11a1cf', 'a76d99ad-c6a9-4f69-9e90-1cf94f82c183'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:32:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a507f49a-feb3-409f-b027-2d0f75a8f658 tempest-GroupSnapshotsTest-1020571071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:32:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a507f49a-feb3-409f-b027-2d0f75a8f658 tempest-GroupSnapshotsTest-1020571071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:32:31 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a507f49a-feb3-409f-b027-2d0f75a8f658 tempest-GroupSnapshotsTest-1020571071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:32:31 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a507f49a-feb3-409f-b027-2d0f75a8f658 tempest-GroupSnapshotsTest-1020571071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:32:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a507f49a-feb3-409f-b027-2d0f75a8f658 tempest-GroupSnapshotsTest-1020571071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:32:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a507f49a-feb3-409f-b027-2d0f75a8f658 tempest-GroupSnapshotsTest-1020571071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:32:31 devstack sudo[89447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:32:31 devstack sudo[89447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:32:32 devstack sudo[89447]: pam_unix(sudo:session): session closed for user root
Jul 09 14:32:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a507f49a-feb3-409f-b027-2d0f75a8f658 tempest-GroupSnapshotsTest-1020571071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.740s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:32:32 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-a507f49a-feb3-409f-b027-2d0f75a8f658 tempest-GroupSnapshotsTest-1020571071 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:32:32 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-a507f49a-feb3-409f-b027-2d0f75a8f658 tempest-GroupSnapshotsTest-1020571071 None] Delete group completed successfully.
Jul 09 14:32:32 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-a12d0077-ea7e-4b26-8a2a-5b6bee7bf83a tempest-GroupSnapshotsTest-1020571071 None] Group tempest-GroupSnapshotsTest-Group-744335874: creating
Jul 09 14:32:32 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-a12d0077-ea7e-4b26-8a2a-5b6bee7bf83a tempest-GroupSnapshotsTest-1020571071 None] Group tempest-GroupSnapshotsTest-Group-744335874: created successfully
Jul 09 14:32:32 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-a12d0077-ea7e-4b26-8a2a-5b6bee7bf83a tempest-GroupSnapshotsTest-1020571071 None] Create group completed successfully.
Jul 09 14:32:34 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-9df4763c-8c73-4617-b6d6-f7573d9d840c tempest-GroupSnapshotsTest-1020571071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:32:34 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9df4763c-8c73-4617-b6d6-f7573d9d840c tempest-GroupSnapshotsTest-1020571071 None] Flow 'volume_create_manager' (0825de65-9c70-4e84-86f3-dbe0a6889d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:32:34 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9df4763c-8c73-4617-b6d6-f7573d9d840c tempest-GroupSnapshotsTest-1020571071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e5b5bad-2531-4878-bf8d-24d6ff4cd401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:32:34 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9df4763c-8c73-4617-b6d6-f7573d9d840c tempest-GroupSnapshotsTest-1020571071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e5b5bad-2531-4878-bf8d-24d6ff4cd401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:32:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1158578544',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=415c9ac1-046d-4424-885e-591404a7d739,host='devstack@QuobyteHD#QuobyteHD',id=8c825fd2-5429-4470-89a0-2d997620573c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='531740d4ee6f4b94a699d04a7eddb233',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:32:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:32:35Z,use_quota=True,user_id='6438d0684a2f482489697f50bffe8f8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7880a37e-e9d9-4f23-95a3-3334b22d550b),volume_type_id=7880a37e-e9d9-4f23-95a3-3334b22d550b)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:32:34 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9df4763c-8c73-4617-b6d6-f7573d9d840c tempest-GroupSnapshotsTest-1020571071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ad7a8b5-c7ce-4207-8666-a60bf35c53be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:32:34 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9df4763c-8c73-4617-b6d6-f7573d9d840c tempest-GroupSnapshotsTest-1020571071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ad7a8b5-c7ce-4207-8666-a60bf35c53be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:32:34 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9df4763c-8c73-4617-b6d6-f7573d9d840c tempest-GroupSnapshotsTest-1020571071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c5f7646-3170-411e-a6a2-b42dc0083a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:32:34 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9df4763c-8c73-4617-b6d6-f7573d9d840c tempest-GroupSnapshotsTest-1020571071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c5f7646-3170-411e-a6a2-b42dc0083a79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c825fd2-5429-4470-89a0-2d997620573c', 'volume_name': 'volume-8c825fd2-5429-4470-89a0-2d997620573c', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:32:34 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9df4763c-8c73-4617-b6d6-f7573d9d840c tempest-GroupSnapshotsTest-1020571071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1f08489-1edb-407f-9c25-f5aed6995231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:32:34 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9df4763c-8c73-4617-b6d6-f7573d9d840c tempest-GroupSnapshotsTest-1020571071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1f08489-1edb-407f-9c25-f5aed6995231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:32:34 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9df4763c-8c73-4617-b6d6-f7573d9d840c tempest-GroupSnapshotsTest-1020571071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71374e6a-71c5-42c9-9d40-6f0002ddc772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:32:34 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-9df4763c-8c73-4617-b6d6-f7573d9d840c tempest-GroupSnapshotsTest-1020571071 None] Volume 8c825fd2-5429-4470-89a0-2d997620573c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c825fd2-5429-4470-89a0-2d997620573c', 'volume_size': 1}
Jul 09 14:32:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9df4763c-8c73-4617-b6d6-f7573d9d840c tempest-GroupSnapshotsTest-1020571071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:32:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9df4763c-8c73-4617-b6d6-f7573d9d840c tempest-GroupSnapshotsTest-1020571071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:32:34 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9df4763c-8c73-4617-b6d6-f7573d9d840c tempest-GroupSnapshotsTest-1020571071 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=415c9ac1-046d-4424-885e-591404a7d739,created_at=2026-07-09T12:32:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1158578544',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=415c9ac1-046d-4424-885e-591404a7d739,host='devstack@QuobyteHD#QuobyteHD',id=8c825fd2-5429-4470-89a0-2d997620573c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='531740d4ee6f4b94a699d04a7eddb233',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:32:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:32:35Z,use_quota=True,user_id='6438d0684a2f482489697f50bffe8f8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7880a37e-e9d9-4f23-95a3-3334b22d550b),volume_type_id=7880a37e-e9d9-4f23-95a3-3334b22d550b)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:32:34 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-9df4763c-8c73-4617-b6d6-f7573d9d840c tempest-GroupSnapshotsTest-1020571071 None] Creating volume 8c825fd2-5429-4470-89a0-2d997620573c {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:32:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9df4763c-8c73-4617-b6d6-f7573d9d840c tempest-GroupSnapshotsTest-1020571071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:32:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9df4763c-8c73-4617-b6d6-f7573d9d840c tempest-GroupSnapshotsTest-1020571071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:32:34 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9df4763c-8c73-4617-b6d6-f7573d9d840c tempest-GroupSnapshotsTest-1020571071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:32:34 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9df4763c-8c73-4617-b6d6-f7573d9d840c tempest-GroupSnapshotsTest-1020571071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:32:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9df4763c-8c73-4617-b6d6-f7573d9d840c tempest-GroupSnapshotsTest-1020571071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:32:34 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9df4763c-8c73-4617-b6d6-f7573d9d840c tempest-GroupSnapshotsTest-1020571071 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:32:34 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-9df4763c-8c73-4617-b6d6-f7573d9d840c tempest-GroupSnapshotsTest-1020571071 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:32:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9df4763c-8c73-4617-b6d6-f7573d9d840c tempest-GroupSnapshotsTest-1020571071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8c825fd2-5429-4470-89a0-2d997620573c 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:32:34 devstack sudo[89502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8c825fd2-5429-4470-89a0-2d997620573c 1073741824
Jul 09 14:32:34 devstack sudo[89502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:32:35 devstack sudo[89502]: pam_unix(sudo:session): session closed for user root
Jul 09 14:32:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9df4763c-8c73-4617-b6d6-f7573d9d840c tempest-GroupSnapshotsTest-1020571071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8c825fd2-5429-4470-89a0-2d997620573c 1073741824" returned: 0 in 1.018s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:32:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9df4763c-8c73-4617-b6d6-f7573d9d840c tempest-GroupSnapshotsTest-1020571071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8c825fd2-5429-4470-89a0-2d997620573c {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:32:35 devstack sudo[89509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8c825fd2-5429-4470-89a0-2d997620573c
Jul 09 14:32:35 devstack sudo[89509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:32:36 devstack sudo[89509]: pam_unix(sudo:session): session closed for user root
Jul 09 14:32:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9df4763c-8c73-4617-b6d6-f7573d9d840c tempest-GroupSnapshotsTest-1020571071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8c825fd2-5429-4470-89a0-2d997620573c" returned: 0 in 0.710s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:32:36 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9df4763c-8c73-4617-b6d6-f7573d9d840c tempest-GroupSnapshotsTest-1020571071 None] <== create_volume: return (1785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:32:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9df4763c-8c73-4617-b6d6-f7573d9d840c tempest-GroupSnapshotsTest-1020571071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.786s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:32:36 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9df4763c-8c73-4617-b6d6-f7573d9d840c tempest-GroupSnapshotsTest-1020571071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71374e6a-71c5-42c9-9d40-6f0002ddc772) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c825fd2-5429-4470-89a0-2d997620573c', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:32:36 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9df4763c-8c73-4617-b6d6-f7573d9d840c tempest-GroupSnapshotsTest-1020571071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f2d743e-ee0a-40b0-a229-2c6f8c9e4db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:32:36 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-9df4763c-8c73-4617-b6d6-f7573d9d840c tempest-GroupSnapshotsTest-1020571071 None] Volume volume-8c825fd2-5429-4470-89a0-2d997620573c (8c825fd2-5429-4470-89a0-2d997620573c): created successfully
Jul 09 14:32:36 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9df4763c-8c73-4617-b6d6-f7573d9d840c tempest-GroupSnapshotsTest-1020571071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f2d743e-ee0a-40b0-a229-2c6f8c9e4db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:32:36 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9df4763c-8c73-4617-b6d6-f7573d9d840c tempest-GroupSnapshotsTest-1020571071 None] Flow 'volume_create_manager' (0825de65-9c70-4e84-86f3-dbe0a6889d97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:32:36 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-9df4763c-8c73-4617-b6d6-f7573d9d840c tempest-GroupSnapshotsTest-1020571071 None] Created volume successfully.
Jul 09 14:32:37 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-6149c0cd-7fdd-4af3-a7bb-1aff0ddfcbc5 tempest-GroupSnapshotsTest-1020571071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:32:37 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6149c0cd-7fdd-4af3-a7bb-1aff0ddfcbc5 tempest-GroupSnapshotsTest-1020571071 None] Flow 'volume_create_manager' (f7e30301-a28c-4d4b-8e8d-96efc9a19964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:32:37 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6149c0cd-7fdd-4af3-a7bb-1aff0ddfcbc5 tempest-GroupSnapshotsTest-1020571071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89a6f39a-cd76-4e46-bd5c-2db908f568d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:32:37 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6149c0cd-7fdd-4af3-a7bb-1aff0ddfcbc5 tempest-GroupSnapshotsTest-1020571071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89a6f39a-cd76-4e46-bd5c-2db908f568d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:32:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1393497371',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=415c9ac1-046d-4424-885e-591404a7d739,host='devstack@QuobyteHD#QuobyteHD',id=a4d2ec7d-39f2-4302-8cac-60563929012e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='531740d4ee6f4b94a699d04a7eddb233',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:32:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:32:38Z,use_quota=True,user_id='6438d0684a2f482489697f50bffe8f8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7880a37e-e9d9-4f23-95a3-3334b22d550b),volume_type_id=7880a37e-e9d9-4f23-95a3-3334b22d550b)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:32:37 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6149c0cd-7fdd-4af3-a7bb-1aff0ddfcbc5 tempest-GroupSnapshotsTest-1020571071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7409fc7-c3b0-489f-a661-a2298b7c672d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:32:37 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6149c0cd-7fdd-4af3-a7bb-1aff0ddfcbc5 tempest-GroupSnapshotsTest-1020571071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7409fc7-c3b0-489f-a661-a2298b7c672d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:32:37 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6149c0cd-7fdd-4af3-a7bb-1aff0ddfcbc5 tempest-GroupSnapshotsTest-1020571071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c23c66c-f299-4f0f-80e9-388fc206f4b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:32:37 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6149c0cd-7fdd-4af3-a7bb-1aff0ddfcbc5 tempest-GroupSnapshotsTest-1020571071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c23c66c-f299-4f0f-80e9-388fc206f4b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4d2ec7d-39f2-4302-8cac-60563929012e', 'volume_name': 'volume-a4d2ec7d-39f2-4302-8cac-60563929012e', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:32:37 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6149c0cd-7fdd-4af3-a7bb-1aff0ddfcbc5 tempest-GroupSnapshotsTest-1020571071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a8715dd-f66d-4925-ab05-aa45c120818d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:32:37 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6149c0cd-7fdd-4af3-a7bb-1aff0ddfcbc5 tempest-GroupSnapshotsTest-1020571071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a8715dd-f66d-4925-ab05-aa45c120818d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:32:37 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6149c0cd-7fdd-4af3-a7bb-1aff0ddfcbc5 tempest-GroupSnapshotsTest-1020571071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (577e094e-de36-46a4-b706-68cbfda498cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:32:37 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-6149c0cd-7fdd-4af3-a7bb-1aff0ddfcbc5 tempest-GroupSnapshotsTest-1020571071 None] Volume a4d2ec7d-39f2-4302-8cac-60563929012e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4d2ec7d-39f2-4302-8cac-60563929012e', 'volume_size': 1}
Jul 09 14:32:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6149c0cd-7fdd-4af3-a7bb-1aff0ddfcbc5 tempest-GroupSnapshotsTest-1020571071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:32:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6149c0cd-7fdd-4af3-a7bb-1aff0ddfcbc5 tempest-GroupSnapshotsTest-1020571071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:32:37 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-6149c0cd-7fdd-4af3-a7bb-1aff0ddfcbc5 tempest-GroupSnapshotsTest-1020571071 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=415c9ac1-046d-4424-885e-591404a7d739,created_at=2026-07-09T12:32:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1393497371',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=415c9ac1-046d-4424-885e-591404a7d739,host='devstack@QuobyteHD#QuobyteHD',id=a4d2ec7d-39f2-4302-8cac-60563929012e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='531740d4ee6f4b94a699d04a7eddb233',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:32:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:32:38Z,use_quota=True,user_id='6438d0684a2f482489697f50bffe8f8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7880a37e-e9d9-4f23-95a3-3334b22d550b),volume_type_id=7880a37e-e9d9-4f23-95a3-3334b22d550b)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:32:37 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-6149c0cd-7fdd-4af3-a7bb-1aff0ddfcbc5 tempest-GroupSnapshotsTest-1020571071 None] Creating volume a4d2ec7d-39f2-4302-8cac-60563929012e {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:32:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6149c0cd-7fdd-4af3-a7bb-1aff0ddfcbc5 tempest-GroupSnapshotsTest-1020571071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:32:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6149c0cd-7fdd-4af3-a7bb-1aff0ddfcbc5 tempest-GroupSnapshotsTest-1020571071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:32:37 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-6149c0cd-7fdd-4af3-a7bb-1aff0ddfcbc5 tempest-GroupSnapshotsTest-1020571071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:32:37 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-6149c0cd-7fdd-4af3-a7bb-1aff0ddfcbc5 tempest-GroupSnapshotsTest-1020571071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:32:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6149c0cd-7fdd-4af3-a7bb-1aff0ddfcbc5 tempest-GroupSnapshotsTest-1020571071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:32:37 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-6149c0cd-7fdd-4af3-a7bb-1aff0ddfcbc5 tempest-GroupSnapshotsTest-1020571071 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:32:37 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-6149c0cd-7fdd-4af3-a7bb-1aff0ddfcbc5 tempest-GroupSnapshotsTest-1020571071 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:32:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6149c0cd-7fdd-4af3-a7bb-1aff0ddfcbc5 tempest-GroupSnapshotsTest-1020571071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a4d2ec7d-39f2-4302-8cac-60563929012e 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:32:37 devstack sudo[89515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a4d2ec7d-39f2-4302-8cac-60563929012e 1073741824
Jul 09 14:32:37 devstack sudo[89515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:32:39 devstack sudo[89515]: pam_unix(sudo:session): session closed for user root
Jul 09 14:32:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6149c0cd-7fdd-4af3-a7bb-1aff0ddfcbc5 tempest-GroupSnapshotsTest-1020571071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a4d2ec7d-39f2-4302-8cac-60563929012e 1073741824" returned: 0 in 1.072s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:32:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6149c0cd-7fdd-4af3-a7bb-1aff0ddfcbc5 tempest-GroupSnapshotsTest-1020571071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a4d2ec7d-39f2-4302-8cac-60563929012e {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:32:39 devstack sudo[89524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a4d2ec7d-39f2-4302-8cac-60563929012e
Jul 09 14:32:39 devstack sudo[89524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:32:39 devstack sudo[89524]: pam_unix(sudo:session): session closed for user root
Jul 09 14:32:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6149c0cd-7fdd-4af3-a7bb-1aff0ddfcbc5 tempest-GroupSnapshotsTest-1020571071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a4d2ec7d-39f2-4302-8cac-60563929012e" returned: 0 in 0.722s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:32:39 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-6149c0cd-7fdd-4af3-a7bb-1aff0ddfcbc5 tempest-GroupSnapshotsTest-1020571071 None] <== create_volume: return (1847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:32:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6149c0cd-7fdd-4af3-a7bb-1aff0ddfcbc5 tempest-GroupSnapshotsTest-1020571071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.849s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:32:39 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6149c0cd-7fdd-4af3-a7bb-1aff0ddfcbc5 tempest-GroupSnapshotsTest-1020571071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (577e094e-de36-46a4-b706-68cbfda498cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4d2ec7d-39f2-4302-8cac-60563929012e', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:32:39 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6149c0cd-7fdd-4af3-a7bb-1aff0ddfcbc5 tempest-GroupSnapshotsTest-1020571071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9277fbc6-08b1-48f6-8940-5e5dcada90e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:32:39 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-6149c0cd-7fdd-4af3-a7bb-1aff0ddfcbc5 tempest-GroupSnapshotsTest-1020571071 None] Volume volume-a4d2ec7d-39f2-4302-8cac-60563929012e (a4d2ec7d-39f2-4302-8cac-60563929012e): created successfully
Jul 09 14:32:39 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6149c0cd-7fdd-4af3-a7bb-1aff0ddfcbc5 tempest-GroupSnapshotsTest-1020571071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9277fbc6-08b1-48f6-8940-5e5dcada90e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:32:39 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6149c0cd-7fdd-4af3-a7bb-1aff0ddfcbc5 tempest-GroupSnapshotsTest-1020571071 None] Flow 'volume_create_manager' (f7e30301-a28c-4d4b-8e8d-96efc9a19964) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:32:39 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-6149c0cd-7fdd-4af3-a7bb-1aff0ddfcbc5 tempest-GroupSnapshotsTest-1020571071 None] Created volume successfully.
Jul 09 14:32:40 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-c65d0a0f-1aa3-4be1-a26c-c30440ab015c tempest-GroupSnapshotsTest-1020571071 None] Update group completed successfully.
Jul 09 14:32:41 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-cf1627bf-a8da-4f4a-9984-c13271816a0a tempest-GroupSnapshotsTest-1020571071 None] Update group completed successfully.
Jul 09 14:32:43 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-9d8e81a1-4599-4614-81d7-b2849807ed95 tempest-GroupSnapshotsTest-1020571071 None] Update group completed successfully.
Jul 09 14:32:44 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-52147028-a3b2-4418-9ea3-bcab0489cc5f tempest-GroupSnapshotsTest-1020571071 None] Update group completed successfully.
Jul 09 14:32:46 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-228ad206-5680-4e93-87d7-f1b8b4348d76 tempest-GroupSnapshotsTest-1020571071 None] GroupSnapshot e5180bb0-29f9-499a-aa7a-846542950558: creating.
Jul 09 14:32:46 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-228ad206-5680-4e93-87d7-f1b8b4348d76 tempest-GroupSnapshotsTest-1020571071 None] Group snapshot e5180bb0-29f9-499a-aa7a-846542950558: creating. {{(pid=87230) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jul 09 14:32:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-228ad206-5680-4e93-87d7-f1b8b4348d76 tempest-GroupSnapshotsTest-1020571071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:32:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-228ad206-5680-4e93-87d7-f1b8b4348d76 tempest-GroupSnapshotsTest-1020571071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:32:46 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-228ad206-5680-4e93-87d7-f1b8b4348d76 tempest-GroupSnapshotsTest-1020571071 None] Creating offline snapshot 2bd5c8ca-6ad9-4ce8-a46d-b8e2e3c9636c of volume a4d2ec7d-39f2-4302-8cac-60563929012e {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 14:32:46 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d540934-1c4b-419e-a1cd-24e49e6b645b]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:32:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-228ad206-5680-4e93-87d7-f1b8b4348d76 tempest-GroupSnapshotsTest-1020571071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a4d2ec7d-39f2-4302-8cac-60563929012e {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:32:46 devstack sudo[89615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a4d2ec7d-39f2-4302-8cac-60563929012e
Jul 09 14:32:46 devstack sudo[89615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:32:47 devstack sudo[89615]: pam_unix(sudo:session): session closed for user root
Jul 09 14:32:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-228ad206-5680-4e93-87d7-f1b8b4348d76 tempest-GroupSnapshotsTest-1020571071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a4d2ec7d-39f2-4302-8cac-60563929012e" returned: 0 in 1.096s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:32:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-228ad206-5680-4e93-87d7-f1b8b4348d76 tempest-GroupSnapshotsTest-1020571071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a4d2ec7d-39f2-4302-8cac-60563929012e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a4d2ec7d-39f2-4302-8cac-60563929012e.2bd5c8ca-6ad9-4ce8-a46d-b8e2e3c9636c 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:32:47 devstack sudo[89626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a4d2ec7d-39f2-4302-8cac-60563929012e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a4d2ec7d-39f2-4302-8cac-60563929012e.2bd5c8ca-6ad9-4ce8-a46d-b8e2e3c9636c 1G
Jul 09 14:32:47 devstack sudo[89626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:32:48 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-0302bbc3-30ba-45ad-8ef4-642993718112 tempest-VolumesAdminNegativeTest-1231229856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:32:48 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0302bbc3-30ba-45ad-8ef4-642993718112 tempest-VolumesAdminNegativeTest-1231229856 None] Flow 'volume_create_manager' (804ff8ec-9d53-4ac1-87c0-23b61bfc1b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:32:48 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0302bbc3-30ba-45ad-8ef4-642993718112 tempest-VolumesAdminNegativeTest-1231229856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1767f44f-01f0-4ce0-8c58-307bcc41913a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:32:48 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0302bbc3-30ba-45ad-8ef4-642993718112 tempest-VolumesAdminNegativeTest-1231229856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1767f44f-01f0-4ce0-8c58-307bcc41913a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:32:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1513637271',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d5a5545-3fd5-4baf-8cac-51dae52d12c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7f660fd6cff4cb5af17fd4b199a991a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:32:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:32:48Z,use_quota=True,user_id='93fa7bf2163e4ceab5d11623a827d3c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:32:48 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0302bbc3-30ba-45ad-8ef4-642993718112 tempest-VolumesAdminNegativeTest-1231229856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f817292b-d808-4985-a81f-abf580dbc603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:32:48 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0302bbc3-30ba-45ad-8ef4-642993718112 tempest-VolumesAdminNegativeTest-1231229856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f817292b-d808-4985-a81f-abf580dbc603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:32:48 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0302bbc3-30ba-45ad-8ef4-642993718112 tempest-VolumesAdminNegativeTest-1231229856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ef9cdff-a88f-4d9a-87ba-e8e3716346ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:32:48 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0302bbc3-30ba-45ad-8ef4-642993718112 tempest-VolumesAdminNegativeTest-1231229856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ef9cdff-a88f-4d9a-87ba-e8e3716346ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d5a5545-3fd5-4baf-8cac-51dae52d12c0', 'volume_name': 'volume-9d5a5545-3fd5-4baf-8cac-51dae52d12c0', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:32:48 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0302bbc3-30ba-45ad-8ef4-642993718112 tempest-VolumesAdminNegativeTest-1231229856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12c4973c-e4dd-4007-94fd-d937a061739f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:32:48 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0302bbc3-30ba-45ad-8ef4-642993718112 tempest-VolumesAdminNegativeTest-1231229856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12c4973c-e4dd-4007-94fd-d937a061739f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:32:48 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0302bbc3-30ba-45ad-8ef4-642993718112 tempest-VolumesAdminNegativeTest-1231229856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b52bdf72-49dc-4c15-9495-1879111137b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:32:48 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-0302bbc3-30ba-45ad-8ef4-642993718112 tempest-VolumesAdminNegativeTest-1231229856 None] Volume 9d5a5545-3fd5-4baf-8cac-51dae52d12c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d5a5545-3fd5-4baf-8cac-51dae52d12c0', 'volume_size': 1}
Jul 09 14:32:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0302bbc3-30ba-45ad-8ef4-642993718112 tempest-VolumesAdminNegativeTest-1231229856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:32:48 devstack sudo[89626]: pam_unix(sudo:session): session closed for user root
Jul 09 14:32:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-228ad206-5680-4e93-87d7-f1b8b4348d76 tempest-GroupSnapshotsTest-1020571071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a4d2ec7d-39f2-4302-8cac-60563929012e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a4d2ec7d-39f2-4302-8cac-60563929012e.2bd5c8ca-6ad9-4ce8-a46d-b8e2e3c9636c 1G" returned: 0 in 1.354s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:32:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-228ad206-5680-4e93-87d7-f1b8b4348d76 tempest-GroupSnapshotsTest-1020571071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4d2ec7d-39f2-4302-8cac-60563929012e -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a4d2ec7d-39f2-4302-8cac-60563929012e.2bd5c8ca-6ad9-4ce8-a46d-b8e2e3c9636c {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:32:48 devstack sudo[89635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4d2ec7d-39f2-4302-8cac-60563929012e -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a4d2ec7d-39f2-4302-8cac-60563929012e.2bd5c8ca-6ad9-4ce8-a46d-b8e2e3c9636c
Jul 09 14:32:48 devstack sudo[89635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:32:49 devstack sudo[89635]: pam_unix(sudo:session): session closed for user root
Jul 09 14:32:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-228ad206-5680-4e93-87d7-f1b8b4348d76 tempest-GroupSnapshotsTest-1020571071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4d2ec7d-39f2-4302-8cac-60563929012e -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a4d2ec7d-39f2-4302-8cac-60563929012e.2bd5c8ca-6ad9-4ce8-a46d-b8e2e3c9636c" returned: 0 in 0.988s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:32:49 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-228ad206-5680-4e93-87d7-f1b8b4348d76 tempest-GroupSnapshotsTest-1020571071 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a4d2ec7d-39f2-4302-8cac-60563929012e.2bd5c8ca-6ad9-4ce8-a46d-b8e2e3c9636c is being set with open permissions: ugo+rw: NotImplementedError
Jul 09 14:32:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-228ad206-5680-4e93-87d7-f1b8b4348d76 tempest-GroupSnapshotsTest-1020571071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a4d2ec7d-39f2-4302-8cac-60563929012e.2bd5c8ca-6ad9-4ce8-a46d-b8e2e3c9636c {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:32:49 devstack sudo[89641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a4d2ec7d-39f2-4302-8cac-60563929012e.2bd5c8ca-6ad9-4ce8-a46d-b8e2e3c9636c
Jul 09 14:32:49 devstack sudo[89641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:32:50 devstack sudo[89641]: pam_unix(sudo:session): session closed for user root
Jul 09 14:32:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-228ad206-5680-4e93-87d7-f1b8b4348d76 tempest-GroupSnapshotsTest-1020571071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a4d2ec7d-39f2-4302-8cac-60563929012e.2bd5c8ca-6ad9-4ce8-a46d-b8e2e3c9636c" returned: 0 in 0.745s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:32:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-228ad206-5680-4e93-87d7-f1b8b4348d76 tempest-GroupSnapshotsTest-1020571071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a4d2ec7d-39f2-4302-8cac-60563929012e.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:32:50 devstack sudo[89644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a4d2ec7d-39f2-4302-8cac-60563929012e.info
Jul 09 14:32:50 devstack sudo[89644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:32:51 devstack sudo[89644]: pam_unix(sudo:session): session closed for user root
Jul 09 14:32:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-228ad206-5680-4e93-87d7-f1b8b4348d76 tempest-GroupSnapshotsTest-1020571071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a4d2ec7d-39f2-4302-8cac-60563929012e.info" returned: 0 in 0.820s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:32:51 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-228ad206-5680-4e93-87d7-f1b8b4348d76 tempest-GroupSnapshotsTest-1020571071 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a4d2ec7d-39f2-4302-8cac-60563929012e.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 09 14:32:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-228ad206-5680-4e93-87d7-f1b8b4348d76 tempest-GroupSnapshotsTest-1020571071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a4d2ec7d-39f2-4302-8cac-60563929012e.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:32:51 devstack sudo[89661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a4d2ec7d-39f2-4302-8cac-60563929012e.info
Jul 09 14:32:51 devstack sudo[89661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:32:52 devstack sudo[89661]: pam_unix(sudo:session): session closed for user root
Jul 09 14:32:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-228ad206-5680-4e93-87d7-f1b8b4348d76 tempest-GroupSnapshotsTest-1020571071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a4d2ec7d-39f2-4302-8cac-60563929012e.info" returned: 0 in 0.975s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:32:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-228ad206-5680-4e93-87d7-f1b8b4348d76 tempest-GroupSnapshotsTest-1020571071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.115s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:32:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-228ad206-5680-4e93-87d7-f1b8b4348d76 tempest-GroupSnapshotsTest-1020571071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:32:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-228ad206-5680-4e93-87d7-f1b8b4348d76 tempest-GroupSnapshotsTest-1020571071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:32:52 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-228ad206-5680-4e93-87d7-f1b8b4348d76 tempest-GroupSnapshotsTest-1020571071 None] Creating offline snapshot c51e94ad-078c-4aae-9031-754e75afc8a6 of volume 8c825fd2-5429-4470-89a0-2d997620573c {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 14:32:52 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 14:32:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:32:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:32:52 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:32:52 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:32:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:32:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:32:52 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[e92ee0db-b658-47dc-8763-a4c23ee6aaca]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:32:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-228ad206-5680-4e93-87d7-f1b8b4348d76 tempest-GroupSnapshotsTest-1020571071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8c825fd2-5429-4470-89a0-2d997620573c {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:32:52 devstack sudo[89695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:32:52 devstack sudo[89695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:32:52 devstack sudo[89696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8c825fd2-5429-4470-89a0-2d997620573c
Jul 09 14:32:52 devstack sudo[89696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:32:53 devstack sudo[89695]: pam_unix(sudo:session): session closed for user root
Jul 09 14:32:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 1.173s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:32:53 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:32:53 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Running periodic task VolumeManager._thread_info {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 14:32:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] thread count: 8 {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 09 14:32:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] thread info: [<_MainThread(MainThread, started 125388812103808)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125388713797504)>, <Thread(Thread-3 (stat_writer), started daemon 125388699995392)>, <Thread(Rabbit-heartbeat, started daemon 125388700522560)>, <Thread(Thread-5 (_runner), started daemon 125388698545216)>, <Thread(Thread-7 (_runner), started daemon 125388698611264)>, <Thread(fd_logger, started daemon 125388703020672)>, <Thread(privsep_reader, started daemon 125388696441088)>] {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 09 14:32:53 devstack sudo[89696]: pam_unix(sudo:session): session closed for user root
Jul 09 14:32:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-228ad206-5680-4e93-87d7-f1b8b4348d76 tempest-GroupSnapshotsTest-1020571071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8c825fd2-5429-4470-89a0-2d997620573c" returned: 0 in 1.517s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:32:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-228ad206-5680-4e93-87d7-f1b8b4348d76 tempest-GroupSnapshotsTest-1020571071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8c825fd2-5429-4470-89a0-2d997620573c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8c825fd2-5429-4470-89a0-2d997620573c.c51e94ad-078c-4aae-9031-754e75afc8a6 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:32:53 devstack sudo[89725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8c825fd2-5429-4470-89a0-2d997620573c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8c825fd2-5429-4470-89a0-2d997620573c.c51e94ad-078c-4aae-9031-754e75afc8a6 1G
Jul 09 14:32:53 devstack sudo[89725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:32:55 devstack sudo[89725]: pam_unix(sudo:session): session closed for user root
Jul 09 14:32:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-228ad206-5680-4e93-87d7-f1b8b4348d76 tempest-GroupSnapshotsTest-1020571071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8c825fd2-5429-4470-89a0-2d997620573c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8c825fd2-5429-4470-89a0-2d997620573c.c51e94ad-078c-4aae-9031-754e75afc8a6 1G" returned: 0 in 1.233s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:32:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-228ad206-5680-4e93-87d7-f1b8b4348d76 tempest-GroupSnapshotsTest-1020571071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c825fd2-5429-4470-89a0-2d997620573c -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8c825fd2-5429-4470-89a0-2d997620573c.c51e94ad-078c-4aae-9031-754e75afc8a6 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:32:55 devstack sudo[89755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c825fd2-5429-4470-89a0-2d997620573c -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8c825fd2-5429-4470-89a0-2d997620573c.c51e94ad-078c-4aae-9031-754e75afc8a6
Jul 09 14:32:55 devstack sudo[89755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:32:56 devstack sudo[89755]: pam_unix(sudo:session): session closed for user root
Jul 09 14:32:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-228ad206-5680-4e93-87d7-f1b8b4348d76 tempest-GroupSnapshotsTest-1020571071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c825fd2-5429-4470-89a0-2d997620573c -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8c825fd2-5429-4470-89a0-2d997620573c.c51e94ad-078c-4aae-9031-754e75afc8a6" returned: 0 in 0.945s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:32:56 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-228ad206-5680-4e93-87d7-f1b8b4348d76 tempest-GroupSnapshotsTest-1020571071 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8c825fd2-5429-4470-89a0-2d997620573c.c51e94ad-078c-4aae-9031-754e75afc8a6 is being set with open permissions: ugo+rw: NotImplementedError
Jul 09 14:32:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-228ad206-5680-4e93-87d7-f1b8b4348d76 tempest-GroupSnapshotsTest-1020571071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8c825fd2-5429-4470-89a0-2d997620573c.c51e94ad-078c-4aae-9031-754e75afc8a6 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:32:56 devstack sudo[89787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8c825fd2-5429-4470-89a0-2d997620573c.c51e94ad-078c-4aae-9031-754e75afc8a6
Jul 09 14:32:56 devstack sudo[89787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:32:56 devstack sudo[89787]: pam_unix(sudo:session): session closed for user root
Jul 09 14:32:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-228ad206-5680-4e93-87d7-f1b8b4348d76 tempest-GroupSnapshotsTest-1020571071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8c825fd2-5429-4470-89a0-2d997620573c.c51e94ad-078c-4aae-9031-754e75afc8a6" returned: 0 in 0.782s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:32:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-228ad206-5680-4e93-87d7-f1b8b4348d76 tempest-GroupSnapshotsTest-1020571071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8c825fd2-5429-4470-89a0-2d997620573c.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:32:56 devstack sudo[89792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8c825fd2-5429-4470-89a0-2d997620573c.info
Jul 09 14:32:56 devstack sudo[89792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:32:57 devstack sudo[89792]: pam_unix(sudo:session): session closed for user root
Jul 09 14:32:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-228ad206-5680-4e93-87d7-f1b8b4348d76 tempest-GroupSnapshotsTest-1020571071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8c825fd2-5429-4470-89a0-2d997620573c.info" returned: 0 in 0.728s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:32:57 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-228ad206-5680-4e93-87d7-f1b8b4348d76 tempest-GroupSnapshotsTest-1020571071 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8c825fd2-5429-4470-89a0-2d997620573c.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 09 14:32:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-228ad206-5680-4e93-87d7-f1b8b4348d76 tempest-GroupSnapshotsTest-1020571071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8c825fd2-5429-4470-89a0-2d997620573c.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:32:57 devstack sudo[89809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8c825fd2-5429-4470-89a0-2d997620573c.info
Jul 09 14:32:57 devstack sudo[89809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:32:58 devstack sudo[89809]: pam_unix(sudo:session): session closed for user root
Jul 09 14:32:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-228ad206-5680-4e93-87d7-f1b8b4348d76 tempest-GroupSnapshotsTest-1020571071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8c825fd2-5429-4470-89a0-2d997620573c.info" returned: 0 in 0.685s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:32:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-228ad206-5680-4e93-87d7-f1b8b4348d76 tempest-GroupSnapshotsTest-1020571071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.026s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:32:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0302bbc3-30ba-45ad-8ef4-642993718112 tempest-VolumesAdminNegativeTest-1231229856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.054s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:32:58 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-0302bbc3-30ba-45ad-8ef4-642993718112 tempest-VolumesAdminNegativeTest-1231229856 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:32:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1513637271',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d5a5545-3fd5-4baf-8cac-51dae52d12c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7f660fd6cff4cb5af17fd4b199a991a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:32:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:32:48Z,use_quota=True,user_id='93fa7bf2163e4ceab5d11623a827d3c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:32:58 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-0302bbc3-30ba-45ad-8ef4-642993718112 tempest-VolumesAdminNegativeTest-1231229856 None] Creating volume 9d5a5545-3fd5-4baf-8cac-51dae52d12c0 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:32:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0302bbc3-30ba-45ad-8ef4-642993718112 tempest-VolumesAdminNegativeTest-1231229856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:32:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0302bbc3-30ba-45ad-8ef4-642993718112 tempest-VolumesAdminNegativeTest-1231229856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:32:58 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-0302bbc3-30ba-45ad-8ef4-642993718112 tempest-VolumesAdminNegativeTest-1231229856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:32:58 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-0302bbc3-30ba-45ad-8ef4-642993718112 tempest-VolumesAdminNegativeTest-1231229856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:32:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0302bbc3-30ba-45ad-8ef4-642993718112 tempest-VolumesAdminNegativeTest-1231229856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:32:58 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-0302bbc3-30ba-45ad-8ef4-642993718112 tempest-VolumesAdminNegativeTest-1231229856 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:32:58 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-0302bbc3-30ba-45ad-8ef4-642993718112 tempest-VolumesAdminNegativeTest-1231229856 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:32:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0302bbc3-30ba-45ad-8ef4-642993718112 tempest-VolumesAdminNegativeTest-1231229856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-9d5a5545-3fd5-4baf-8cac-51dae52d12c0 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:32:58 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=60,cinder:INSERT=11,cinder:UPDATE=41,cinder:DELETE=1 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 14:32:58 devstack sudo[89815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-9d5a5545-3fd5-4baf-8cac-51dae52d12c0 1073741824
Jul 09 14:32:58 devstack sudo[89815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:32:58 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-228ad206-5680-4e93-87d7-f1b8b4348d76 tempest-GroupSnapshotsTest-1020571071 None] group_snapshot e5180bb0-29f9-499a-aa7a-846542950558: created successfully
Jul 09 14:32:59 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-1f337f0c-8f0e-4d6d-b3f3-60e583aced69 tempest-GroupSnapshotsTest-1020571071 None] group_snapshot e5180bb0-29f9-499a-aa7a-846542950558: deleting
Jul 09 14:32:59 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1f337f0c-8f0e-4d6d-b3f3-60e583aced69 tempest-GroupSnapshotsTest-1020571071 None] group_snapshot e5180bb0-29f9-499a-aa7a-846542950558: deleting {{(pid=87230) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jul 09 14:32:59 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1f337f0c-8f0e-4d6d-b3f3-60e583aced69 tempest-GroupSnapshotsTest-1020571071 None] Acquiring lock "cinder-quobyte-a4d2ec7d-39f2-4302-8cac-60563929012e" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:32:59 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1f337f0c-8f0e-4d6d-b3f3-60e583aced69 tempest-GroupSnapshotsTest-1020571071 None] Lock "cinder-quobyte-a4d2ec7d-39f2-4302-8cac-60563929012e" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:32:59 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1f337f0c-8f0e-4d6d-b3f3-60e583aced69 tempest-GroupSnapshotsTest-1020571071 None] Acquiring lock "cinder-quobyte-2bd5c8ca-6ad9-4ce8-a46d-b8e2e3c9636c" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:32:59 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1f337f0c-8f0e-4d6d-b3f3-60e583aced69 tempest-GroupSnapshotsTest-1020571071 None] Lock "cinder-quobyte-2bd5c8ca-6ad9-4ce8-a46d-b8e2e3c9636c" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:32:59 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-1f337f0c-8f0e-4d6d-b3f3-60e583aced69 tempest-GroupSnapshotsTest-1020571071 None] Deleting offline snapshot 2bd5c8ca-6ad9-4ce8-a46d-b8e2e3c9636c of volume a4d2ec7d-39f2-4302-8cac-60563929012e {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 14:32:59 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-1f337f0c-8f0e-4d6d-b3f3-60e583aced69 tempest-GroupSnapshotsTest-1020571071 None] snapshot_file for this snap is: volume-a4d2ec7d-39f2-4302-8cac-60563929012e.2bd5c8ca-6ad9-4ce8-a46d-b8e2e3c9636c {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 14:32:59 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bdce19e-0566-4241-bcc6-deacbcf33fc1]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:32:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1f337f0c-8f0e-4d6d-b3f3-60e583aced69 tempest-GroupSnapshotsTest-1020571071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a4d2ec7d-39f2-4302-8cac-60563929012e.2bd5c8ca-6ad9-4ce8-a46d-b8e2e3c9636c {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:32:59 devstack sudo[89820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a4d2ec7d-39f2-4302-8cac-60563929012e.2bd5c8ca-6ad9-4ce8-a46d-b8e2e3c9636c
Jul 09 14:32:59 devstack sudo[89820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:32:59 devstack sudo[89815]: pam_unix(sudo:session): session closed for user root
Jul 09 14:32:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0302bbc3-30ba-45ad-8ef4-642993718112 tempest-VolumesAdminNegativeTest-1231229856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-9d5a5545-3fd5-4baf-8cac-51dae52d12c0 1073741824" returned: 0 in 1.370s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:32:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0302bbc3-30ba-45ad-8ef4-642993718112 tempest-VolumesAdminNegativeTest-1231229856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-9d5a5545-3fd5-4baf-8cac-51dae52d12c0 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:32:59 devstack sudo[89834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-9d5a5545-3fd5-4baf-8cac-51dae52d12c0
Jul 09 14:32:59 devstack sudo[89834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:33:00 devstack sudo[89820]: pam_unix(sudo:session): session closed for user root
Jul 09 14:33:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1f337f0c-8f0e-4d6d-b3f3-60e583aced69 tempest-GroupSnapshotsTest-1020571071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a4d2ec7d-39f2-4302-8cac-60563929012e.2bd5c8ca-6ad9-4ce8-a46d-b8e2e3c9636c" returned: 0 in 1.493s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:33:00 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-1f337f0c-8f0e-4d6d-b3f3-60e583aced69 tempest-GroupSnapshotsTest-1020571071 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a4d2ec7d-39f2-4302-8cac-60563929012e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 14:33:00 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ddc714-c9e7-4736-8f51-0da4cf11ade0]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:33:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1f337f0c-8f0e-4d6d-b3f3-60e583aced69 tempest-GroupSnapshotsTest-1020571071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a4d2ec7d-39f2-4302-8cac-60563929012e {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:33:01 devstack sudo[89834]: pam_unix(sudo:session): session closed for user root
Jul 09 14:33:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0302bbc3-30ba-45ad-8ef4-642993718112 tempest-VolumesAdminNegativeTest-1231229856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-9d5a5545-3fd5-4baf-8cac-51dae52d12c0" returned: 0 in 1.313s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:33:01 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-0302bbc3-30ba-45ad-8ef4-642993718112 tempest-VolumesAdminNegativeTest-1231229856 None] <== create_volume: return (2773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:33:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0302bbc3-30ba-45ad-8ef4-642993718112 tempest-VolumesAdminNegativeTest-1231229856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.776s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:33:01 devstack sudo[89872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a4d2ec7d-39f2-4302-8cac-60563929012e
Jul 09 14:33:01 devstack sudo[89872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:33:01 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0302bbc3-30ba-45ad-8ef4-642993718112 tempest-VolumesAdminNegativeTest-1231229856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b52bdf72-49dc-4c15-9495-1879111137b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d5a5545-3fd5-4baf-8cac-51dae52d12c0', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:33:01 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0302bbc3-30ba-45ad-8ef4-642993718112 tempest-VolumesAdminNegativeTest-1231229856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28843362-c2c0-46a9-b96f-b0a8363909bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:33:01 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-0302bbc3-30ba-45ad-8ef4-642993718112 tempest-VolumesAdminNegativeTest-1231229856 None] Volume volume-9d5a5545-3fd5-4baf-8cac-51dae52d12c0 (9d5a5545-3fd5-4baf-8cac-51dae52d12c0): created successfully
Jul 09 14:33:01 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0302bbc3-30ba-45ad-8ef4-642993718112 tempest-VolumesAdminNegativeTest-1231229856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28843362-c2c0-46a9-b96f-b0a8363909bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:33:01 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0302bbc3-30ba-45ad-8ef4-642993718112 tempest-VolumesAdminNegativeTest-1231229856 None] Flow 'volume_create_manager' (804ff8ec-9d53-4ac1-87c0-23b61bfc1b35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:33:01 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=60,cinder:UPDATE=55,cinder:DELETE=2,cinder:INSERT=9 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 14:33:01 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-0302bbc3-30ba-45ad-8ef4-642993718112 tempest-VolumesAdminNegativeTest-1231229856 None] Created volume successfully.
Jul 09 14:33:02 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-bc0d567a-d1bd-410e-b1ab-d4808d1c783f tempest-VolumesAdminNegativeTest-1231229856 None] Acquiring lock "cinder-9d5a5545-3fd5-4baf-8cac-51dae52d12c0-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:33:02 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-bc0d567a-d1bd-410e-b1ab-d4808d1c783f tempest-VolumesAdminNegativeTest-1231229856 None] Lock "cinder-9d5a5545-3fd5-4baf-8cac-51dae52d12c0-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:33:02 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-bc0d567a-d1bd-410e-b1ab-d4808d1c783f tempest-VolumesAdminNegativeTest-1231229856 None] Acquiring lock "cinder-quobyte-9d5a5545-3fd5-4baf-8cac-51dae52d12c0" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:33:02 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-bc0d567a-d1bd-410e-b1ab-d4808d1c783f tempest-VolumesAdminNegativeTest-1231229856 None] Lock "cinder-quobyte-9d5a5545-3fd5-4baf-8cac-51dae52d12c0" acquired by "delete_volume" :: waited 0.033s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:33:02 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[806af209-0d58-4f08-bd85-441443eafc6d]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:33:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-bc0d567a-d1bd-410e-b1ab-d4808d1c783f tempest-VolumesAdminNegativeTest-1231229856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-9d5a5545-3fd5-4baf-8cac-51dae52d12c0 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:33:02 devstack sudo[89902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-9d5a5545-3fd5-4baf-8cac-51dae52d12c0
Jul 09 14:33:02 devstack sudo[89902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:33:02 devstack sudo[89872]: pam_unix(sudo:session): session closed for user root
Jul 09 14:33:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1f337f0c-8f0e-4d6d-b3f3-60e583aced69 tempest-GroupSnapshotsTest-1020571071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a4d2ec7d-39f2-4302-8cac-60563929012e" returned: 0 in 1.758s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:33:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1f337f0c-8f0e-4d6d-b3f3-60e583aced69 tempest-GroupSnapshotsTest-1020571071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a4d2ec7d-39f2-4302-8cac-60563929012e.2bd5c8ca-6ad9-4ce8-a46d-b8e2e3c9636c {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:33:02 devstack sudo[89904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a4d2ec7d-39f2-4302-8cac-60563929012e.2bd5c8ca-6ad9-4ce8-a46d-b8e2e3c9636c
Jul 09 14:33:02 devstack sudo[89904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:33:04 devstack sudo[89902]: pam_unix(sudo:session): session closed for user root
Jul 09 14:33:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-bc0d567a-d1bd-410e-b1ab-d4808d1c783f tempest-VolumesAdminNegativeTest-1231229856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-9d5a5545-3fd5-4baf-8cac-51dae52d12c0" returned: 0 in 2.183s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:33:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-bc0d567a-d1bd-410e-b1ab-d4808d1c783f tempest-VolumesAdminNegativeTest-1231229856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-9d5a5545-3fd5-4baf-8cac-51dae52d12c0 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:33:04 devstack sudo[89916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-9d5a5545-3fd5-4baf-8cac-51dae52d12c0
Jul 09 14:33:04 devstack sudo[89916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:33:04 devstack sudo[89904]: pam_unix(sudo:session): session closed for user root
Jul 09 14:33:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1f337f0c-8f0e-4d6d-b3f3-60e583aced69 tempest-GroupSnapshotsTest-1020571071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a4d2ec7d-39f2-4302-8cac-60563929012e.2bd5c8ca-6ad9-4ce8-a46d-b8e2e3c9636c" returned: 0 in 1.966s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:33:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1f337f0c-8f0e-4d6d-b3f3-60e583aced69 tempest-GroupSnapshotsTest-1020571071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a4d2ec7d-39f2-4302-8cac-60563929012e.2bd5c8ca-6ad9-4ce8-a46d-b8e2e3c9636c {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:33:04 devstack sudo[89918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a4d2ec7d-39f2-4302-8cac-60563929012e.2bd5c8ca-6ad9-4ce8-a46d-b8e2e3c9636c
Jul 09 14:33:04 devstack sudo[89918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:33:05 devstack sudo[89916]: pam_unix(sudo:session): session closed for user root
Jul 09 14:33:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-bc0d567a-d1bd-410e-b1ab-d4808d1c783f tempest-VolumesAdminNegativeTest-1231229856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-9d5a5545-3fd5-4baf-8cac-51dae52d12c0" returned: 0 in 1.321s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:33:05 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-bc0d567a-d1bd-410e-b1ab-d4808d1c783f tempest-VolumesAdminNegativeTest-1231229856 None] Lock "cinder-quobyte-9d5a5545-3fd5-4baf-8cac-51dae52d12c0" released by "delete_volume" :: held 3.628s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:33:06 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-bc0d567a-d1bd-410e-b1ab-d4808d1c783f tempest-VolumesAdminNegativeTest-1231229856 None] Created reservations ['77ed6b65-02f4-4e40-9aa4-2c8164df1257', 'cc22a786-bfaa-4f81-8d5e-bbcf906ce306', '053ae8dc-5622-410d-98f2-b765f7f552cb', '866affe1-f99e-4d24-a086-40b726267fc2'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:33:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-bc0d567a-d1bd-410e-b1ab-d4808d1c783f tempest-VolumesAdminNegativeTest-1231229856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:33:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-bc0d567a-d1bd-410e-b1ab-d4808d1c783f tempest-VolumesAdminNegativeTest-1231229856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:33:06 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-bc0d567a-d1bd-410e-b1ab-d4808d1c783f tempest-VolumesAdminNegativeTest-1231229856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:33:06 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-bc0d567a-d1bd-410e-b1ab-d4808d1c783f tempest-VolumesAdminNegativeTest-1231229856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:33:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-bc0d567a-d1bd-410e-b1ab-d4808d1c783f tempest-VolumesAdminNegativeTest-1231229856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:33:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-bc0d567a-d1bd-410e-b1ab-d4808d1c783f tempest-VolumesAdminNegativeTest-1231229856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:33:06 devstack sudo[89924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:33:06 devstack sudo[89924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:33:06 devstack sudo[89918]: pam_unix(sudo:session): session closed for user root
Jul 09 14:33:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1f337f0c-8f0e-4d6d-b3f3-60e583aced69 tempest-GroupSnapshotsTest-1020571071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a4d2ec7d-39f2-4302-8cac-60563929012e.2bd5c8ca-6ad9-4ce8-a46d-b8e2e3c9636c" returned: 0 in 1.692s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:33:06 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1f337f0c-8f0e-4d6d-b3f3-60e583aced69 tempest-GroupSnapshotsTest-1020571071 None] Lock "cinder-quobyte-2bd5c8ca-6ad9-4ce8-a46d-b8e2e3c9636c" released by "_delete_snapshot" :: held 7.129s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:33:06 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1f337f0c-8f0e-4d6d-b3f3-60e583aced69 tempest-GroupSnapshotsTest-1020571071 None] Lock "cinder-quobyte-a4d2ec7d-39f2-4302-8cac-60563929012e" released by "delete_snapshot" :: held 7.196s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:33:06 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1f337f0c-8f0e-4d6d-b3f3-60e583aced69 tempest-GroupSnapshotsTest-1020571071 None] Acquiring lock "cinder-quobyte-8c825fd2-5429-4470-89a0-2d997620573c" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:33:06 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1f337f0c-8f0e-4d6d-b3f3-60e583aced69 tempest-GroupSnapshotsTest-1020571071 None] Lock "cinder-quobyte-8c825fd2-5429-4470-89a0-2d997620573c" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:33:06 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1f337f0c-8f0e-4d6d-b3f3-60e583aced69 tempest-GroupSnapshotsTest-1020571071 None] Acquiring lock "cinder-quobyte-c51e94ad-078c-4aae-9031-754e75afc8a6" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:33:06 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1f337f0c-8f0e-4d6d-b3f3-60e583aced69 tempest-GroupSnapshotsTest-1020571071 None] Lock "cinder-quobyte-c51e94ad-078c-4aae-9031-754e75afc8a6" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:33:06 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-1f337f0c-8f0e-4d6d-b3f3-60e583aced69 tempest-GroupSnapshotsTest-1020571071 None] Deleting offline snapshot c51e94ad-078c-4aae-9031-754e75afc8a6 of volume 8c825fd2-5429-4470-89a0-2d997620573c {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 14:33:06 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-1f337f0c-8f0e-4d6d-b3f3-60e583aced69 tempest-GroupSnapshotsTest-1020571071 None] snapshot_file for this snap is: volume-8c825fd2-5429-4470-89a0-2d997620573c.c51e94ad-078c-4aae-9031-754e75afc8a6 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 14:33:06 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf3c3ef-61a6-4923-85ab-6a206a54bb0f]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:33:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1f337f0c-8f0e-4d6d-b3f3-60e583aced69 tempest-GroupSnapshotsTest-1020571071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8c825fd2-5429-4470-89a0-2d997620573c.c51e94ad-078c-4aae-9031-754e75afc8a6 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:33:07 devstack sudo[89926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8c825fd2-5429-4470-89a0-2d997620573c.c51e94ad-078c-4aae-9031-754e75afc8a6
Jul 09 14:33:07 devstack sudo[89926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:33:07 devstack sudo[89924]: pam_unix(sudo:session): session closed for user root
Jul 09 14:33:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-bc0d567a-d1bd-410e-b1ab-d4808d1c783f tempest-VolumesAdminNegativeTest-1231229856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 1.436s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:33:07 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-bc0d567a-d1bd-410e-b1ab-d4808d1c783f tempest-VolumesAdminNegativeTest-1231229856 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:33:07 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-bc0d567a-d1bd-410e-b1ab-d4808d1c783f tempest-VolumesAdminNegativeTest-1231229856 None] Deleted volume successfully.
Jul 09 14:33:07 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-bc0d567a-d1bd-410e-b1ab-d4808d1c783f tempest-VolumesAdminNegativeTest-1231229856 None] Lock "cinder-9d5a5545-3fd5-4baf-8cac-51dae52d12c0-delete_volume" released by "delete_volume" :: held 5.565s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:33:08 devstack sudo[89926]: pam_unix(sudo:session): session closed for user root
Jul 09 14:33:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1f337f0c-8f0e-4d6d-b3f3-60e583aced69 tempest-GroupSnapshotsTest-1020571071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8c825fd2-5429-4470-89a0-2d997620573c.c51e94ad-078c-4aae-9031-754e75afc8a6" returned: 0 in 1.529s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:33:08 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-1f337f0c-8f0e-4d6d-b3f3-60e583aced69 tempest-GroupSnapshotsTest-1020571071 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c825fd2-5429-4470-89a0-2d997620573c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 14:33:08 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a3745c5-5aaa-4656-a711-2b15c6d2fdf4]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:33:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1f337f0c-8f0e-4d6d-b3f3-60e583aced69 tempest-GroupSnapshotsTest-1020571071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8c825fd2-5429-4470-89a0-2d997620573c {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:33:08 devstack sudo[89934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8c825fd2-5429-4470-89a0-2d997620573c
Jul 09 14:33:08 devstack sudo[89934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:33:09 devstack sudo[89934]: pam_unix(sudo:session): session closed for user root
Jul 09 14:33:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1f337f0c-8f0e-4d6d-b3f3-60e583aced69 tempest-GroupSnapshotsTest-1020571071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8c825fd2-5429-4470-89a0-2d997620573c" returned: 0 in 0.874s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:33:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1f337f0c-8f0e-4d6d-b3f3-60e583aced69 tempest-GroupSnapshotsTest-1020571071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8c825fd2-5429-4470-89a0-2d997620573c.c51e94ad-078c-4aae-9031-754e75afc8a6 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:33:09 devstack sudo[89947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8c825fd2-5429-4470-89a0-2d997620573c.c51e94ad-078c-4aae-9031-754e75afc8a6
Jul 09 14:33:09 devstack sudo[89947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:33:10 devstack sudo[89947]: pam_unix(sudo:session): session closed for user root
Jul 09 14:33:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1f337f0c-8f0e-4d6d-b3f3-60e583aced69 tempest-GroupSnapshotsTest-1020571071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8c825fd2-5429-4470-89a0-2d997620573c.c51e94ad-078c-4aae-9031-754e75afc8a6" returned: 0 in 1.684s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:33:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1f337f0c-8f0e-4d6d-b3f3-60e583aced69 tempest-GroupSnapshotsTest-1020571071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8c825fd2-5429-4470-89a0-2d997620573c.c51e94ad-078c-4aae-9031-754e75afc8a6 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:33:10 devstack sudo[89969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8c825fd2-5429-4470-89a0-2d997620573c.c51e94ad-078c-4aae-9031-754e75afc8a6
Jul 09 14:33:10 devstack sudo[89969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:33:11 devstack sudo[89969]: pam_unix(sudo:session): session closed for user root
Jul 09 14:33:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1f337f0c-8f0e-4d6d-b3f3-60e583aced69 tempest-GroupSnapshotsTest-1020571071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8c825fd2-5429-4470-89a0-2d997620573c.c51e94ad-078c-4aae-9031-754e75afc8a6" returned: 0 in 1.090s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:33:11 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1f337f0c-8f0e-4d6d-b3f3-60e583aced69 tempest-GroupSnapshotsTest-1020571071 None] Lock "cinder-quobyte-c51e94ad-078c-4aae-9031-754e75afc8a6" released by "_delete_snapshot" :: held 5.333s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:33:11 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1f337f0c-8f0e-4d6d-b3f3-60e583aced69 tempest-GroupSnapshotsTest-1020571071 None] Lock "cinder-quobyte-8c825fd2-5429-4470-89a0-2d997620573c" released by "delete_snapshot" :: held 5.391s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:33:12 devstack cinder-volume[87230]: WARNING cinder.quota [None req-1f337f0c-8f0e-4d6d-b3f3-60e583aced69 tempest-GroupSnapshotsTest-1020571071 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1732337197 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1732337197, it is now deprecated. Please use the default quota class for default quota.
Jul 09 14:33:12 devstack cinder-volume[87230]: WARNING cinder.quota [None req-1f337f0c-8f0e-4d6d-b3f3-60e583aced69 tempest-GroupSnapshotsTest-1020571071 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1732337197 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1732337197, it is now deprecated. Please use the default quota class for default quota.
Jul 09 14:33:12 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-1f337f0c-8f0e-4d6d-b3f3-60e583aced69 tempest-GroupSnapshotsTest-1020571071 None] Created reservations ['08f2d2ba-a283-43dc-9025-76de2547e104', 'cedc6e0a-3adc-4e3d-89da-0c2df4e42698', 'b418a745-e8f6-49fa-b291-5e4c27d3b2ec', 'fe9e6370-0a6e-4663-91b3-2c9ba3c07b80'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:33:12 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-1f337f0c-8f0e-4d6d-b3f3-60e583aced69 tempest-GroupSnapshotsTest-1020571071 None] Created reservations ['24647409-a950-468b-bf0d-ff30508a942f', '67a1a1d8-6e2a-4b8c-9abc-fd7788a45c31', '52148dae-7cdc-431a-89e8-c9dba9be0fd5', '5d56fd30-df1c-4647-b19f-dbd42254a566'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:33:12 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-1f337f0c-8f0e-4d6d-b3f3-60e583aced69 tempest-GroupSnapshotsTest-1020571071 None] group_snapshot e5180bb0-29f9-499a-aa7a-846542950558: deleted successfully
Jul 09 14:33:12 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a29522f5-1fea-4505-b179-7725e68ddfff tempest-GroupSnapshotsTest-1020571071 None] Acquiring lock "cinder-quobyte-8c825fd2-5429-4470-89a0-2d997620573c" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:33:12 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a29522f5-1fea-4505-b179-7725e68ddfff tempest-GroupSnapshotsTest-1020571071 None] Lock "cinder-quobyte-8c825fd2-5429-4470-89a0-2d997620573c" acquired by "delete_volume" :: waited 0.023s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:33:13 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[454f0dfe-7eee-4d41-9424-5aa686d1ac98]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:33:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a29522f5-1fea-4505-b179-7725e68ddfff tempest-GroupSnapshotsTest-1020571071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8c825fd2-5429-4470-89a0-2d997620573c {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:33:13 devstack sudo[90002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8c825fd2-5429-4470-89a0-2d997620573c
Jul 09 14:33:13 devstack sudo[90002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:33:13 devstack sudo[90002]: pam_unix(sudo:session): session closed for user root
Jul 09 14:33:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a29522f5-1fea-4505-b179-7725e68ddfff tempest-GroupSnapshotsTest-1020571071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8c825fd2-5429-4470-89a0-2d997620573c" returned: 0 in 0.787s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:33:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a29522f5-1fea-4505-b179-7725e68ddfff tempest-GroupSnapshotsTest-1020571071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8c825fd2-5429-4470-89a0-2d997620573c {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:33:13 devstack sudo[90007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8c825fd2-5429-4470-89a0-2d997620573c
Jul 09 14:33:13 devstack sudo[90007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:33:14 devstack sudo[90007]: pam_unix(sudo:session): session closed for user root
Jul 09 14:33:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a29522f5-1fea-4505-b179-7725e68ddfff tempest-GroupSnapshotsTest-1020571071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8c825fd2-5429-4470-89a0-2d997620573c" returned: 0 in 0.646s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:33:14 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a29522f5-1fea-4505-b179-7725e68ddfff tempest-GroupSnapshotsTest-1020571071 None] Lock "cinder-quobyte-8c825fd2-5429-4470-89a0-2d997620573c" released by "delete_volume" :: held 1.522s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:33:14 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a29522f5-1fea-4505-b179-7725e68ddfff tempest-GroupSnapshotsTest-1020571071 None] Acquiring lock "cinder-quobyte-a4d2ec7d-39f2-4302-8cac-60563929012e" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:33:14 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a29522f5-1fea-4505-b179-7725e68ddfff tempest-GroupSnapshotsTest-1020571071 None] Lock "cinder-quobyte-a4d2ec7d-39f2-4302-8cac-60563929012e" acquired by "delete_volume" :: waited 0.014s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:33:14 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db06991-5516-4482-a537-c10219350423]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:33:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a29522f5-1fea-4505-b179-7725e68ddfff tempest-GroupSnapshotsTest-1020571071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a4d2ec7d-39f2-4302-8cac-60563929012e {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:33:14 devstack sudo[90010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a4d2ec7d-39f2-4302-8cac-60563929012e
Jul 09 14:33:14 devstack sudo[90010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:33:15 devstack sudo[90010]: pam_unix(sudo:session): session closed for user root
Jul 09 14:33:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a29522f5-1fea-4505-b179-7725e68ddfff tempest-GroupSnapshotsTest-1020571071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a4d2ec7d-39f2-4302-8cac-60563929012e" returned: 0 in 0.755s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:33:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a29522f5-1fea-4505-b179-7725e68ddfff tempest-GroupSnapshotsTest-1020571071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a4d2ec7d-39f2-4302-8cac-60563929012e {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:33:15 devstack sudo[90016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a4d2ec7d-39f2-4302-8cac-60563929012e
Jul 09 14:33:15 devstack sudo[90016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:33:16 devstack sudo[90016]: pam_unix(sudo:session): session closed for user root
Jul 09 14:33:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a29522f5-1fea-4505-b179-7725e68ddfff tempest-GroupSnapshotsTest-1020571071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a4d2ec7d-39f2-4302-8cac-60563929012e" returned: 0 in 0.796s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:33:16 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a29522f5-1fea-4505-b179-7725e68ddfff tempest-GroupSnapshotsTest-1020571071 None] Lock "cinder-quobyte-a4d2ec7d-39f2-4302-8cac-60563929012e" released by "delete_volume" :: held 1.605s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:33:16 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-a29522f5-1fea-4505-b179-7725e68ddfff tempest-GroupSnapshotsTest-1020571071 None] Created reservations ['d0139ba6-80d9-440e-924f-efe1a316d5ad'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:33:16 devstack cinder-volume[87230]: WARNING cinder.quota [None req-a29522f5-1fea-4505-b179-7725e68ddfff tempest-GroupSnapshotsTest-1020571071 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1732337197 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1732337197, it is now deprecated. Please use the default quota class for default quota.
Jul 09 14:33:16 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-a29522f5-1fea-4505-b179-7725e68ddfff tempest-GroupSnapshotsTest-1020571071 None] Created reservations ['e795359a-0b48-4dd4-b114-dfc375b101c7', '6bf7515b-f026-4a87-ba77-5221e4786f3c', '7ccca29a-3217-4f77-8115-2f5fafb909da', '830446de-9835-43e8-9028-5ab35c44172c'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:33:16 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-a29522f5-1fea-4505-b179-7725e68ddfff tempest-GroupSnapshotsTest-1020571071 None] Created reservations ['9bc0ac6b-a74c-4f1a-92fd-c3e33e2fd8ee', 'a57a72d7-5b6a-4040-acda-59bdb90d91a5', 'e78b1e78-b244-4492-b131-88bc803e736c', '52080373-1166-4c8a-8289-877e454411d5'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:33:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a29522f5-1fea-4505-b179-7725e68ddfff tempest-GroupSnapshotsTest-1020571071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:33:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a29522f5-1fea-4505-b179-7725e68ddfff tempest-GroupSnapshotsTest-1020571071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:33:16 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a29522f5-1fea-4505-b179-7725e68ddfff tempest-GroupSnapshotsTest-1020571071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:33:16 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a29522f5-1fea-4505-b179-7725e68ddfff tempest-GroupSnapshotsTest-1020571071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:33:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a29522f5-1fea-4505-b179-7725e68ddfff tempest-GroupSnapshotsTest-1020571071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:33:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a29522f5-1fea-4505-b179-7725e68ddfff tempest-GroupSnapshotsTest-1020571071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:33:16 devstack sudo[90020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:33:16 devstack sudo[90020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:33:17 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-5c200ce7-8832-4a5f-99d1-b2fbf9973144 tempest-GroupSnapshotsTest-1020571071 None] Group tempest-GroupSnapshotsTest-Group-414553554: creating
Jul 09 14:33:17 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-5c200ce7-8832-4a5f-99d1-b2fbf9973144 tempest-GroupSnapshotsTest-1020571071 None] Group tempest-GroupSnapshotsTest-Group-414553554: created successfully
Jul 09 14:33:17 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-5c200ce7-8832-4a5f-99d1-b2fbf9973144 tempest-GroupSnapshotsTest-1020571071 None] Create group completed successfully.
Jul 09 14:33:17 devstack sudo[90020]: pam_unix(sudo:session): session closed for user root
Jul 09 14:33:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a29522f5-1fea-4505-b179-7725e68ddfff tempest-GroupSnapshotsTest-1020571071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 1.177s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:33:17 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-a29522f5-1fea-4505-b179-7725e68ddfff tempest-GroupSnapshotsTest-1020571071 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:33:17 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-a29522f5-1fea-4505-b179-7725e68ddfff tempest-GroupSnapshotsTest-1020571071 None] Delete group completed successfully.
Jul 09 14:33:19 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-734ca48b-b668-473a-a84a-3d2d13eaab6f tempest-GroupSnapshotsTest-1020571071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:33:19 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-734ca48b-b668-473a-a84a-3d2d13eaab6f tempest-GroupSnapshotsTest-1020571071 None] Flow 'volume_create_manager' (72fd4e2e-1b21-4be9-be23-9c0b1e5aad0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:33:19 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-734ca48b-b668-473a-a84a-3d2d13eaab6f tempest-GroupSnapshotsTest-1020571071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47427e03-16f2-43bf-9899-c07284caa7fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:33:19 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-734ca48b-b668-473a-a84a-3d2d13eaab6f tempest-GroupSnapshotsTest-1020571071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47427e03-16f2-43bf-9899-c07284caa7fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:33:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-271091103',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7e81f6b1-8e2e-4ca1-af61-fdc30a701434,host='devstack@QuobyteHD#QuobyteHD',id=98805bab-ba7b-44dd-a235-42efd9e0b30c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='531740d4ee6f4b94a699d04a7eddb233',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:33:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:33:19Z,use_quota=True,user_id='6438d0684a2f482489697f50bffe8f8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cc9fb84-557e-42fe-b1b1-0458d5165bbd),volume_type_id=3cc9fb84-557e-42fe-b1b1-0458d5165bbd)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:33:19 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-734ca48b-b668-473a-a84a-3d2d13eaab6f tempest-GroupSnapshotsTest-1020571071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (484df0d8-a59c-451a-b2ee-28be7e22a9f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:33:19 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-734ca48b-b668-473a-a84a-3d2d13eaab6f tempest-GroupSnapshotsTest-1020571071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (484df0d8-a59c-451a-b2ee-28be7e22a9f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:33:19 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-734ca48b-b668-473a-a84a-3d2d13eaab6f tempest-GroupSnapshotsTest-1020571071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2089b96-b3d8-4ec4-b14a-0dcc182f9ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:33:19 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-734ca48b-b668-473a-a84a-3d2d13eaab6f tempest-GroupSnapshotsTest-1020571071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2089b96-b3d8-4ec4-b14a-0dcc182f9ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98805bab-ba7b-44dd-a235-42efd9e0b30c', 'volume_name': 'volume-98805bab-ba7b-44dd-a235-42efd9e0b30c', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:33:19 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-734ca48b-b668-473a-a84a-3d2d13eaab6f tempest-GroupSnapshotsTest-1020571071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2308634e-0eb9-454c-9924-e6452a4233e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:33:19 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-734ca48b-b668-473a-a84a-3d2d13eaab6f tempest-GroupSnapshotsTest-1020571071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2308634e-0eb9-454c-9924-e6452a4233e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:33:19 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-734ca48b-b668-473a-a84a-3d2d13eaab6f tempest-GroupSnapshotsTest-1020571071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05bd9495-e66f-4761-83bb-4270f5288801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:33:19 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-734ca48b-b668-473a-a84a-3d2d13eaab6f tempest-GroupSnapshotsTest-1020571071 None] Volume 98805bab-ba7b-44dd-a235-42efd9e0b30c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98805bab-ba7b-44dd-a235-42efd9e0b30c', 'volume_size': 1}
Jul 09 14:33:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-734ca48b-b668-473a-a84a-3d2d13eaab6f tempest-GroupSnapshotsTest-1020571071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:33:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-734ca48b-b668-473a-a84a-3d2d13eaab6f tempest-GroupSnapshotsTest-1020571071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:33:19 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-734ca48b-b668-473a-a84a-3d2d13eaab6f tempest-GroupSnapshotsTest-1020571071 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=7e81f6b1-8e2e-4ca1-af61-fdc30a701434,created_at=2026-07-09T12:33:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-271091103',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7e81f6b1-8e2e-4ca1-af61-fdc30a701434,host='devstack@QuobyteHD#QuobyteHD',id=98805bab-ba7b-44dd-a235-42efd9e0b30c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='531740d4ee6f4b94a699d04a7eddb233',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:33:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:33:19Z,use_quota=True,user_id='6438d0684a2f482489697f50bffe8f8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cc9fb84-557e-42fe-b1b1-0458d5165bbd),volume_type_id=3cc9fb84-557e-42fe-b1b1-0458d5165bbd)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:33:19 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-734ca48b-b668-473a-a84a-3d2d13eaab6f tempest-GroupSnapshotsTest-1020571071 None] Creating volume 98805bab-ba7b-44dd-a235-42efd9e0b30c {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:33:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-734ca48b-b668-473a-a84a-3d2d13eaab6f tempest-GroupSnapshotsTest-1020571071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:33:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-734ca48b-b668-473a-a84a-3d2d13eaab6f tempest-GroupSnapshotsTest-1020571071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:33:19 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-734ca48b-b668-473a-a84a-3d2d13eaab6f tempest-GroupSnapshotsTest-1020571071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:33:19 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-734ca48b-b668-473a-a84a-3d2d13eaab6f tempest-GroupSnapshotsTest-1020571071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:33:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-734ca48b-b668-473a-a84a-3d2d13eaab6f tempest-GroupSnapshotsTest-1020571071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:33:19 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-734ca48b-b668-473a-a84a-3d2d13eaab6f tempest-GroupSnapshotsTest-1020571071 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:33:19 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-734ca48b-b668-473a-a84a-3d2d13eaab6f tempest-GroupSnapshotsTest-1020571071 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:33:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-734ca48b-b668-473a-a84a-3d2d13eaab6f tempest-GroupSnapshotsTest-1020571071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-98805bab-ba7b-44dd-a235-42efd9e0b30c 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:33:19 devstack sudo[90048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-98805bab-ba7b-44dd-a235-42efd9e0b30c 1073741824
Jul 09 14:33:19 devstack sudo[90048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:33:20 devstack sudo[90048]: pam_unix(sudo:session): session closed for user root
Jul 09 14:33:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-734ca48b-b668-473a-a84a-3d2d13eaab6f tempest-GroupSnapshotsTest-1020571071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-98805bab-ba7b-44dd-a235-42efd9e0b30c 1073741824" returned: 0 in 0.955s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:33:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-734ca48b-b668-473a-a84a-3d2d13eaab6f tempest-GroupSnapshotsTest-1020571071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-98805bab-ba7b-44dd-a235-42efd9e0b30c {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:33:20 devstack sudo[90055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-98805bab-ba7b-44dd-a235-42efd9e0b30c
Jul 09 14:33:20 devstack sudo[90055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:33:20 devstack sudo[90055]: pam_unix(sudo:session): session closed for user root
Jul 09 14:33:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-734ca48b-b668-473a-a84a-3d2d13eaab6f tempest-GroupSnapshotsTest-1020571071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-98805bab-ba7b-44dd-a235-42efd9e0b30c" returned: 0 in 0.645s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:33:20 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-734ca48b-b668-473a-a84a-3d2d13eaab6f tempest-GroupSnapshotsTest-1020571071 None] <== create_volume: return (1649ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:33:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-734ca48b-b668-473a-a84a-3d2d13eaab6f tempest-GroupSnapshotsTest-1020571071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.652s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:33:20 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-734ca48b-b668-473a-a84a-3d2d13eaab6f tempest-GroupSnapshotsTest-1020571071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05bd9495-e66f-4761-83bb-4270f5288801) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98805bab-ba7b-44dd-a235-42efd9e0b30c', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:33:20 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-734ca48b-b668-473a-a84a-3d2d13eaab6f tempest-GroupSnapshotsTest-1020571071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (580aa80a-b4d7-416e-98c4-2462ac5836c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:33:20 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-734ca48b-b668-473a-a84a-3d2d13eaab6f tempest-GroupSnapshotsTest-1020571071 None] Volume volume-98805bab-ba7b-44dd-a235-42efd9e0b30c (98805bab-ba7b-44dd-a235-42efd9e0b30c): created successfully
Jul 09 14:33:20 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-734ca48b-b668-473a-a84a-3d2d13eaab6f tempest-GroupSnapshotsTest-1020571071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (580aa80a-b4d7-416e-98c4-2462ac5836c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:33:20 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-734ca48b-b668-473a-a84a-3d2d13eaab6f tempest-GroupSnapshotsTest-1020571071 None] Flow 'volume_create_manager' (72fd4e2e-1b21-4be9-be23-9c0b1e5aad0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:33:20 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-734ca48b-b668-473a-a84a-3d2d13eaab6f tempest-GroupSnapshotsTest-1020571071 None] Created volume successfully.
Jul 09 14:33:21 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-87a0577c-8728-4b55-8f19-4bfce3a7add6 tempest-GroupSnapshotsTest-1020571071 None] GroupSnapshot d7dd77c0-b11a-4661-966c-f597c4b7e9d4: creating.
Jul 09 14:33:21 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-87a0577c-8728-4b55-8f19-4bfce3a7add6 tempest-GroupSnapshotsTest-1020571071 None] Group snapshot d7dd77c0-b11a-4661-966c-f597c4b7e9d4: creating. {{(pid=87230) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jul 09 14:33:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-87a0577c-8728-4b55-8f19-4bfce3a7add6 tempest-GroupSnapshotsTest-1020571071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:33:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-87a0577c-8728-4b55-8f19-4bfce3a7add6 tempest-GroupSnapshotsTest-1020571071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:33:21 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-87a0577c-8728-4b55-8f19-4bfce3a7add6 tempest-GroupSnapshotsTest-1020571071 None] Creating offline snapshot a4fc9b43-1381-42cd-932f-e9a467ca157b of volume 98805bab-ba7b-44dd-a235-42efd9e0b30c {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 14:33:21 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c1d447-b090-4944-8bfa-886befa53d94]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:33:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-87a0577c-8728-4b55-8f19-4bfce3a7add6 tempest-GroupSnapshotsTest-1020571071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-98805bab-ba7b-44dd-a235-42efd9e0b30c {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:33:21 devstack sudo[90061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-98805bab-ba7b-44dd-a235-42efd9e0b30c
Jul 09 14:33:21 devstack sudo[90061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:33:22 devstack sudo[90061]: pam_unix(sudo:session): session closed for user root
Jul 09 14:33:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-87a0577c-8728-4b55-8f19-4bfce3a7add6 tempest-GroupSnapshotsTest-1020571071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-98805bab-ba7b-44dd-a235-42efd9e0b30c" returned: 0 in 0.868s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:33:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-87a0577c-8728-4b55-8f19-4bfce3a7add6 tempest-GroupSnapshotsTest-1020571071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-98805bab-ba7b-44dd-a235-42efd9e0b30c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-98805bab-ba7b-44dd-a235-42efd9e0b30c.a4fc9b43-1381-42cd-932f-e9a467ca157b 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:33:22 devstack sudo[90068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-98805bab-ba7b-44dd-a235-42efd9e0b30c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-98805bab-ba7b-44dd-a235-42efd9e0b30c.a4fc9b43-1381-42cd-932f-e9a467ca157b 1G
Jul 09 14:33:22 devstack sudo[90068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:33:23 devstack sudo[90068]: pam_unix(sudo:session): session closed for user root
Jul 09 14:33:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-87a0577c-8728-4b55-8f19-4bfce3a7add6 tempest-GroupSnapshotsTest-1020571071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-98805bab-ba7b-44dd-a235-42efd9e0b30c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-98805bab-ba7b-44dd-a235-42efd9e0b30c.a4fc9b43-1381-42cd-932f-e9a467ca157b 1G" returned: 0 in 0.897s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:33:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-87a0577c-8728-4b55-8f19-4bfce3a7add6 tempest-GroupSnapshotsTest-1020571071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98805bab-ba7b-44dd-a235-42efd9e0b30c -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-98805bab-ba7b-44dd-a235-42efd9e0b30c.a4fc9b43-1381-42cd-932f-e9a467ca157b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:33:23 devstack sudo[90075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98805bab-ba7b-44dd-a235-42efd9e0b30c -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-98805bab-ba7b-44dd-a235-42efd9e0b30c.a4fc9b43-1381-42cd-932f-e9a467ca157b
Jul 09 14:33:23 devstack sudo[90075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:33:24 devstack sudo[90075]: pam_unix(sudo:session): session closed for user root
Jul 09 14:33:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-87a0577c-8728-4b55-8f19-4bfce3a7add6 tempest-GroupSnapshotsTest-1020571071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98805bab-ba7b-44dd-a235-42efd9e0b30c -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-98805bab-ba7b-44dd-a235-42efd9e0b30c.a4fc9b43-1381-42cd-932f-e9a467ca157b" returned: 0 in 0.824s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:33:24 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-87a0577c-8728-4b55-8f19-4bfce3a7add6 tempest-GroupSnapshotsTest-1020571071 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-98805bab-ba7b-44dd-a235-42efd9e0b30c.a4fc9b43-1381-42cd-932f-e9a467ca157b is being set with open permissions: ugo+rw: NotImplementedError
Jul 09 14:33:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-87a0577c-8728-4b55-8f19-4bfce3a7add6 tempest-GroupSnapshotsTest-1020571071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-98805bab-ba7b-44dd-a235-42efd9e0b30c.a4fc9b43-1381-42cd-932f-e9a467ca157b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:33:24 devstack sudo[90080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-98805bab-ba7b-44dd-a235-42efd9e0b30c.a4fc9b43-1381-42cd-932f-e9a467ca157b
Jul 09 14:33:24 devstack sudo[90080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:33:25 devstack sudo[90080]: pam_unix(sudo:session): session closed for user root
Jul 09 14:33:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-87a0577c-8728-4b55-8f19-4bfce3a7add6 tempest-GroupSnapshotsTest-1020571071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-98805bab-ba7b-44dd-a235-42efd9e0b30c.a4fc9b43-1381-42cd-932f-e9a467ca157b" returned: 0 in 0.787s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:33:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-87a0577c-8728-4b55-8f19-4bfce3a7add6 tempest-GroupSnapshotsTest-1020571071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-98805bab-ba7b-44dd-a235-42efd9e0b30c.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:33:25 devstack sudo[90086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-98805bab-ba7b-44dd-a235-42efd9e0b30c.info
Jul 09 14:33:25 devstack sudo[90086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:33:25 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-c67a5946-ab18-4e7d-bde1-61d90f8c9972 tempest-AttachVolumeNegativeTest-594851243 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:33:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c67a5946-ab18-4e7d-bde1-61d90f8c9972 tempest-AttachVolumeNegativeTest-594851243 None] Flow 'volume_create_manager' (de328fda-51a6-4211-8043-9c2e02fa165f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:33:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c67a5946-ab18-4e7d-bde1-61d90f8c9972 tempest-AttachVolumeNegativeTest-594851243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a296de7-1d9d-45b0-81ef-7dec597254c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:33:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c67a5946-ab18-4e7d-bde1-61d90f8c9972 tempest-AttachVolumeNegativeTest-594851243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a296de7-1d9d-45b0-81ef-7dec597254c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:33:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-808068009',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7468e7e6-2849-45eb-a656-10c997e948fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e12f6e1be054416827515b9bb0da885',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:33:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:33:26Z,use_quota=True,user_id='9c9a26714c9349c2b8e073697960118b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:33:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c67a5946-ab18-4e7d-bde1-61d90f8c9972 tempest-AttachVolumeNegativeTest-594851243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d5caba8-17e8-40e9-8512-0cca19d33c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:33:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c67a5946-ab18-4e7d-bde1-61d90f8c9972 tempest-AttachVolumeNegativeTest-594851243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d5caba8-17e8-40e9-8512-0cca19d33c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:33:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c67a5946-ab18-4e7d-bde1-61d90f8c9972 tempest-AttachVolumeNegativeTest-594851243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18846ff7-1898-4ee4-9862-f8b7a299624c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:33:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c67a5946-ab18-4e7d-bde1-61d90f8c9972 tempest-AttachVolumeNegativeTest-594851243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18846ff7-1898-4ee4-9862-f8b7a299624c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7468e7e6-2849-45eb-a656-10c997e948fc', 'volume_name': 'volume-7468e7e6-2849-45eb-a656-10c997e948fc', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:33:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c67a5946-ab18-4e7d-bde1-61d90f8c9972 tempest-AttachVolumeNegativeTest-594851243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e32ebbaf-2afd-4bb6-8922-f7af865a43ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:33:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c67a5946-ab18-4e7d-bde1-61d90f8c9972 tempest-AttachVolumeNegativeTest-594851243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e32ebbaf-2afd-4bb6-8922-f7af865a43ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:33:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c67a5946-ab18-4e7d-bde1-61d90f8c9972 tempest-AttachVolumeNegativeTest-594851243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01c04b27-f078-41e1-ba29-a1f05ff3ee7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:33:25 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-c67a5946-ab18-4e7d-bde1-61d90f8c9972 tempest-AttachVolumeNegativeTest-594851243 None] Volume 7468e7e6-2849-45eb-a656-10c997e948fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7468e7e6-2849-45eb-a656-10c997e948fc', 'volume_size': 1}
Jul 09 14:33:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c67a5946-ab18-4e7d-bde1-61d90f8c9972 tempest-AttachVolumeNegativeTest-594851243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:33:26 devstack sudo[90086]: pam_unix(sudo:session): session closed for user root
Jul 09 14:33:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-87a0577c-8728-4b55-8f19-4bfce3a7add6 tempest-GroupSnapshotsTest-1020571071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-98805bab-ba7b-44dd-a235-42efd9e0b30c.info" returned: 0 in 0.919s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:33:26 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-87a0577c-8728-4b55-8f19-4bfce3a7add6 tempest-GroupSnapshotsTest-1020571071 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-98805bab-ba7b-44dd-a235-42efd9e0b30c.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 09 14:33:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-87a0577c-8728-4b55-8f19-4bfce3a7add6 tempest-GroupSnapshotsTest-1020571071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-98805bab-ba7b-44dd-a235-42efd9e0b30c.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:33:26 devstack sudo[90089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-98805bab-ba7b-44dd-a235-42efd9e0b30c.info
Jul 09 14:33:26 devstack sudo[90089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:33:26 devstack sudo[90089]: pam_unix(sudo:session): session closed for user root
Jul 09 14:33:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-87a0577c-8728-4b55-8f19-4bfce3a7add6 tempest-GroupSnapshotsTest-1020571071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-98805bab-ba7b-44dd-a235-42efd9e0b30c.info" returned: 0 in 0.801s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:33:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-87a0577c-8728-4b55-8f19-4bfce3a7add6 tempest-GroupSnapshotsTest-1020571071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.204s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:33:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c67a5946-ab18-4e7d-bde1-61d90f8c9972 tempest-AttachVolumeNegativeTest-594851243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.102s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:33:26 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-c67a5946-ab18-4e7d-bde1-61d90f8c9972 tempest-AttachVolumeNegativeTest-594851243 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:33:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-808068009',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7468e7e6-2849-45eb-a656-10c997e948fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e12f6e1be054416827515b9bb0da885',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:33:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:33:26Z,use_quota=True,user_id='9c9a26714c9349c2b8e073697960118b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:33:26 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-c67a5946-ab18-4e7d-bde1-61d90f8c9972 tempest-AttachVolumeNegativeTest-594851243 None] Creating volume 7468e7e6-2849-45eb-a656-10c997e948fc {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:33:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c67a5946-ab18-4e7d-bde1-61d90f8c9972 tempest-AttachVolumeNegativeTest-594851243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:33:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c67a5946-ab18-4e7d-bde1-61d90f8c9972 tempest-AttachVolumeNegativeTest-594851243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:33:26 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-c67a5946-ab18-4e7d-bde1-61d90f8c9972 tempest-AttachVolumeNegativeTest-594851243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:33:26 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-c67a5946-ab18-4e7d-bde1-61d90f8c9972 tempest-AttachVolumeNegativeTest-594851243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:33:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c67a5946-ab18-4e7d-bde1-61d90f8c9972 tempest-AttachVolumeNegativeTest-594851243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:33:26 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-c67a5946-ab18-4e7d-bde1-61d90f8c9972 tempest-AttachVolumeNegativeTest-594851243 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:33:26 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-c67a5946-ab18-4e7d-bde1-61d90f8c9972 tempest-AttachVolumeNegativeTest-594851243 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:33:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c67a5946-ab18-4e7d-bde1-61d90f8c9972 tempest-AttachVolumeNegativeTest-594851243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7468e7e6-2849-45eb-a656-10c997e948fc 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:33:26 devstack sudo[90092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7468e7e6-2849-45eb-a656-10c997e948fc 1073741824
Jul 09 14:33:26 devstack sudo[90092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:33:27 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-87a0577c-8728-4b55-8f19-4bfce3a7add6 tempest-GroupSnapshotsTest-1020571071 None] group_snapshot d7dd77c0-b11a-4661-966c-f597c4b7e9d4: created successfully
Jul 09 14:33:27 devstack sudo[90092]: pam_unix(sudo:session): session closed for user root
Jul 09 14:33:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c67a5946-ab18-4e7d-bde1-61d90f8c9972 tempest-AttachVolumeNegativeTest-594851243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7468e7e6-2849-45eb-a656-10c997e948fc 1073741824" returned: 0 in 0.964s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:33:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c67a5946-ab18-4e7d-bde1-61d90f8c9972 tempest-AttachVolumeNegativeTest-594851243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7468e7e6-2849-45eb-a656-10c997e948fc {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:33:27 devstack sudo[90099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7468e7e6-2849-45eb-a656-10c997e948fc
Jul 09 14:33:27 devstack sudo[90099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:33:28 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-d5d42e46-26e7-422a-a889-e3f1dfac2e99 tempest-GroupSnapshotsTest-1020571071 None] group_snapshot d7dd77c0-b11a-4661-966c-f597c4b7e9d4: deleting
Jul 09 14:33:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d5d42e46-26e7-422a-a889-e3f1dfac2e99 tempest-GroupSnapshotsTest-1020571071 None] group_snapshot d7dd77c0-b11a-4661-966c-f597c4b7e9d4: deleting {{(pid=87230) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jul 09 14:33:28 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d5d42e46-26e7-422a-a889-e3f1dfac2e99 tempest-GroupSnapshotsTest-1020571071 None] Acquiring lock "cinder-quobyte-98805bab-ba7b-44dd-a235-42efd9e0b30c" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:33:28 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d5d42e46-26e7-422a-a889-e3f1dfac2e99 tempest-GroupSnapshotsTest-1020571071 None] Lock "cinder-quobyte-98805bab-ba7b-44dd-a235-42efd9e0b30c" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:33:28 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d5d42e46-26e7-422a-a889-e3f1dfac2e99 tempest-GroupSnapshotsTest-1020571071 None] Acquiring lock "cinder-quobyte-a4fc9b43-1381-42cd-932f-e9a467ca157b" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:33:28 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d5d42e46-26e7-422a-a889-e3f1dfac2e99 tempest-GroupSnapshotsTest-1020571071 None] Lock "cinder-quobyte-a4fc9b43-1381-42cd-932f-e9a467ca157b" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:33:28 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-d5d42e46-26e7-422a-a889-e3f1dfac2e99 tempest-GroupSnapshotsTest-1020571071 None] Deleting offline snapshot a4fc9b43-1381-42cd-932f-e9a467ca157b of volume 98805bab-ba7b-44dd-a235-42efd9e0b30c {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 14:33:28 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-d5d42e46-26e7-422a-a889-e3f1dfac2e99 tempest-GroupSnapshotsTest-1020571071 None] snapshot_file for this snap is: volume-98805bab-ba7b-44dd-a235-42efd9e0b30c.a4fc9b43-1381-42cd-932f-e9a467ca157b {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 14:33:28 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[8142d068-6ac6-417b-8f03-ce59a359d1ef]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:33:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d5d42e46-26e7-422a-a889-e3f1dfac2e99 tempest-GroupSnapshotsTest-1020571071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-98805bab-ba7b-44dd-a235-42efd9e0b30c.a4fc9b43-1381-42cd-932f-e9a467ca157b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:33:28 devstack sudo[90103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-98805bab-ba7b-44dd-a235-42efd9e0b30c.a4fc9b43-1381-42cd-932f-e9a467ca157b
Jul 09 14:33:28 devstack sudo[90103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:33:28 devstack sudo[90099]: pam_unix(sudo:session): session closed for user root
Jul 09 14:33:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c67a5946-ab18-4e7d-bde1-61d90f8c9972 tempest-AttachVolumeNegativeTest-594851243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7468e7e6-2849-45eb-a656-10c997e948fc" returned: 0 in 0.825s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:33:28 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-c67a5946-ab18-4e7d-bde1-61d90f8c9972 tempest-AttachVolumeNegativeTest-594851243 None] <== create_volume: return (1835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:33:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c67a5946-ab18-4e7d-bde1-61d90f8c9972 tempest-AttachVolumeNegativeTest-594851243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.841s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:33:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c67a5946-ab18-4e7d-bde1-61d90f8c9972 tempest-AttachVolumeNegativeTest-594851243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01c04b27-f078-41e1-ba29-a1f05ff3ee7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7468e7e6-2849-45eb-a656-10c997e948fc', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:33:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c67a5946-ab18-4e7d-bde1-61d90f8c9972 tempest-AttachVolumeNegativeTest-594851243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6ae1437-381d-4c68-ba21-0147fbd0b07a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:33:28 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-c67a5946-ab18-4e7d-bde1-61d90f8c9972 tempest-AttachVolumeNegativeTest-594851243 None] Volume volume-7468e7e6-2849-45eb-a656-10c997e948fc (7468e7e6-2849-45eb-a656-10c997e948fc): created successfully
Jul 09 14:33:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c67a5946-ab18-4e7d-bde1-61d90f8c9972 tempest-AttachVolumeNegativeTest-594851243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6ae1437-381d-4c68-ba21-0147fbd0b07a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:33:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c67a5946-ab18-4e7d-bde1-61d90f8c9972 tempest-AttachVolumeNegativeTest-594851243 None] Flow 'volume_create_manager' (de328fda-51a6-4211-8043-9c2e02fa165f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:33:28 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-c67a5946-ab18-4e7d-bde1-61d90f8c9972 tempest-AttachVolumeNegativeTest-594851243 None] Created volume successfully.
Jul 09 14:33:29 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-f78d6b12-bbda-4dc5-8532-479ed1561760 tempest-AttachVolumeShelveTestJSON-222680792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:33:29 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f78d6b12-bbda-4dc5-8532-479ed1561760 tempest-AttachVolumeShelveTestJSON-222680792 None] Flow 'volume_create_manager' (b6cd354d-aa3e-462e-a527-5065698f369f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:33:29 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f78d6b12-bbda-4dc5-8532-479ed1561760 tempest-AttachVolumeShelveTestJSON-222680792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a347a6ef-8e48-4338-ace8-c5a7ad0c76f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:33:29 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f78d6b12-bbda-4dc5-8532-479ed1561760 tempest-AttachVolumeShelveTestJSON-222680792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a347a6ef-8e48-4338-ace8-c5a7ad0c76f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:33:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-103557679',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c98db6c6-1c36-4ee4-b260-abadaf61560c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8165cdc8f892483099ff654d9161cf95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:33:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:33:29Z,use_quota=True,user_id='daf2e779db32410db7abe107211f7b54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:33:29 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f78d6b12-bbda-4dc5-8532-479ed1561760 tempest-AttachVolumeShelveTestJSON-222680792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd65be75-700e-4aca-ab28-cbe701a65757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:33:29 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f78d6b12-bbda-4dc5-8532-479ed1561760 tempest-AttachVolumeShelveTestJSON-222680792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd65be75-700e-4aca-ab28-cbe701a65757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:33:29 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f78d6b12-bbda-4dc5-8532-479ed1561760 tempest-AttachVolumeShelveTestJSON-222680792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (514601ff-d224-4899-9eec-52214bd0d480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:33:29 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f78d6b12-bbda-4dc5-8532-479ed1561760 tempest-AttachVolumeShelveTestJSON-222680792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (514601ff-d224-4899-9eec-52214bd0d480) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c98db6c6-1c36-4ee4-b260-abadaf61560c', 'volume_name': 'volume-c98db6c6-1c36-4ee4-b260-abadaf61560c', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:33:29 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f78d6b12-bbda-4dc5-8532-479ed1561760 tempest-AttachVolumeShelveTestJSON-222680792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ee8d2c0-f87f-4781-a458-5ce17379c949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:33:29 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f78d6b12-bbda-4dc5-8532-479ed1561760 tempest-AttachVolumeShelveTestJSON-222680792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ee8d2c0-f87f-4781-a458-5ce17379c949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:33:29 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f78d6b12-bbda-4dc5-8532-479ed1561760 tempest-AttachVolumeShelveTestJSON-222680792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdee2591-7945-43ef-b892-77234af91575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:33:29 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-f78d6b12-bbda-4dc5-8532-479ed1561760 tempest-AttachVolumeShelveTestJSON-222680792 None] Volume c98db6c6-1c36-4ee4-b260-abadaf61560c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c98db6c6-1c36-4ee4-b260-abadaf61560c', 'volume_size': 1}
Jul 09 14:33:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f78d6b12-bbda-4dc5-8532-479ed1561760 tempest-AttachVolumeShelveTestJSON-222680792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:33:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f78d6b12-bbda-4dc5-8532-479ed1561760 tempest-AttachVolumeShelveTestJSON-222680792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:33:29 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f78d6b12-bbda-4dc5-8532-479ed1561760 tempest-AttachVolumeShelveTestJSON-222680792 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:33:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-103557679',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c98db6c6-1c36-4ee4-b260-abadaf61560c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8165cdc8f892483099ff654d9161cf95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:33:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:33:29Z,use_quota=True,user_id='daf2e779db32410db7abe107211f7b54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:33:29 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-f78d6b12-bbda-4dc5-8532-479ed1561760 tempest-AttachVolumeShelveTestJSON-222680792 None] Creating volume c98db6c6-1c36-4ee4-b260-abadaf61560c {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:33:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f78d6b12-bbda-4dc5-8532-479ed1561760 tempest-AttachVolumeShelveTestJSON-222680792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:33:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f78d6b12-bbda-4dc5-8532-479ed1561760 tempest-AttachVolumeShelveTestJSON-222680792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:33:29 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f78d6b12-bbda-4dc5-8532-479ed1561760 tempest-AttachVolumeShelveTestJSON-222680792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:33:29 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f78d6b12-bbda-4dc5-8532-479ed1561760 tempest-AttachVolumeShelveTestJSON-222680792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:33:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f78d6b12-bbda-4dc5-8532-479ed1561760 tempest-AttachVolumeShelveTestJSON-222680792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:33:29 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f78d6b12-bbda-4dc5-8532-479ed1561760 tempest-AttachVolumeShelveTestJSON-222680792 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:33:29 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-f78d6b12-bbda-4dc5-8532-479ed1561760 tempest-AttachVolumeShelveTestJSON-222680792 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:33:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f78d6b12-bbda-4dc5-8532-479ed1561760 tempest-AttachVolumeShelveTestJSON-222680792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-c98db6c6-1c36-4ee4-b260-abadaf61560c 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:33:29 devstack sudo[90103]: pam_unix(sudo:session): session closed for user root
Jul 09 14:33:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d5d42e46-26e7-422a-a889-e3f1dfac2e99 tempest-GroupSnapshotsTest-1020571071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-98805bab-ba7b-44dd-a235-42efd9e0b30c.a4fc9b43-1381-42cd-932f-e9a467ca157b" returned: 0 in 0.934s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:33:29 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-d5d42e46-26e7-422a-a889-e3f1dfac2e99 tempest-GroupSnapshotsTest-1020571071 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-98805bab-ba7b-44dd-a235-42efd9e0b30c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 14:33:29 devstack sudo[90109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-c98db6c6-1c36-4ee4-b260-abadaf61560c 1073741824
Jul 09 14:33:29 devstack sudo[90109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:33:29 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f3514e5-6395-421e-b495-946893e44ed5]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:33:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d5d42e46-26e7-422a-a889-e3f1dfac2e99 tempest-GroupSnapshotsTest-1020571071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-98805bab-ba7b-44dd-a235-42efd9e0b30c {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:33:29 devstack sudo[90111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-98805bab-ba7b-44dd-a235-42efd9e0b30c
Jul 09 14:33:29 devstack sudo[90111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:33:30 devstack sudo[90111]: pam_unix(sudo:session): session closed for user root
Jul 09 14:33:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d5d42e46-26e7-422a-a889-e3f1dfac2e99 tempest-GroupSnapshotsTest-1020571071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-98805bab-ba7b-44dd-a235-42efd9e0b30c" returned: 0 in 0.907s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:33:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d5d42e46-26e7-422a-a889-e3f1dfac2e99 tempest-GroupSnapshotsTest-1020571071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-98805bab-ba7b-44dd-a235-42efd9e0b30c.a4fc9b43-1381-42cd-932f-e9a467ca157b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:33:30 devstack sudo[90126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-98805bab-ba7b-44dd-a235-42efd9e0b30c.a4fc9b43-1381-42cd-932f-e9a467ca157b
Jul 09 14:33:30 devstack sudo[90126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:33:30 devstack sudo[90109]: pam_unix(sudo:session): session closed for user root
Jul 09 14:33:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f78d6b12-bbda-4dc5-8532-479ed1561760 tempest-AttachVolumeShelveTestJSON-222680792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-c98db6c6-1c36-4ee4-b260-abadaf61560c 1073741824" returned: 0 in 1.050s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:33:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f78d6b12-bbda-4dc5-8532-479ed1561760 tempest-AttachVolumeShelveTestJSON-222680792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-c98db6c6-1c36-4ee4-b260-abadaf61560c {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:33:30 devstack sudo[90128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-c98db6c6-1c36-4ee4-b260-abadaf61560c
Jul 09 14:33:30 devstack sudo[90128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:33:31 devstack sudo[90128]: pam_unix(sudo:session): session closed for user root
Jul 09 14:33:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f78d6b12-bbda-4dc5-8532-479ed1561760 tempest-AttachVolumeShelveTestJSON-222680792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-c98db6c6-1c36-4ee4-b260-abadaf61560c" returned: 0 in 0.683s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:33:31 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f78d6b12-bbda-4dc5-8532-479ed1561760 tempest-AttachVolumeShelveTestJSON-222680792 None] <== create_volume: return (1794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:33:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f78d6b12-bbda-4dc5-8532-479ed1561760 tempest-AttachVolumeShelveTestJSON-222680792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.797s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:33:31 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f78d6b12-bbda-4dc5-8532-479ed1561760 tempest-AttachVolumeShelveTestJSON-222680792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdee2591-7945-43ef-b892-77234af91575) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c98db6c6-1c36-4ee4-b260-abadaf61560c', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:33:31 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f78d6b12-bbda-4dc5-8532-479ed1561760 tempest-AttachVolumeShelveTestJSON-222680792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae832720-2f49-4a36-8267-b1873728fab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:33:31 devstack sudo[90126]: pam_unix(sudo:session): session closed for user root
Jul 09 14:33:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d5d42e46-26e7-422a-a889-e3f1dfac2e99 tempest-GroupSnapshotsTest-1020571071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-98805bab-ba7b-44dd-a235-42efd9e0b30c.a4fc9b43-1381-42cd-932f-e9a467ca157b" returned: 0 in 0.856s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:33:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d5d42e46-26e7-422a-a889-e3f1dfac2e99 tempest-GroupSnapshotsTest-1020571071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-98805bab-ba7b-44dd-a235-42efd9e0b30c.a4fc9b43-1381-42cd-932f-e9a467ca157b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:33:31 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-f78d6b12-bbda-4dc5-8532-479ed1561760 tempest-AttachVolumeShelveTestJSON-222680792 None] Volume volume-c98db6c6-1c36-4ee4-b260-abadaf61560c (c98db6c6-1c36-4ee4-b260-abadaf61560c): created successfully
Jul 09 14:33:31 devstack sudo[90135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-98805bab-ba7b-44dd-a235-42efd9e0b30c.a4fc9b43-1381-42cd-932f-e9a467ca157b
Jul 09 14:33:31 devstack sudo[90135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:33:31 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f78d6b12-bbda-4dc5-8532-479ed1561760 tempest-AttachVolumeShelveTestJSON-222680792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae832720-2f49-4a36-8267-b1873728fab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:33:31 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f78d6b12-bbda-4dc5-8532-479ed1561760 tempest-AttachVolumeShelveTestJSON-222680792 None] Flow 'volume_create_manager' (b6cd354d-aa3e-462e-a527-5065698f369f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:33:31 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-f78d6b12-bbda-4dc5-8532-479ed1561760 tempest-AttachVolumeShelveTestJSON-222680792 None] Created volume successfully.
Jul 09 14:33:31 devstack sudo[90135]: pam_unix(sudo:session): session closed for user root
Jul 09 14:33:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d5d42e46-26e7-422a-a889-e3f1dfac2e99 tempest-GroupSnapshotsTest-1020571071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-98805bab-ba7b-44dd-a235-42efd9e0b30c.a4fc9b43-1381-42cd-932f-e9a467ca157b" returned: 0 in 0.654s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:33:31 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d5d42e46-26e7-422a-a889-e3f1dfac2e99 tempest-GroupSnapshotsTest-1020571071 None] Lock "cinder-quobyte-a4fc9b43-1381-42cd-932f-e9a467ca157b" released by "_delete_snapshot" :: held 3.478s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:33:31 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d5d42e46-26e7-422a-a889-e3f1dfac2e99 tempest-GroupSnapshotsTest-1020571071 None] Lock "cinder-quobyte-98805bab-ba7b-44dd-a235-42efd9e0b30c" released by "delete_snapshot" :: held 3.515s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:33:31 devstack cinder-volume[87230]: WARNING cinder.quota [None req-d5d42e46-26e7-422a-a889-e3f1dfac2e99 tempest-GroupSnapshotsTest-1020571071 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-321728804 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-321728804, it is now deprecated. Please use the default quota class for default quota.
Jul 09 14:33:31 devstack cinder-volume[87230]: WARNING cinder.quota [None req-d5d42e46-26e7-422a-a889-e3f1dfac2e99 tempest-GroupSnapshotsTest-1020571071 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-321728804 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-321728804, it is now deprecated. Please use the default quota class for default quota.
Jul 09 14:33:32 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-d5d42e46-26e7-422a-a889-e3f1dfac2e99 tempest-GroupSnapshotsTest-1020571071 None] Created reservations ['3b93b20f-d76d-46bd-9ac5-7a9d6bd4bff5', 'd8e46dad-533b-406f-b7b5-8613402804a9', '79f6cf8f-3de4-491e-9f1b-464be3714ff8', '153aae3b-2317-4317-becc-ba07dea1190c'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:33:32 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-d5d42e46-26e7-422a-a889-e3f1dfac2e99 tempest-GroupSnapshotsTest-1020571071 None] group_snapshot d7dd77c0-b11a-4661-966c-f597c4b7e9d4: deleted successfully
Jul 09 14:33:33 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-720edcf5-6f61-4490-8f2b-2a6fefb13257 tempest-GroupSnapshotsTest-1020571071 None] Acquiring lock "cinder-quobyte-98805bab-ba7b-44dd-a235-42efd9e0b30c" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:33:33 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-720edcf5-6f61-4490-8f2b-2a6fefb13257 tempest-GroupSnapshotsTest-1020571071 None] Lock "cinder-quobyte-98805bab-ba7b-44dd-a235-42efd9e0b30c" acquired by "delete_volume" :: waited 0.045s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:33:33 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb2fec0-e218-4302-9740-12b1296ee8aa]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:33:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-720edcf5-6f61-4490-8f2b-2a6fefb13257 tempest-GroupSnapshotsTest-1020571071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-98805bab-ba7b-44dd-a235-42efd9e0b30c {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:33:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-0cb30d1c-277f-4506-b7d6-5f83a42b8a2d req-db934ede-750d-4d1c-a127-f94857c68a8c tempest-AttachVolumeNegativeTest-594851243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:33:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-0cb30d1c-277f-4506-b7d6-5f83a42b8a2d req-db934ede-750d-4d1c-a127-f94857c68a8c tempest-AttachVolumeNegativeTest-594851243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:33:33 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac00ebb-994c-412c-8126-9f40a872644c]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:33:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-0cb30d1c-277f-4506-b7d6-5f83a42b8a2d req-db934ede-750d-4d1c-a127-f94857c68a8c tempest-AttachVolumeNegativeTest-594851243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7468e7e6-2849-45eb-a656-10c997e948fc {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:33:33 devstack sudo[90153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-98805bab-ba7b-44dd-a235-42efd9e0b30c
Jul 09 14:33:33 devstack sudo[90153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:33:33 devstack sudo[90154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7468e7e6-2849-45eb-a656-10c997e948fc
Jul 09 14:33:33 devstack sudo[90154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:33:34 devstack sudo[90153]: pam_unix(sudo:session): session closed for user root
Jul 09 14:33:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-720edcf5-6f61-4490-8f2b-2a6fefb13257 tempest-GroupSnapshotsTest-1020571071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-98805bab-ba7b-44dd-a235-42efd9e0b30c" returned: 0 in 0.910s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:33:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-720edcf5-6f61-4490-8f2b-2a6fefb13257 tempest-GroupSnapshotsTest-1020571071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-98805bab-ba7b-44dd-a235-42efd9e0b30c {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:33:34 devstack sudo[90164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-98805bab-ba7b-44dd-a235-42efd9e0b30c
Jul 09 14:33:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-0cb30d1c-277f-4506-b7d6-5f83a42b8a2d req-db934ede-750d-4d1c-a127-f94857c68a8c tempest-AttachVolumeNegativeTest-594851243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7468e7e6-2849-45eb-a656-10c997e948fc" returned: 0 in 0.913s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:33:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-0cb30d1c-277f-4506-b7d6-5f83a42b8a2d req-db934ede-750d-4d1c-a127-f94857c68a8c tempest-AttachVolumeNegativeTest-594851243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.941s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:33:34 devstack sudo[90164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:33:34 devstack sudo[90154]: pam_unix(sudo:session): session closed for user root
Jul 09 14:33:34 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-0cb30d1c-277f-4506-b7d6-5f83a42b8a2d req-db934ede-750d-4d1c-a127-f94857c68a8c tempest-AttachVolumeNegativeTest-594851243 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653', 'name': 'volume-7468e7e6-2849-45eb-a656-10c997e948fc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '43726c94-6610-4691-ad3a-6cfd929ba6e1', 'enforce_multipath': True} {{(pid=87230) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 09 14:33:34 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-0cb30d1c-277f-4506-b7d6-5f83a42b8a2d req-db934ede-750d-4d1c-a127-f94857c68a8c tempest-AttachVolumeNegativeTest-594851243 None] attachment_update completed successfully.
Jul 09 14:33:35 devstack sudo[90164]: pam_unix(sudo:session): session closed for user root
Jul 09 14:33:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-720edcf5-6f61-4490-8f2b-2a6fefb13257 tempest-GroupSnapshotsTest-1020571071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-98805bab-ba7b-44dd-a235-42efd9e0b30c" returned: 0 in 0.802s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:33:35 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-720edcf5-6f61-4490-8f2b-2a6fefb13257 tempest-GroupSnapshotsTest-1020571071 None] Lock "cinder-quobyte-98805bab-ba7b-44dd-a235-42efd9e0b30c" released by "delete_volume" :: held 1.892s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:33:35 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-720edcf5-6f61-4490-8f2b-2a6fefb13257 tempest-GroupSnapshotsTest-1020571071 None] Created reservations ['e2a0ef47-50d6-4cdd-b737-78cb291709fb'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:33:35 devstack cinder-volume[87230]: WARNING cinder.quota [None req-720edcf5-6f61-4490-8f2b-2a6fefb13257 tempest-GroupSnapshotsTest-1020571071 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-321728804 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-321728804, it is now deprecated. Please use the default quota class for default quota.
Jul 09 14:33:35 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-720edcf5-6f61-4490-8f2b-2a6fefb13257 tempest-GroupSnapshotsTest-1020571071 None] Created reservations ['7d9d94a1-c3e6-4473-afd4-5412d4d68524', '8c8b02c8-d4af-4ab5-b558-081ef6b2d9c7', '81d811be-7799-4cd1-86a1-e962e4696275', '921f4b1e-264d-4957-b67c-39c3292d97c1'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:33:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-720edcf5-6f61-4490-8f2b-2a6fefb13257 tempest-GroupSnapshotsTest-1020571071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:33:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-720edcf5-6f61-4490-8f2b-2a6fefb13257 tempest-GroupSnapshotsTest-1020571071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:33:35 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-720edcf5-6f61-4490-8f2b-2a6fefb13257 tempest-GroupSnapshotsTest-1020571071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:33:35 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-720edcf5-6f61-4490-8f2b-2a6fefb13257 tempest-GroupSnapshotsTest-1020571071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:33:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-720edcf5-6f61-4490-8f2b-2a6fefb13257 tempest-GroupSnapshotsTest-1020571071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:33:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-720edcf5-6f61-4490-8f2b-2a6fefb13257 tempest-GroupSnapshotsTest-1020571071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:33:35 devstack sudo[90274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:33:35 devstack sudo[90274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:33:36 devstack sudo[90274]: pam_unix(sudo:session): session closed for user root
Jul 09 14:33:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-720edcf5-6f61-4490-8f2b-2a6fefb13257 tempest-GroupSnapshotsTest-1020571071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.899s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:33:36 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-720edcf5-6f61-4490-8f2b-2a6fefb13257 tempest-GroupSnapshotsTest-1020571071 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:33:36 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-720edcf5-6f61-4490-8f2b-2a6fefb13257 tempest-GroupSnapshotsTest-1020571071 None] Delete group completed successfully.
Jul 09 14:33:42 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-5180b551-3436-45cb-9f2b-fddb0c5fe800 tempest-GroupsV314Test-1691964999 None] Group tempest-GroupsV314Test-Group-1005029756: creating
Jul 09 14:33:42 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-5180b551-3436-45cb-9f2b-fddb0c5fe800 tempest-GroupsV314Test-1691964999 None] Group tempest-GroupsV314Test-Group-1005029756: created successfully
Jul 09 14:33:42 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-5180b551-3436-45cb-9f2b-fddb0c5fe800 tempest-GroupsV314Test-1691964999 None] Create group completed successfully.
Jul 09 14:33:44 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f6d750e-c217-490e-ad00-cb86e46f9ff0 tempest-GroupsV314Test-1691964999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:33:44 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6f6d750e-c217-490e-ad00-cb86e46f9ff0 tempest-GroupsV314Test-1691964999 None] Flow 'volume_create_manager' (2f4ddec1-4258-4ba6-98da-748f7d38f414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:33:44 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6f6d750e-c217-490e-ad00-cb86e46f9ff0 tempest-GroupsV314Test-1691964999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ba36be6-5a5b-4892-b459-ef51cd8cea54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:33:44 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6f6d750e-c217-490e-ad00-cb86e46f9ff0 tempest-GroupsV314Test-1691964999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ba36be6-5a5b-4892-b459-ef51cd8cea54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:33:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1407306846',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b88e9520-ccaa-474a-8a36-b7c3223476fa,host='devstack@QuobyteHD#QuobyteHD',id=95feef6b-e251-4ab5-a15e-8348e7f2ec28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acafc2944afe45f986e6ad6e5a1eaeb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:33:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:33:45Z,use_quota=True,user_id='1d67667684374a6ead9f95bdac8017e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae27e4d6-b9d7-46a8-9e18-e9eeded33780),volume_type_id=ae27e4d6-b9d7-46a8-9e18-e9eeded33780)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:33:44 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6f6d750e-c217-490e-ad00-cb86e46f9ff0 tempest-GroupsV314Test-1691964999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6cd8b0e-4b0f-4d4e-951e-6b9befd88f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:33:44 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6f6d750e-c217-490e-ad00-cb86e46f9ff0 tempest-GroupsV314Test-1691964999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6cd8b0e-4b0f-4d4e-951e-6b9befd88f68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:33:44 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6f6d750e-c217-490e-ad00-cb86e46f9ff0 tempest-GroupsV314Test-1691964999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b900932c-4cac-4aa3-869c-7d429604ca97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:33:44 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6f6d750e-c217-490e-ad00-cb86e46f9ff0 tempest-GroupsV314Test-1691964999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b900932c-4cac-4aa3-869c-7d429604ca97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95feef6b-e251-4ab5-a15e-8348e7f2ec28', 'volume_name': 'volume-95feef6b-e251-4ab5-a15e-8348e7f2ec28', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:33:44 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6f6d750e-c217-490e-ad00-cb86e46f9ff0 tempest-GroupsV314Test-1691964999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5873244-b010-4c6b-aaaa-35d31554ca77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:33:44 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6f6d750e-c217-490e-ad00-cb86e46f9ff0 tempest-GroupsV314Test-1691964999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5873244-b010-4c6b-aaaa-35d31554ca77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:33:44 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6f6d750e-c217-490e-ad00-cb86e46f9ff0 tempest-GroupsV314Test-1691964999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a10c95c-db22-458b-896c-d5f04c9ba8f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:33:44 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-6f6d750e-c217-490e-ad00-cb86e46f9ff0 tempest-GroupsV314Test-1691964999 None] Volume 95feef6b-e251-4ab5-a15e-8348e7f2ec28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95feef6b-e251-4ab5-a15e-8348e7f2ec28', 'volume_size': 1}
Jul 09 14:33:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6f6d750e-c217-490e-ad00-cb86e46f9ff0 tempest-GroupsV314Test-1691964999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:33:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6f6d750e-c217-490e-ad00-cb86e46f9ff0 tempest-GroupsV314Test-1691964999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:33:44 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-6f6d750e-c217-490e-ad00-cb86e46f9ff0 tempest-GroupsV314Test-1691964999 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=b88e9520-ccaa-474a-8a36-b7c3223476fa,created_at=2026-07-09T12:33:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1407306846',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b88e9520-ccaa-474a-8a36-b7c3223476fa,host='devstack@QuobyteHD#QuobyteHD',id=95feef6b-e251-4ab5-a15e-8348e7f2ec28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acafc2944afe45f986e6ad6e5a1eaeb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:33:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:33:45Z,use_quota=True,user_id='1d67667684374a6ead9f95bdac8017e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae27e4d6-b9d7-46a8-9e18-e9eeded33780),volume_type_id=ae27e4d6-b9d7-46a8-9e18-e9eeded33780)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:33:44 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-6f6d750e-c217-490e-ad00-cb86e46f9ff0 tempest-GroupsV314Test-1691964999 None] Creating volume 95feef6b-e251-4ab5-a15e-8348e7f2ec28 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:33:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6f6d750e-c217-490e-ad00-cb86e46f9ff0 tempest-GroupsV314Test-1691964999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:33:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6f6d750e-c217-490e-ad00-cb86e46f9ff0 tempest-GroupsV314Test-1691964999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:33:44 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-6f6d750e-c217-490e-ad00-cb86e46f9ff0 tempest-GroupsV314Test-1691964999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:33:44 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-6f6d750e-c217-490e-ad00-cb86e46f9ff0 tempest-GroupsV314Test-1691964999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:33:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6f6d750e-c217-490e-ad00-cb86e46f9ff0 tempest-GroupsV314Test-1691964999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:33:44 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-6f6d750e-c217-490e-ad00-cb86e46f9ff0 tempest-GroupsV314Test-1691964999 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:33:44 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-6f6d750e-c217-490e-ad00-cb86e46f9ff0 tempest-GroupsV314Test-1691964999 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:33:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6f6d750e-c217-490e-ad00-cb86e46f9ff0 tempest-GroupsV314Test-1691964999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-95feef6b-e251-4ab5-a15e-8348e7f2ec28 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:33:44 devstack sudo[90611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-95feef6b-e251-4ab5-a15e-8348e7f2ec28 1073741824
Jul 09 14:33:44 devstack sudo[90611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:33:45 devstack sudo[90611]: pam_unix(sudo:session): session closed for user root
Jul 09 14:33:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6f6d750e-c217-490e-ad00-cb86e46f9ff0 tempest-GroupsV314Test-1691964999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-95feef6b-e251-4ab5-a15e-8348e7f2ec28 1073741824" returned: 0 in 1.249s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:33:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6f6d750e-c217-490e-ad00-cb86e46f9ff0 tempest-GroupsV314Test-1691964999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-95feef6b-e251-4ab5-a15e-8348e7f2ec28 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:33:46 devstack sudo[90636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-95feef6b-e251-4ab5-a15e-8348e7f2ec28
Jul 09 14:33:46 devstack sudo[90636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:33:46 devstack sudo[90636]: pam_unix(sudo:session): session closed for user root
Jul 09 14:33:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6f6d750e-c217-490e-ad00-cb86e46f9ff0 tempest-GroupsV314Test-1691964999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-95feef6b-e251-4ab5-a15e-8348e7f2ec28" returned: 0 in 0.838s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:33:46 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-6f6d750e-c217-490e-ad00-cb86e46f9ff0 tempest-GroupsV314Test-1691964999 None] <== create_volume: return (2133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:33:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6f6d750e-c217-490e-ad00-cb86e46f9ff0 tempest-GroupsV314Test-1691964999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.135s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:33:46 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6f6d750e-c217-490e-ad00-cb86e46f9ff0 tempest-GroupsV314Test-1691964999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a10c95c-db22-458b-896c-d5f04c9ba8f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95feef6b-e251-4ab5-a15e-8348e7f2ec28', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:33:46 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6f6d750e-c217-490e-ad00-cb86e46f9ff0 tempest-GroupsV314Test-1691964999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab3916e0-6cf5-4e1f-9c7d-dfea58776d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:33:46 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-6f6d750e-c217-490e-ad00-cb86e46f9ff0 tempest-GroupsV314Test-1691964999 None] Volume volume-95feef6b-e251-4ab5-a15e-8348e7f2ec28 (95feef6b-e251-4ab5-a15e-8348e7f2ec28): created successfully
Jul 09 14:33:46 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6f6d750e-c217-490e-ad00-cb86e46f9ff0 tempest-GroupsV314Test-1691964999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab3916e0-6cf5-4e1f-9c7d-dfea58776d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:33:46 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6f6d750e-c217-490e-ad00-cb86e46f9ff0 tempest-GroupsV314Test-1691964999 None] Flow 'volume_create_manager' (2f4ddec1-4258-4ba6-98da-748f7d38f414) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:33:46 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-6f6d750e-c217-490e-ad00-cb86e46f9ff0 tempest-GroupsV314Test-1691964999 None] Created volume successfully.
Jul 09 14:33:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-88baaeb7-cffc-4083-b813-9f1c950e307b tempest-GroupsV314Test-1691964999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:33:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-88baaeb7-cffc-4083-b813-9f1c950e307b tempest-GroupsV314Test-1691964999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:33:48 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-88baaeb7-cffc-4083-b813-9f1c950e307b tempest-GroupsV314Test-1691964999 None] Cloning volume 95feef6b-e251-4ab5-a15e-8348e7f2ec28 to volume 3c6740bf-547a-4d03-8fb6-658ff29d5377
Jul 09 14:33:48 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-88baaeb7-cffc-4083-b813-9f1c950e307b tempest-GroupsV314Test-1691964999 None] Creating offline snapshot d86a78e2-061d-48f0-8e88-1e1fbf400a75 of volume 95feef6b-e251-4ab5-a15e-8348e7f2ec28 {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 14:33:48 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[146502f6-9d11-4add-b544-510e018f85aa]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:33:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-88baaeb7-cffc-4083-b813-9f1c950e307b tempest-GroupsV314Test-1691964999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-95feef6b-e251-4ab5-a15e-8348e7f2ec28 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:33:48 devstack sudo[90640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-95feef6b-e251-4ab5-a15e-8348e7f2ec28
Jul 09 14:33:48 devstack sudo[90640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:33:49 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-d58beefc-5d49-40ea-b6cc-eb8581b8f7f3 req-62509322-cd0f-4510-951d-2222650832fa tempest-AttachVolumeShelveTestJSON-222680792 None] No connector for attachment ec02dd53-e483-4f84-9aac-88786a3d1624; skipping storage backend terminate_connection call. {{(pid=87230) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}}
Jul 09 14:33:49 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-d58beefc-5d49-40ea-b6cc-eb8581b8f7f3 req-62509322-cd0f-4510-951d-2222650832fa tempest-AttachVolumeShelveTestJSON-222680792 None] Deleting attachment ec02dd53-e483-4f84-9aac-88786a3d1624. {{(pid=87230) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 09 14:33:49 devstack sudo[90640]: pam_unix(sudo:session): session closed for user root
Jul 09 14:33:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-88baaeb7-cffc-4083-b813-9f1c950e307b tempest-GroupsV314Test-1691964999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-95feef6b-e251-4ab5-a15e-8348e7f2ec28" returned: 0 in 1.245s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:33:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-88baaeb7-cffc-4083-b813-9f1c950e307b tempest-GroupsV314Test-1691964999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-95feef6b-e251-4ab5-a15e-8348e7f2ec28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-95feef6b-e251-4ab5-a15e-8348e7f2ec28.d86a78e2-061d-48f0-8e88-1e1fbf400a75 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:33:49 devstack sudo[90647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-95feef6b-e251-4ab5-a15e-8348e7f2ec28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-95feef6b-e251-4ab5-a15e-8348e7f2ec28.d86a78e2-061d-48f0-8e88-1e1fbf400a75 1G
Jul 09 14:33:49 devstack sudo[90647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:33:51 devstack sudo[90647]: pam_unix(sudo:session): session closed for user root
Jul 09 14:33:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-88baaeb7-cffc-4083-b813-9f1c950e307b tempest-GroupsV314Test-1691964999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-95feef6b-e251-4ab5-a15e-8348e7f2ec28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-95feef6b-e251-4ab5-a15e-8348e7f2ec28.d86a78e2-061d-48f0-8e88-1e1fbf400a75 1G" returned: 0 in 1.388s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:33:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-88baaeb7-cffc-4083-b813-9f1c950e307b tempest-GroupsV314Test-1691964999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95feef6b-e251-4ab5-a15e-8348e7f2ec28 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-95feef6b-e251-4ab5-a15e-8348e7f2ec28.d86a78e2-061d-48f0-8e88-1e1fbf400a75 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:33:51 devstack sudo[90680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95feef6b-e251-4ab5-a15e-8348e7f2ec28 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-95feef6b-e251-4ab5-a15e-8348e7f2ec28.d86a78e2-061d-48f0-8e88-1e1fbf400a75
Jul 09 14:33:51 devstack sudo[90680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:33:52 devstack sudo[90680]: pam_unix(sudo:session): session closed for user root
Jul 09 14:33:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-88baaeb7-cffc-4083-b813-9f1c950e307b tempest-GroupsV314Test-1691964999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95feef6b-e251-4ab5-a15e-8348e7f2ec28 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-95feef6b-e251-4ab5-a15e-8348e7f2ec28.d86a78e2-061d-48f0-8e88-1e1fbf400a75" returned: 0 in 1.041s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:33:52 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-88baaeb7-cffc-4083-b813-9f1c950e307b tempest-GroupsV314Test-1691964999 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-95feef6b-e251-4ab5-a15e-8348e7f2ec28.d86a78e2-061d-48f0-8e88-1e1fbf400a75 is being set with open permissions: ugo+rw: NotImplementedError
Jul 09 14:33:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-88baaeb7-cffc-4083-b813-9f1c950e307b tempest-GroupsV314Test-1691964999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-95feef6b-e251-4ab5-a15e-8348e7f2ec28.d86a78e2-061d-48f0-8e88-1e1fbf400a75 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:33:52 devstack sudo[90688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-95feef6b-e251-4ab5-a15e-8348e7f2ec28.d86a78e2-061d-48f0-8e88-1e1fbf400a75
Jul 09 14:33:52 devstack sudo[90688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:33:52 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 14:33:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:33:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:33:52 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:33:52 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:33:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:33:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:33:52 devstack sudo[90690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:33:52 devstack sudo[90690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:33:52 devstack sudo[90688]: pam_unix(sudo:session): session closed for user root
Jul 09 14:33:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-88baaeb7-cffc-4083-b813-9f1c950e307b tempest-GroupsV314Test-1691964999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-95feef6b-e251-4ab5-a15e-8348e7f2ec28.d86a78e2-061d-48f0-8e88-1e1fbf400a75" returned: 0 in 0.796s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:33:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-88baaeb7-cffc-4083-b813-9f1c950e307b tempest-GroupsV314Test-1691964999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-95feef6b-e251-4ab5-a15e-8348e7f2ec28.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:33:53 devstack sudo[90696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-95feef6b-e251-4ab5-a15e-8348e7f2ec28.info
Jul 09 14:33:53 devstack sudo[90696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:33:53 devstack sudo[90690]: pam_unix(sudo:session): session closed for user root
Jul 09 14:33:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 1.077s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:33:53 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:33:53 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Running periodic task VolumeManager._thread_info {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 14:33:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] thread count: 8 {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 09 14:33:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] thread info: [<_MainThread(MainThread, started 125388812103808)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125388713797504)>, <Thread(Thread-3 (stat_writer), started daemon 125388699995392)>, <Thread(Rabbit-heartbeat, started daemon 125388700522560)>, <Thread(Thread-5 (_runner), started daemon 125388698545216)>, <Thread(Thread-7 (_runner), started daemon 125388698611264)>, <Thread(fd_logger, started daemon 125388703020672)>, <Thread(privsep_reader, started daemon 125388696441088)>] {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 09 14:33:54 devstack sudo[90696]: pam_unix(sudo:session): session closed for user root
Jul 09 14:33:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-88baaeb7-cffc-4083-b813-9f1c950e307b tempest-GroupsV314Test-1691964999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-95feef6b-e251-4ab5-a15e-8348e7f2ec28.info" returned: 0 in 1.209s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:33:54 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-88baaeb7-cffc-4083-b813-9f1c950e307b tempest-GroupsV314Test-1691964999 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-95feef6b-e251-4ab5-a15e-8348e7f2ec28.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 09 14:33:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-88baaeb7-cffc-4083-b813-9f1c950e307b tempest-GroupsV314Test-1691964999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-95feef6b-e251-4ab5-a15e-8348e7f2ec28.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:33:54 devstack sudo[90708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-95feef6b-e251-4ab5-a15e-8348e7f2ec28.info
Jul 09 14:33:54 devstack sudo[90708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:33:54 devstack sudo[90708]: pam_unix(sudo:session): session closed for user root
Jul 09 14:33:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-88baaeb7-cffc-4083-b813-9f1c950e307b tempest-GroupsV314Test-1691964999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-95feef6b-e251-4ab5-a15e-8348e7f2ec28.info" returned: 0 in 0.773s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:33:54 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-88baaeb7-cffc-4083-b813-9f1c950e307b tempest-GroupsV314Test-1691964999 None] Acquiring lock "cinder-quobyte-3c6740bf-547a-4d03-8fb6-658ff29d5377" by "_copy_volume_from_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:33:55 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-88baaeb7-cffc-4083-b813-9f1c950e307b tempest-GroupsV314Test-1691964999 None] Lock "cinder-quobyte-3c6740bf-547a-4d03-8fb6-658ff29d5377" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:33:55 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-88baaeb7-cffc-4083-b813-9f1c950e307b tempest-GroupsV314Test-1691964999 None] snapshot: d86a78e2-061d-48f0-8e88-1e1fbf400a75, volume: 3c6740bf-547a-4d03-8fb6-658ff29d5377,  {{(pid=87230) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 09 14:33:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-88baaeb7-cffc-4083-b813-9f1c950e307b tempest-GroupsV314Test-1691964999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:33:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-88baaeb7-cffc-4083-b813-9f1c950e307b tempest-GroupsV314Test-1691964999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:33:55 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-88baaeb7-cffc-4083-b813-9f1c950e307b tempest-GroupsV314Test-1691964999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:33:55 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-88baaeb7-cffc-4083-b813-9f1c950e307b tempest-GroupsV314Test-1691964999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:33:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-88baaeb7-cffc-4083-b813-9f1c950e307b tempest-GroupsV314Test-1691964999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:33:55 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[142007e5-aec1-430c-96d1-343ca0fef040]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:33:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-88baaeb7-cffc-4083-b813-9f1c950e307b tempest-GroupsV314Test-1691964999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-95feef6b-e251-4ab5-a15e-8348e7f2ec28.d86a78e2-061d-48f0-8e88-1e1fbf400a75 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:33:55 devstack sudo[90735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-95feef6b-e251-4ab5-a15e-8348e7f2ec28.d86a78e2-061d-48f0-8e88-1e1fbf400a75
Jul 09 14:33:55 devstack sudo[90735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:33:56 devstack sudo[90735]: pam_unix(sudo:session): session closed for user root
Jul 09 14:33:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-88baaeb7-cffc-4083-b813-9f1c950e307b tempest-GroupsV314Test-1691964999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-95feef6b-e251-4ab5-a15e-8348e7f2ec28.d86a78e2-061d-48f0-8e88-1e1fbf400a75" returned: 0 in 0.994s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:33:56 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-88baaeb7-cffc-4083-b813-9f1c950e307b tempest-GroupsV314Test-1691964999 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95feef6b-e251-4ab5-a15e-8348e7f2ec28(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 14:33:56 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-88baaeb7-cffc-4083-b813-9f1c950e307b tempest-GroupsV314Test-1691964999 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-95feef6b-e251-4ab5-a15e-8348e7f2ec28 {{(pid=87230) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 09 14:33:56 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-88baaeb7-cffc-4083-b813-9f1c950e307b tempest-GroupsV314Test-1691964999 None] Creating direct copy from snapshot {{(pid=87230) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 09 14:33:56 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a8afea-42ec-4475-a29a-a4fbcb427b0a]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:33:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-88baaeb7-cffc-4083-b813-9f1c950e307b tempest-GroupsV314Test-1691964999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-95feef6b-e251-4ab5-a15e-8348e7f2ec28 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:33:56 devstack sudo[90759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-95feef6b-e251-4ab5-a15e-8348e7f2ec28
Jul 09 14:33:56 devstack sudo[90759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:33:57 devstack sudo[90759]: pam_unix(sudo:session): session closed for user root
Jul 09 14:33:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-88baaeb7-cffc-4083-b813-9f1c950e307b tempest-GroupsV314Test-1691964999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-95feef6b-e251-4ab5-a15e-8348e7f2ec28" returned: 0 in 1.225s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:33:57 devstack cinder-volume[87230]: DEBUG cinder.utils [None req-88baaeb7-cffc-4083-b813-9f1c950e307b tempest-GroupsV314Test-1691964999 None] Path /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-3c6740bf-547a-4d03-8fb6-658ff29d5377 not found in is_blk_device check {{(pid=87230) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 09 14:33:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-88baaeb7-cffc-4083-b813-9f1c950e307b tempest-GroupsV314Test-1691964999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-95feef6b-e251-4ab5-a15e-8348e7f2ec28 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-3c6740bf-547a-4d03-8fb6-658ff29d5377 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:33:57 devstack sudo[90777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-95feef6b-e251-4ab5-a15e-8348e7f2ec28 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-3c6740bf-547a-4d03-8fb6-658ff29d5377
Jul 09 14:33:57 devstack sudo[90777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:34:02 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:UPDATE=74,cinder:SELECT=79,cinder:INSERT=18,cinder:DELETE=4 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 14:34:02 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:UPDATE=80,cinder:SELECT=70,cinder:INSERT=20,cinder:DELETE=2 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 14:34:05 devstack sudo[90777]: pam_unix(sudo:session): session closed for user root
Jul 09 14:34:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-88baaeb7-cffc-4083-b813-9f1c950e307b tempest-GroupsV314Test-1691964999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-95feef6b-e251-4ab5-a15e-8348e7f2ec28 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-3c6740bf-547a-4d03-8fb6-658ff29d5377" returned: 0 in 8.164s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:34:05 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[32941d3d-8df0-4489-8583-c1cdb36e8cd8]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:34:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-88baaeb7-cffc-4083-b813-9f1c950e307b tempest-GroupsV314Test-1691964999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-95feef6b-e251-4ab5-a15e-8348e7f2ec28 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:34:05 devstack sudo[90809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-95feef6b-e251-4ab5-a15e-8348e7f2ec28
Jul 09 14:34:05 devstack sudo[90809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:34:06 devstack sudo[90809]: pam_unix(sudo:session): session closed for user root
Jul 09 14:34:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-88baaeb7-cffc-4083-b813-9f1c950e307b tempest-GroupsV314Test-1691964999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-95feef6b-e251-4ab5-a15e-8348e7f2ec28" returned: 0 in 1.347s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:34:06 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-88baaeb7-cffc-4083-b813-9f1c950e307b tempest-GroupsV314Test-1691964999 None] Image conversion details: src /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-95feef6b-e251-4ab5-a15e-8348e7f2ec28, size 1024.00 MB, duration 8.16 sec, destination /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-3c6740bf-547a-4d03-8fb6-658ff29d5377 {{(pid=87230) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 09 14:34:06 devstack cinder-volume[87230]: INFO cinder.image.image_utils [None req-88baaeb7-cffc-4083-b813-9f1c950e307b tempest-GroupsV314Test-1691964999 None] Converted 1024.00 MB image at 125.42 MB/s
Jul 09 14:34:06 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-88baaeb7-cffc-4083-b813-9f1c950e307b tempest-GroupsV314Test-1691964999 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-3c6740bf-547a-4d03-8fb6-658ff29d5377 is being set with open permissions: ugo+rw: NotImplementedError
Jul 09 14:34:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-88baaeb7-cffc-4083-b813-9f1c950e307b tempest-GroupsV314Test-1691964999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-3c6740bf-547a-4d03-8fb6-658ff29d5377 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:34:06 devstack sudo[90814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-3c6740bf-547a-4d03-8fb6-658ff29d5377
Jul 09 14:34:06 devstack sudo[90814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:34:07 devstack sudo[90814]: pam_unix(sudo:session): session closed for user root
Jul 09 14:34:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-88baaeb7-cffc-4083-b813-9f1c950e307b tempest-GroupsV314Test-1691964999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-3c6740bf-547a-4d03-8fb6-658ff29d5377" returned: 0 in 0.931s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:34:07 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-88baaeb7-cffc-4083-b813-9f1c950e307b tempest-GroupsV314Test-1691964999 None] Lock "cinder-quobyte-3c6740bf-547a-4d03-8fb6-658ff29d5377" released by "_copy_volume_from_snapshot" :: held 12.849s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:34:07 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-88baaeb7-cffc-4083-b813-9f1c950e307b tempest-GroupsV314Test-1691964999 None] Acquiring lock "cinder-quobyte-d86a78e2-061d-48f0-8e88-1e1fbf400a75" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:34:07 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-88baaeb7-cffc-4083-b813-9f1c950e307b tempest-GroupsV314Test-1691964999 None] Lock "cinder-quobyte-d86a78e2-061d-48f0-8e88-1e1fbf400a75" acquired by "_delete_snapshot" :: waited 0.049s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:34:07 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-88baaeb7-cffc-4083-b813-9f1c950e307b tempest-GroupsV314Test-1691964999 None] Deleting offline snapshot d86a78e2-061d-48f0-8e88-1e1fbf400a75 of volume 95feef6b-e251-4ab5-a15e-8348e7f2ec28 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 14:34:07 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-88baaeb7-cffc-4083-b813-9f1c950e307b tempest-GroupsV314Test-1691964999 None] snapshot_file for this snap is: volume-95feef6b-e251-4ab5-a15e-8348e7f2ec28.d86a78e2-061d-48f0-8e88-1e1fbf400a75 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 14:34:07 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b211c1f-55d7-4613-a944-23672fa61737]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:34:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-88baaeb7-cffc-4083-b813-9f1c950e307b tempest-GroupsV314Test-1691964999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-95feef6b-e251-4ab5-a15e-8348e7f2ec28.d86a78e2-061d-48f0-8e88-1e1fbf400a75 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:34:08 devstack sudo[90820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-95feef6b-e251-4ab5-a15e-8348e7f2ec28.d86a78e2-061d-48f0-8e88-1e1fbf400a75
Jul 09 14:34:08 devstack sudo[90820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:34:10 devstack sudo[90820]: pam_unix(sudo:session): session closed for user root
Jul 09 14:34:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-88baaeb7-cffc-4083-b813-9f1c950e307b tempest-GroupsV314Test-1691964999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-95feef6b-e251-4ab5-a15e-8348e7f2ec28.d86a78e2-061d-48f0-8e88-1e1fbf400a75" returned: 0 in 2.013s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:34:10 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-88baaeb7-cffc-4083-b813-9f1c950e307b tempest-GroupsV314Test-1691964999 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95feef6b-e251-4ab5-a15e-8348e7f2ec28(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 14:34:10 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[2495910b-f290-47f6-aab2-ca6763cbc84f]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:34:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-88baaeb7-cffc-4083-b813-9f1c950e307b tempest-GroupsV314Test-1691964999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-95feef6b-e251-4ab5-a15e-8348e7f2ec28 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:34:10 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5750822-7fb2-402b-a00e-b3863fe2c935 tempest-TaggedAttachmentsTest-1717979664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:34:10 devstack sudo[90828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-95feef6b-e251-4ab5-a15e-8348e7f2ec28
Jul 09 14:34:10 devstack sudo[90828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:34:10 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d5750822-7fb2-402b-a00e-b3863fe2c935 tempest-TaggedAttachmentsTest-1717979664 None] Flow 'volume_create_manager' (0ebc1011-7c7b-4499-8652-b5921e647fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:34:10 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d5750822-7fb2-402b-a00e-b3863fe2c935 tempest-TaggedAttachmentsTest-1717979664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33eb549f-3ae3-4883-a8da-b28adccb5a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:34:10 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d5750822-7fb2-402b-a00e-b3863fe2c935 tempest-TaggedAttachmentsTest-1717979664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33eb549f-3ae3-4883-a8da-b28adccb5a81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:34:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1569498703',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a2a10ef-5848-4758-b3c5-f2283f2da7ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80d4a984504c4ed492c6fd12aa7e5008',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:34:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:34:10Z,use_quota=True,user_id='9bfb38c5165f40faac3c466122271212',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:34:10 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d5750822-7fb2-402b-a00e-b3863fe2c935 tempest-TaggedAttachmentsTest-1717979664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3aaf3ca1-648e-4429-a184-8fc6640da0b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:34:10 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d5750822-7fb2-402b-a00e-b3863fe2c935 tempest-TaggedAttachmentsTest-1717979664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3aaf3ca1-648e-4429-a184-8fc6640da0b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:34:10 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d5750822-7fb2-402b-a00e-b3863fe2c935 tempest-TaggedAttachmentsTest-1717979664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bffc7478-d6d2-437e-9b48-ec6991f501c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:34:10 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d5750822-7fb2-402b-a00e-b3863fe2c935 tempest-TaggedAttachmentsTest-1717979664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bffc7478-d6d2-437e-9b48-ec6991f501c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a2a10ef-5848-4758-b3c5-f2283f2da7ec', 'volume_name': 'volume-8a2a10ef-5848-4758-b3c5-f2283f2da7ec', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:34:10 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d5750822-7fb2-402b-a00e-b3863fe2c935 tempest-TaggedAttachmentsTest-1717979664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (571c78d8-f523-44e2-a2c5-9586c9acdcae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:34:10 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d5750822-7fb2-402b-a00e-b3863fe2c935 tempest-TaggedAttachmentsTest-1717979664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (571c78d8-f523-44e2-a2c5-9586c9acdcae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:34:10 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d5750822-7fb2-402b-a00e-b3863fe2c935 tempest-TaggedAttachmentsTest-1717979664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f453ec6-6816-4836-a260-1a01cca31939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:34:10 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-d5750822-7fb2-402b-a00e-b3863fe2c935 tempest-TaggedAttachmentsTest-1717979664 None] Volume 8a2a10ef-5848-4758-b3c5-f2283f2da7ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a2a10ef-5848-4758-b3c5-f2283f2da7ec', 'volume_size': 1}
Jul 09 14:34:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d5750822-7fb2-402b-a00e-b3863fe2c935 tempest-TaggedAttachmentsTest-1717979664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:34:11 devstack sudo[90828]: pam_unix(sudo:session): session closed for user root
Jul 09 14:34:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-88baaeb7-cffc-4083-b813-9f1c950e307b tempest-GroupsV314Test-1691964999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-95feef6b-e251-4ab5-a15e-8348e7f2ec28" returned: 0 in 0.968s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:34:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-88baaeb7-cffc-4083-b813-9f1c950e307b tempest-GroupsV314Test-1691964999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-95feef6b-e251-4ab5-a15e-8348e7f2ec28.d86a78e2-061d-48f0-8e88-1e1fbf400a75 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:34:11 devstack sudo[90855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-95feef6b-e251-4ab5-a15e-8348e7f2ec28.d86a78e2-061d-48f0-8e88-1e1fbf400a75
Jul 09 14:34:11 devstack sudo[90855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:34:11 devstack sudo[90855]: pam_unix(sudo:session): session closed for user root
Jul 09 14:34:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-88baaeb7-cffc-4083-b813-9f1c950e307b tempest-GroupsV314Test-1691964999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-95feef6b-e251-4ab5-a15e-8348e7f2ec28.d86a78e2-061d-48f0-8e88-1e1fbf400a75" returned: 0 in 0.787s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:34:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-88baaeb7-cffc-4083-b813-9f1c950e307b tempest-GroupsV314Test-1691964999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-95feef6b-e251-4ab5-a15e-8348e7f2ec28.d86a78e2-061d-48f0-8e88-1e1fbf400a75 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:34:11 devstack sudo[90887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-95feef6b-e251-4ab5-a15e-8348e7f2ec28.d86a78e2-061d-48f0-8e88-1e1fbf400a75
Jul 09 14:34:11 devstack sudo[90887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:34:12 devstack sudo[90887]: pam_unix(sudo:session): session closed for user root
Jul 09 14:34:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-88baaeb7-cffc-4083-b813-9f1c950e307b tempest-GroupsV314Test-1691964999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-95feef6b-e251-4ab5-a15e-8348e7f2ec28.d86a78e2-061d-48f0-8e88-1e1fbf400a75" returned: 0 in 0.626s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:34:12 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-88baaeb7-cffc-4083-b813-9f1c950e307b tempest-GroupsV314Test-1691964999 None] Lock "cinder-quobyte-d86a78e2-061d-48f0-8e88-1e1fbf400a75" released by "_delete_snapshot" :: held 4.548s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:34:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-88baaeb7-cffc-4083-b813-9f1c950e307b tempest-GroupsV314Test-1691964999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 24.196s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:34:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d5750822-7fb2-402b-a00e-b3863fe2c935 tempest-TaggedAttachmentsTest-1717979664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.198s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:34:12 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-d5750822-7fb2-402b-a00e-b3863fe2c935 tempest-TaggedAttachmentsTest-1717979664 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:34:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1569498703',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a2a10ef-5848-4758-b3c5-f2283f2da7ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80d4a984504c4ed492c6fd12aa7e5008',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:34:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:34:10Z,use_quota=True,user_id='9bfb38c5165f40faac3c466122271212',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:34:12 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-d5750822-7fb2-402b-a00e-b3863fe2c935 tempest-TaggedAttachmentsTest-1717979664 None] Creating volume 8a2a10ef-5848-4758-b3c5-f2283f2da7ec {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:34:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d5750822-7fb2-402b-a00e-b3863fe2c935 tempest-TaggedAttachmentsTest-1717979664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:34:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d5750822-7fb2-402b-a00e-b3863fe2c935 tempest-TaggedAttachmentsTest-1717979664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:34:12 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-d5750822-7fb2-402b-a00e-b3863fe2c935 tempest-TaggedAttachmentsTest-1717979664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:34:12 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-d5750822-7fb2-402b-a00e-b3863fe2c935 tempest-TaggedAttachmentsTest-1717979664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:34:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d5750822-7fb2-402b-a00e-b3863fe2c935 tempest-TaggedAttachmentsTest-1717979664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:34:12 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-d5750822-7fb2-402b-a00e-b3863fe2c935 tempest-TaggedAttachmentsTest-1717979664 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:34:12 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-d5750822-7fb2-402b-a00e-b3863fe2c935 tempest-TaggedAttachmentsTest-1717979664 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:34:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d5750822-7fb2-402b-a00e-b3863fe2c935 tempest-TaggedAttachmentsTest-1717979664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8a2a10ef-5848-4758-b3c5-f2283f2da7ec 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:34:12 devstack sudo[90892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8a2a10ef-5848-4758-b3c5-f2283f2da7ec 1073741824
Jul 09 14:34:12 devstack sudo[90892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:34:12 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-88baaeb7-cffc-4083-b813-9f1c950e307b tempest-GroupsV314Test-1691964999 None] Create group from source-group-b88e9520-ccaa-474a-8a36-b7c3223476fa completed successfully.
Jul 09 14:34:13 devstack sudo[90892]: pam_unix(sudo:session): session closed for user root
Jul 09 14:34:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d5750822-7fb2-402b-a00e-b3863fe2c935 tempest-TaggedAttachmentsTest-1717979664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8a2a10ef-5848-4758-b3c5-f2283f2da7ec 1073741824" returned: 0 in 0.968s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:34:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d5750822-7fb2-402b-a00e-b3863fe2c935 tempest-TaggedAttachmentsTest-1717979664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8a2a10ef-5848-4758-b3c5-f2283f2da7ec {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:34:13 devstack sudo[90898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8a2a10ef-5848-4758-b3c5-f2283f2da7ec
Jul 09 14:34:13 devstack sudo[90898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:34:13 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d4ca0a46-0a61-4cba-a8f9-11d7444c6190 tempest-GroupsV314Test-1691964999 None] Acquiring lock "cinder-quobyte-3c6740bf-547a-4d03-8fb6-658ff29d5377" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:34:13 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d4ca0a46-0a61-4cba-a8f9-11d7444c6190 tempest-GroupsV314Test-1691964999 None] Lock "cinder-quobyte-3c6740bf-547a-4d03-8fb6-658ff29d5377" acquired by "delete_volume" :: waited 0.019s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:34:13 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[91076d31-38bd-4da8-bfc9-5473654d3112]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:34:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d4ca0a46-0a61-4cba-a8f9-11d7444c6190 tempest-GroupsV314Test-1691964999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-3c6740bf-547a-4d03-8fb6-658ff29d5377 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:34:13 devstack sudo[90900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-3c6740bf-547a-4d03-8fb6-658ff29d5377
Jul 09 14:34:13 devstack sudo[90900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:34:14 devstack sudo[90898]: pam_unix(sudo:session): session closed for user root
Jul 09 14:34:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d5750822-7fb2-402b-a00e-b3863fe2c935 tempest-TaggedAttachmentsTest-1717979664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8a2a10ef-5848-4758-b3c5-f2283f2da7ec" returned: 0 in 0.690s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:34:14 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-d5750822-7fb2-402b-a00e-b3863fe2c935 tempest-TaggedAttachmentsTest-1717979664 None] <== create_volume: return (1702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:34:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d5750822-7fb2-402b-a00e-b3863fe2c935 tempest-TaggedAttachmentsTest-1717979664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.705s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:34:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d5750822-7fb2-402b-a00e-b3863fe2c935 tempest-TaggedAttachmentsTest-1717979664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f453ec6-6816-4836-a260-1a01cca31939) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a2a10ef-5848-4758-b3c5-f2283f2da7ec', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:34:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d5750822-7fb2-402b-a00e-b3863fe2c935 tempest-TaggedAttachmentsTest-1717979664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (248e4f20-98bc-4f58-9930-9547878b9a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:34:14 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-d5750822-7fb2-402b-a00e-b3863fe2c935 tempest-TaggedAttachmentsTest-1717979664 None] Volume volume-8a2a10ef-5848-4758-b3c5-f2283f2da7ec (8a2a10ef-5848-4758-b3c5-f2283f2da7ec): created successfully
Jul 09 14:34:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d5750822-7fb2-402b-a00e-b3863fe2c935 tempest-TaggedAttachmentsTest-1717979664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (248e4f20-98bc-4f58-9930-9547878b9a98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:34:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d5750822-7fb2-402b-a00e-b3863fe2c935 tempest-TaggedAttachmentsTest-1717979664 None] Flow 'volume_create_manager' (0ebc1011-7c7b-4499-8652-b5921e647fe2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:34:14 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-d5750822-7fb2-402b-a00e-b3863fe2c935 tempest-TaggedAttachmentsTest-1717979664 None] Created volume successfully.
Jul 09 14:34:14 devstack sudo[90900]: pam_unix(sudo:session): session closed for user root
Jul 09 14:34:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d4ca0a46-0a61-4cba-a8f9-11d7444c6190 tempest-GroupsV314Test-1691964999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-3c6740bf-547a-4d03-8fb6-658ff29d5377" returned: 0 in 0.785s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:34:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d4ca0a46-0a61-4cba-a8f9-11d7444c6190 tempest-GroupsV314Test-1691964999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-3c6740bf-547a-4d03-8fb6-658ff29d5377 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:34:14 devstack sudo[90906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-3c6740bf-547a-4d03-8fb6-658ff29d5377
Jul 09 14:34:14 devstack sudo[90906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:34:15 devstack sudo[90906]: pam_unix(sudo:session): session closed for user root
Jul 09 14:34:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d4ca0a46-0a61-4cba-a8f9-11d7444c6190 tempest-GroupsV314Test-1691964999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-3c6740bf-547a-4d03-8fb6-658ff29d5377" returned: 0 in 0.950s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:34:15 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d4ca0a46-0a61-4cba-a8f9-11d7444c6190 tempest-GroupsV314Test-1691964999 None] Lock "cinder-quobyte-3c6740bf-547a-4d03-8fb6-658ff29d5377" released by "delete_volume" :: held 1.782s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:34:15 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-d4ca0a46-0a61-4cba-a8f9-11d7444c6190 tempest-GroupsV314Test-1691964999 None] Created reservations ['4cc5d01e-ed90-4f30-81a2-edfc7c2aa3ae'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:34:15 devstack cinder-volume[87230]: WARNING cinder.quota [None req-d4ca0a46-0a61-4cba-a8f9-11d7444c6190 tempest-GroupsV314Test-1691964999 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-511735299 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-511735299, it is now deprecated. Please use the default quota class for default quota.
Jul 09 14:34:15 devstack cinder-volume[87230]: WARNING cinder.quota [None req-d4ca0a46-0a61-4cba-a8f9-11d7444c6190 tempest-GroupsV314Test-1691964999 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-511735299 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-511735299, it is now deprecated. Please use the default quota class for default quota.
Jul 09 14:34:15 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-d4ca0a46-0a61-4cba-a8f9-11d7444c6190 tempest-GroupsV314Test-1691964999 None] Created reservations ['70a7bf5c-eaee-49ab-a28c-9c023a685907', '1581f1b2-cfe4-43e1-97e9-eb1e476d5025', '1fa1cf1b-374f-4e9b-aba2-b496c063036e', '1ccff197-d595-4fbe-a05f-3374f9b4a52b'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:34:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d4ca0a46-0a61-4cba-a8f9-11d7444c6190 tempest-GroupsV314Test-1691964999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:34:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d4ca0a46-0a61-4cba-a8f9-11d7444c6190 tempest-GroupsV314Test-1691964999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:34:15 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-d4ca0a46-0a61-4cba-a8f9-11d7444c6190 tempest-GroupsV314Test-1691964999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:34:15 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-d4ca0a46-0a61-4cba-a8f9-11d7444c6190 tempest-GroupsV314Test-1691964999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:34:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d4ca0a46-0a61-4cba-a8f9-11d7444c6190 tempest-GroupsV314Test-1691964999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:34:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d4ca0a46-0a61-4cba-a8f9-11d7444c6190 tempest-GroupsV314Test-1691964999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:34:15 devstack sudo[90957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:34:15 devstack sudo[90957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:34:16 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-edfdf51d-4be9-43e2-83a6-09309f2e91f9 tempest-GroupsV314Test-1691964999 None] Acquiring lock "cinder-quobyte-95feef6b-e251-4ab5-a15e-8348e7f2ec28" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:34:16 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-edfdf51d-4be9-43e2-83a6-09309f2e91f9 tempest-GroupsV314Test-1691964999 None] Lock "cinder-quobyte-95feef6b-e251-4ab5-a15e-8348e7f2ec28" acquired by "delete_volume" :: waited 0.044s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:34:16 devstack sudo[90957]: pam_unix(sudo:session): session closed for user root
Jul 09 14:34:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d4ca0a46-0a61-4cba-a8f9-11d7444c6190 tempest-GroupsV314Test-1691964999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.879s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:34:16 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-d4ca0a46-0a61-4cba-a8f9-11d7444c6190 tempest-GroupsV314Test-1691964999 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:34:16 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-d4ca0a46-0a61-4cba-a8f9-11d7444c6190 tempest-GroupsV314Test-1691964999 None] Delete group completed successfully.
Jul 09 14:34:16 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d25930-c5a1-43df-9dcb-4f83f8124611]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:34:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-edfdf51d-4be9-43e2-83a6-09309f2e91f9 tempest-GroupsV314Test-1691964999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-95feef6b-e251-4ab5-a15e-8348e7f2ec28 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:34:16 devstack sudo[90979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-95feef6b-e251-4ab5-a15e-8348e7f2ec28
Jul 09 14:34:16 devstack sudo[90979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:34:17 devstack sudo[90979]: pam_unix(sudo:session): session closed for user root
Jul 09 14:34:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-edfdf51d-4be9-43e2-83a6-09309f2e91f9 tempest-GroupsV314Test-1691964999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-95feef6b-e251-4ab5-a15e-8348e7f2ec28" returned: 0 in 0.913s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:34:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-edfdf51d-4be9-43e2-83a6-09309f2e91f9 tempest-GroupsV314Test-1691964999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-95feef6b-e251-4ab5-a15e-8348e7f2ec28 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:34:17 devstack sudo[90987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-95feef6b-e251-4ab5-a15e-8348e7f2ec28
Jul 09 14:34:17 devstack sudo[90987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:34:18 devstack sudo[90987]: pam_unix(sudo:session): session closed for user root
Jul 09 14:34:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-edfdf51d-4be9-43e2-83a6-09309f2e91f9 tempest-GroupsV314Test-1691964999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-95feef6b-e251-4ab5-a15e-8348e7f2ec28" returned: 0 in 1.053s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:34:18 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-edfdf51d-4be9-43e2-83a6-09309f2e91f9 tempest-GroupsV314Test-1691964999 None] Lock "cinder-quobyte-95feef6b-e251-4ab5-a15e-8348e7f2ec28" released by "delete_volume" :: held 2.090s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:34:18 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-edfdf51d-4be9-43e2-83a6-09309f2e91f9 tempest-GroupsV314Test-1691964999 None] Created reservations ['70d86a86-62a5-468c-bf8e-54df53cde930'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:34:18 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-edfdf51d-4be9-43e2-83a6-09309f2e91f9 tempest-GroupsV314Test-1691964999 None] Created reservations ['7ff497e0-7733-473e-91b3-cf73246b5e37', '5cae585a-421a-41ff-9465-deffeaeab50a', 'bdca02fb-6472-4b8f-9bce-4b0edc89f0d8', 'cf516482-f137-4c4c-aca8-db721dbaa063'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:34:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-edfdf51d-4be9-43e2-83a6-09309f2e91f9 tempest-GroupsV314Test-1691964999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:34:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-edfdf51d-4be9-43e2-83a6-09309f2e91f9 tempest-GroupsV314Test-1691964999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:34:18 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-edfdf51d-4be9-43e2-83a6-09309f2e91f9 tempest-GroupsV314Test-1691964999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:34:18 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-edfdf51d-4be9-43e2-83a6-09309f2e91f9 tempest-GroupsV314Test-1691964999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:34:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-edfdf51d-4be9-43e2-83a6-09309f2e91f9 tempest-GroupsV314Test-1691964999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:34:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-edfdf51d-4be9-43e2-83a6-09309f2e91f9 tempest-GroupsV314Test-1691964999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:34:18 devstack sudo[90992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:34:18 devstack sudo[90992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:34:20 devstack sudo[90992]: pam_unix(sudo:session): session closed for user root
Jul 09 14:34:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-edfdf51d-4be9-43e2-83a6-09309f2e91f9 tempest-GroupsV314Test-1691964999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 1.077s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:34:20 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-edfdf51d-4be9-43e2-83a6-09309f2e91f9 tempest-GroupsV314Test-1691964999 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:34:20 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-edfdf51d-4be9-43e2-83a6-09309f2e91f9 tempest-GroupsV314Test-1691964999 None] Delete group completed successfully.
Jul 09 14:34:27 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-9805b4bd-cbf6-4dfd-b3ec-d7795eaec7f6 tempest-GroupsV320Test-712842375 None] Group tempest-GroupsV320Test-Group-923097452: creating
Jul 09 14:34:27 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-9805b4bd-cbf6-4dfd-b3ec-d7795eaec7f6 tempest-GroupsV320Test-712842375 None] Group tempest-GroupsV320Test-Group-923097452: created successfully
Jul 09 14:34:27 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-9805b4bd-cbf6-4dfd-b3ec-d7795eaec7f6 tempest-GroupsV320Test-712842375 None] Create group completed successfully.
Jul 09 14:34:28 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-5f574d6e-399c-456e-b9ae-768fe32c4d89 tempest-GroupsV320Test-712842375 None] Created reservations ['4f2af2d6-2ed4-49c5-8474-3fb810c64d16'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:34:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5f574d6e-399c-456e-b9ae-768fe32c4d89 tempest-GroupsV320Test-712842375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:34:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5f574d6e-399c-456e-b9ae-768fe32c4d89 tempest-GroupsV320Test-712842375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:34:28 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-5f574d6e-399c-456e-b9ae-768fe32c4d89 tempest-GroupsV320Test-712842375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:34:28 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-5f574d6e-399c-456e-b9ae-768fe32c4d89 tempest-GroupsV320Test-712842375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:34:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5f574d6e-399c-456e-b9ae-768fe32c4d89 tempest-GroupsV320Test-712842375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:34:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5f574d6e-399c-456e-b9ae-768fe32c4d89 tempest-GroupsV320Test-712842375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:34:28 devstack sudo[91070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:34:28 devstack sudo[91070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:34:29 devstack sudo[91070]: pam_unix(sudo:session): session closed for user root
Jul 09 14:34:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5f574d6e-399c-456e-b9ae-768fe32c4d89 tempest-GroupsV320Test-712842375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.725s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:34:29 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-5f574d6e-399c-456e-b9ae-768fe32c4d89 tempest-GroupsV320Test-712842375 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:34:29 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-5f574d6e-399c-456e-b9ae-768fe32c4d89 tempest-GroupsV320Test-712842375 None] Delete group completed successfully.
Jul 09 14:34:36 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-9f3047c5-6f5c-435d-bb78-86ba8fa2be89 req-2853d689-f156-411b-b96b-48c1d6479d78 tempest-AttachVolumeNegativeTest-594851243 None] Terminate volume connection completed successfully.
Jul 09 14:34:36 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-9f3047c5-6f5c-435d-bb78-86ba8fa2be89 req-2853d689-f156-411b-b96b-48c1d6479d78 tempest-AttachVolumeNegativeTest-594851243 None] Deleting attachment 43726c94-6610-4691-ad3a-6cfd929ba6e1. {{(pid=87230) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 09 14:34:38 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=26,cinder:UPDATE=28,cinder:INSERT=6 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 14:34:46 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:UPDATE=34,cinder:SELECT=29,cinder:DELETE=1,cinder:INSERT=6 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 14:34:49 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b1dfd716-9503-4a0b-ae9f-9de94e6f14da tempest-AttachVolumeShelveTestJSON-222680792 None] Acquiring lock "cinder-c98db6c6-1c36-4ee4-b260-abadaf61560c-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:34:49 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b1dfd716-9503-4a0b-ae9f-9de94e6f14da tempest-AttachVolumeShelveTestJSON-222680792 None] Lock "cinder-c98db6c6-1c36-4ee4-b260-abadaf61560c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:34:49 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b1dfd716-9503-4a0b-ae9f-9de94e6f14da tempest-AttachVolumeShelveTestJSON-222680792 None] Acquiring lock "cinder-quobyte-c98db6c6-1c36-4ee4-b260-abadaf61560c" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:34:49 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b1dfd716-9503-4a0b-ae9f-9de94e6f14da tempest-AttachVolumeShelveTestJSON-222680792 None] Lock "cinder-quobyte-c98db6c6-1c36-4ee4-b260-abadaf61560c" acquired by "delete_volume" :: waited 0.015s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:34:49 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc200dac-ca5d-45a6-921f-dd640d94bb9b]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:34:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b1dfd716-9503-4a0b-ae9f-9de94e6f14da tempest-AttachVolumeShelveTestJSON-222680792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-c98db6c6-1c36-4ee4-b260-abadaf61560c {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:34:50 devstack sudo[91292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-c98db6c6-1c36-4ee4-b260-abadaf61560c
Jul 09 14:34:50 devstack sudo[91292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:34:50 devstack sudo[91292]: pam_unix(sudo:session): session closed for user root
Jul 09 14:34:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b1dfd716-9503-4a0b-ae9f-9de94e6f14da tempest-AttachVolumeShelveTestJSON-222680792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-c98db6c6-1c36-4ee4-b260-abadaf61560c" returned: 0 in 0.925s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:34:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b1dfd716-9503-4a0b-ae9f-9de94e6f14da tempest-AttachVolumeShelveTestJSON-222680792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-c98db6c6-1c36-4ee4-b260-abadaf61560c {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:34:50 devstack sudo[91297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-c98db6c6-1c36-4ee4-b260-abadaf61560c
Jul 09 14:34:50 devstack sudo[91297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:34:51 devstack sudo[91297]: pam_unix(sudo:session): session closed for user root
Jul 09 14:34:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b1dfd716-9503-4a0b-ae9f-9de94e6f14da tempest-AttachVolumeShelveTestJSON-222680792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-c98db6c6-1c36-4ee4-b260-abadaf61560c" returned: 0 in 0.858s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:34:51 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b1dfd716-9503-4a0b-ae9f-9de94e6f14da tempest-AttachVolumeShelveTestJSON-222680792 None] Lock "cinder-quobyte-c98db6c6-1c36-4ee4-b260-abadaf61560c" released by "delete_volume" :: held 1.849s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:34:51 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-b1dfd716-9503-4a0b-ae9f-9de94e6f14da tempest-AttachVolumeShelveTestJSON-222680792 None] Created reservations ['752da076-a16f-41c9-8dc2-5fc731856420', '7bb5dd3f-e859-420c-8884-2b6c725b9235', 'cc941db7-52db-40c8-b5b2-9b1d4aa42641', 'ca48b260-03b2-42ea-ab2d-9a99b2d946ec'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:34:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b1dfd716-9503-4a0b-ae9f-9de94e6f14da tempest-AttachVolumeShelveTestJSON-222680792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:34:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b1dfd716-9503-4a0b-ae9f-9de94e6f14da tempest-AttachVolumeShelveTestJSON-222680792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:34:51 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b1dfd716-9503-4a0b-ae9f-9de94e6f14da tempest-AttachVolumeShelveTestJSON-222680792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:34:51 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b1dfd716-9503-4a0b-ae9f-9de94e6f14da tempest-AttachVolumeShelveTestJSON-222680792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:34:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b1dfd716-9503-4a0b-ae9f-9de94e6f14da tempest-AttachVolumeShelveTestJSON-222680792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:34:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b1dfd716-9503-4a0b-ae9f-9de94e6f14da tempest-AttachVolumeShelveTestJSON-222680792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:34:51 devstack sudo[91300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:34:51 devstack sudo[91300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:34:52 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 14:34:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:34:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:34:52 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:34:52 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:34:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:34:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:34:52 devstack sudo[91302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:34:52 devstack sudo[91302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:34:52 devstack sudo[91300]: pam_unix(sudo:session): session closed for user root
Jul 09 14:34:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b1dfd716-9503-4a0b-ae9f-9de94e6f14da tempest-AttachVolumeShelveTestJSON-222680792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.795s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:34:52 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-b1dfd716-9503-4a0b-ae9f-9de94e6f14da tempest-AttachVolumeShelveTestJSON-222680792 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:34:52 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-b1dfd716-9503-4a0b-ae9f-9de94e6f14da tempest-AttachVolumeShelveTestJSON-222680792 None] Deleted volume successfully.
Jul 09 14:34:52 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b1dfd716-9503-4a0b-ae9f-9de94e6f14da tempest-AttachVolumeShelveTestJSON-222680792 None] Lock "cinder-c98db6c6-1c36-4ee4-b260-abadaf61560c-delete_volume" released by "delete_volume" :: held 2.928s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:34:53 devstack sudo[91302]: pam_unix(sudo:session): session closed for user root
Jul 09 14:34:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 1.078s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:34:53 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:34:53 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Running periodic task VolumeManager._thread_info {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 14:34:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] thread count: 8 {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 09 14:34:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] thread info: [<_MainThread(MainThread, started 125388812103808)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125388713797504)>, <Thread(Thread-3 (stat_writer), started daemon 125388699995392)>, <Thread(Rabbit-heartbeat, started daemon 125388700522560)>, <Thread(Thread-5 (_runner), started daemon 125388698545216)>, <Thread(Thread-7 (_runner), started daemon 125388698611264)>, <Thread(fd_logger, started daemon 125388703020672)>, <Thread(privsep_reader, started daemon 125388696441088)>] {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 09 14:35:01 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=3,cinder:UPDATE=10,cinder:INSERT=3 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 14:35:02 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=7,cinder:INSERT=1,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 14:35:18 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4bfcfc6-2a3e-43c5-828c-12986b1757fe tempest-VolumesDeleteCascade-1372244469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:35:18 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f4bfcfc6-2a3e-43c5-828c-12986b1757fe tempest-VolumesDeleteCascade-1372244469 None] Flow 'volume_create_manager' (e0105db1-b6f8-4795-ad8d-f8b57137b294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:35:18 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f4bfcfc6-2a3e-43c5-828c-12986b1757fe tempest-VolumesDeleteCascade-1372244469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82e6d1e0-9af4-44d2-b096-abb60e964709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:35:18 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f4bfcfc6-2a3e-43c5-828c-12986b1757fe tempest-VolumesDeleteCascade-1372244469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82e6d1e0-9af4-44d2-b096-abb60e964709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:35:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-137572578',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39ccd09d-4e5e-4e12-95c5-1e09d5782e98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='553674099675468b9bedebdd045eb81d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:35:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:35:18Z,use_quota=True,user_id='96854a59d5bd4b43bc8d199cc04da205',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:35:18 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f4bfcfc6-2a3e-43c5-828c-12986b1757fe tempest-VolumesDeleteCascade-1372244469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2df2c644-f7a8-4d98-ae17-ca1015157fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:35:18 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f4bfcfc6-2a3e-43c5-828c-12986b1757fe tempest-VolumesDeleteCascade-1372244469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2df2c644-f7a8-4d98-ae17-ca1015157fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:35:18 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f4bfcfc6-2a3e-43c5-828c-12986b1757fe tempest-VolumesDeleteCascade-1372244469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71cefb3b-cdb0-4d3f-ab74-733ff0d3f23b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:35:18 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f4bfcfc6-2a3e-43c5-828c-12986b1757fe tempest-VolumesDeleteCascade-1372244469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71cefb3b-cdb0-4d3f-ab74-733ff0d3f23b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39ccd09d-4e5e-4e12-95c5-1e09d5782e98', 'volume_name': 'volume-39ccd09d-4e5e-4e12-95c5-1e09d5782e98', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:35:18 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f4bfcfc6-2a3e-43c5-828c-12986b1757fe tempest-VolumesDeleteCascade-1372244469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90399903-0be5-4cec-af48-12e0b2e5745f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:35:18 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f4bfcfc6-2a3e-43c5-828c-12986b1757fe tempest-VolumesDeleteCascade-1372244469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90399903-0be5-4cec-af48-12e0b2e5745f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:35:18 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f4bfcfc6-2a3e-43c5-828c-12986b1757fe tempest-VolumesDeleteCascade-1372244469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fa680c8-b09d-4309-94f9-02a5dbe0ee2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:35:18 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-f4bfcfc6-2a3e-43c5-828c-12986b1757fe tempest-VolumesDeleteCascade-1372244469 None] Volume 39ccd09d-4e5e-4e12-95c5-1e09d5782e98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39ccd09d-4e5e-4e12-95c5-1e09d5782e98', 'volume_size': 1}
Jul 09 14:35:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f4bfcfc6-2a3e-43c5-828c-12986b1757fe tempest-VolumesDeleteCascade-1372244469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:35:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f4bfcfc6-2a3e-43c5-828c-12986b1757fe tempest-VolumesDeleteCascade-1372244469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:35:18 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f4bfcfc6-2a3e-43c5-828c-12986b1757fe tempest-VolumesDeleteCascade-1372244469 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:35:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-137572578',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39ccd09d-4e5e-4e12-95c5-1e09d5782e98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='553674099675468b9bedebdd045eb81d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:35:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:35:18Z,use_quota=True,user_id='96854a59d5bd4b43bc8d199cc04da205',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:35:18 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-f4bfcfc6-2a3e-43c5-828c-12986b1757fe tempest-VolumesDeleteCascade-1372244469 None] Creating volume 39ccd09d-4e5e-4e12-95c5-1e09d5782e98 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:35:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f4bfcfc6-2a3e-43c5-828c-12986b1757fe tempest-VolumesDeleteCascade-1372244469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:35:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f4bfcfc6-2a3e-43c5-828c-12986b1757fe tempest-VolumesDeleteCascade-1372244469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:35:18 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f4bfcfc6-2a3e-43c5-828c-12986b1757fe tempest-VolumesDeleteCascade-1372244469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:35:18 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f4bfcfc6-2a3e-43c5-828c-12986b1757fe tempest-VolumesDeleteCascade-1372244469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:35:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f4bfcfc6-2a3e-43c5-828c-12986b1757fe tempest-VolumesDeleteCascade-1372244469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:35:18 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f4bfcfc6-2a3e-43c5-828c-12986b1757fe tempest-VolumesDeleteCascade-1372244469 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:35:18 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-f4bfcfc6-2a3e-43c5-828c-12986b1757fe tempest-VolumesDeleteCascade-1372244469 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:35:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f4bfcfc6-2a3e-43c5-828c-12986b1757fe tempest-VolumesDeleteCascade-1372244469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-39ccd09d-4e5e-4e12-95c5-1e09d5782e98 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:35:18 devstack sudo[91463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-39ccd09d-4e5e-4e12-95c5-1e09d5782e98 1073741824
Jul 09 14:35:18 devstack sudo[91463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:35:19 devstack sudo[91463]: pam_unix(sudo:session): session closed for user root
Jul 09 14:35:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f4bfcfc6-2a3e-43c5-828c-12986b1757fe tempest-VolumesDeleteCascade-1372244469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-39ccd09d-4e5e-4e12-95c5-1e09d5782e98 1073741824" returned: 0 in 1.317s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:35:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f4bfcfc6-2a3e-43c5-828c-12986b1757fe tempest-VolumesDeleteCascade-1372244469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-39ccd09d-4e5e-4e12-95c5-1e09d5782e98 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:35:19 devstack sudo[91470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-39ccd09d-4e5e-4e12-95c5-1e09d5782e98
Jul 09 14:35:19 devstack sudo[91470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:35:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-5b6d38fc-43e5-4be7-8675-81ba9e71f827 req-3f7937ef-eacb-4be1-93e8-446d012aeb46 tempest-TaggedAttachmentsTest-1717979664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:35:21 devstack sudo[91470]: pam_unix(sudo:session): session closed for user root
Jul 09 14:35:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f4bfcfc6-2a3e-43c5-828c-12986b1757fe tempest-VolumesDeleteCascade-1372244469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-39ccd09d-4e5e-4e12-95c5-1e09d5782e98" returned: 0 in 1.447s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:35:21 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f4bfcfc6-2a3e-43c5-828c-12986b1757fe tempest-VolumesDeleteCascade-1372244469 None] <== create_volume: return (2852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:35:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f4bfcfc6-2a3e-43c5-828c-12986b1757fe tempest-VolumesDeleteCascade-1372244469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.856s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:35:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-5b6d38fc-43e5-4be7-8675-81ba9e71f827 req-3f7937ef-eacb-4be1-93e8-446d012aeb46 tempest-TaggedAttachmentsTest-1717979664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.045s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:35:21 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f4bfcfc6-2a3e-43c5-828c-12986b1757fe tempest-VolumesDeleteCascade-1372244469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fa680c8-b09d-4309-94f9-02a5dbe0ee2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39ccd09d-4e5e-4e12-95c5-1e09d5782e98', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:35:21 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f4bfcfc6-2a3e-43c5-828c-12986b1757fe tempest-VolumesDeleteCascade-1372244469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91eabe02-734d-4a08-952f-4c9794a29d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:35:21 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f516573-7e5b-434b-8fd3-bcb77fbb4371]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:35:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-5b6d38fc-43e5-4be7-8675-81ba9e71f827 req-3f7937ef-eacb-4be1-93e8-446d012aeb46 tempest-TaggedAttachmentsTest-1717979664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8a2a10ef-5848-4758-b3c5-f2283f2da7ec {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:35:21 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-f4bfcfc6-2a3e-43c5-828c-12986b1757fe tempest-VolumesDeleteCascade-1372244469 None] Volume volume-39ccd09d-4e5e-4e12-95c5-1e09d5782e98 (39ccd09d-4e5e-4e12-95c5-1e09d5782e98): created successfully
Jul 09 14:35:21 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f4bfcfc6-2a3e-43c5-828c-12986b1757fe tempest-VolumesDeleteCascade-1372244469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91eabe02-734d-4a08-952f-4c9794a29d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:35:21 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f4bfcfc6-2a3e-43c5-828c-12986b1757fe tempest-VolumesDeleteCascade-1372244469 None] Flow 'volume_create_manager' (e0105db1-b6f8-4795-ad8d-f8b57137b294) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:35:21 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-f4bfcfc6-2a3e-43c5-828c-12986b1757fe tempest-VolumesDeleteCascade-1372244469 None] Created volume successfully.
Jul 09 14:35:21 devstack sudo[91485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8a2a10ef-5848-4758-b3c5-f2283f2da7ec
Jul 09 14:35:21 devstack sudo[91485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:35:22 devstack sudo[91485]: pam_unix(sudo:session): session closed for user root
Jul 09 14:35:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-5b6d38fc-43e5-4be7-8675-81ba9e71f827 req-3f7937ef-eacb-4be1-93e8-446d012aeb46 tempest-TaggedAttachmentsTest-1717979664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8a2a10ef-5848-4758-b3c5-f2283f2da7ec" returned: 0 in 1.111s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:35:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-5b6d38fc-43e5-4be7-8675-81ba9e71f827 req-3f7937ef-eacb-4be1-93e8-446d012aeb46 tempest-TaggedAttachmentsTest-1717979664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.170s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:35:22 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-5b6d38fc-43e5-4be7-8675-81ba9e71f827 req-3f7937ef-eacb-4be1-93e8-446d012aeb46 tempest-TaggedAttachmentsTest-1717979664 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653', 'name': 'volume-8a2a10ef-5848-4758-b3c5-f2283f2da7ec', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '55364310-ce5d-4f44-8bc5-6cb9857e17c0', 'enforce_multipath': True} {{(pid=87230) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 09 14:35:22 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-5b6d38fc-43e5-4be7-8675-81ba9e71f827 req-3f7937ef-eacb-4be1-93e8-446d012aeb46 tempest-TaggedAttachmentsTest-1717979664 None] attachment_update completed successfully.
Jul 09 14:35:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-dff1c0ba-fa1f-4cd9-b8a5-709884c13fac tempest-VolumesDeleteCascade-1372244469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:35:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-dff1c0ba-fa1f-4cd9-b8a5-709884c13fac tempest-VolumesDeleteCascade-1372244469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:35:22 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-dff1c0ba-fa1f-4cd9-b8a5-709884c13fac tempest-VolumesDeleteCascade-1372244469 None] Creating offline snapshot fc49a880-3926-4b2d-90eb-1bc6bfad7a5f of volume 39ccd09d-4e5e-4e12-95c5-1e09d5782e98 {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 14:35:23 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[26254edd-f0dc-4d97-8235-bf520eab0e69]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:35:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dff1c0ba-fa1f-4cd9-b8a5-709884c13fac tempest-VolumesDeleteCascade-1372244469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-39ccd09d-4e5e-4e12-95c5-1e09d5782e98 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:35:23 devstack sudo[91559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-39ccd09d-4e5e-4e12-95c5-1e09d5782e98
Jul 09 14:35:23 devstack sudo[91559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:35:24 devstack sudo[91559]: pam_unix(sudo:session): session closed for user root
Jul 09 14:35:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dff1c0ba-fa1f-4cd9-b8a5-709884c13fac tempest-VolumesDeleteCascade-1372244469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-39ccd09d-4e5e-4e12-95c5-1e09d5782e98" returned: 0 in 1.097s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:35:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dff1c0ba-fa1f-4cd9-b8a5-709884c13fac tempest-VolumesDeleteCascade-1372244469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-39ccd09d-4e5e-4e12-95c5-1e09d5782e98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-39ccd09d-4e5e-4e12-95c5-1e09d5782e98.fc49a880-3926-4b2d-90eb-1bc6bfad7a5f 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:35:24 devstack sudo[91903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-39ccd09d-4e5e-4e12-95c5-1e09d5782e98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-39ccd09d-4e5e-4e12-95c5-1e09d5782e98.fc49a880-3926-4b2d-90eb-1bc6bfad7a5f 1G
Jul 09 14:35:24 devstack sudo[91903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:35:25 devstack sudo[91903]: pam_unix(sudo:session): session closed for user root
Jul 09 14:35:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dff1c0ba-fa1f-4cd9-b8a5-709884c13fac tempest-VolumesDeleteCascade-1372244469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-39ccd09d-4e5e-4e12-95c5-1e09d5782e98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-39ccd09d-4e5e-4e12-95c5-1e09d5782e98.fc49a880-3926-4b2d-90eb-1bc6bfad7a5f 1G" returned: 0 in 1.014s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:35:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dff1c0ba-fa1f-4cd9-b8a5-709884c13fac tempest-VolumesDeleteCascade-1372244469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39ccd09d-4e5e-4e12-95c5-1e09d5782e98 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-39ccd09d-4e5e-4e12-95c5-1e09d5782e98.fc49a880-3926-4b2d-90eb-1bc6bfad7a5f {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:35:25 devstack sudo[91911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39ccd09d-4e5e-4e12-95c5-1e09d5782e98 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-39ccd09d-4e5e-4e12-95c5-1e09d5782e98.fc49a880-3926-4b2d-90eb-1bc6bfad7a5f
Jul 09 14:35:25 devstack sudo[91911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:35:25 devstack sudo[91911]: pam_unix(sudo:session): session closed for user root
Jul 09 14:35:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dff1c0ba-fa1f-4cd9-b8a5-709884c13fac tempest-VolumesDeleteCascade-1372244469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39ccd09d-4e5e-4e12-95c5-1e09d5782e98 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-39ccd09d-4e5e-4e12-95c5-1e09d5782e98.fc49a880-3926-4b2d-90eb-1bc6bfad7a5f" returned: 0 in 0.667s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:35:25 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-dff1c0ba-fa1f-4cd9-b8a5-709884c13fac tempest-VolumesDeleteCascade-1372244469 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-39ccd09d-4e5e-4e12-95c5-1e09d5782e98.fc49a880-3926-4b2d-90eb-1bc6bfad7a5f is being set with open permissions: ugo+rw
Jul 09 14:35:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dff1c0ba-fa1f-4cd9-b8a5-709884c13fac tempest-VolumesDeleteCascade-1372244469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-39ccd09d-4e5e-4e12-95c5-1e09d5782e98.fc49a880-3926-4b2d-90eb-1bc6bfad7a5f {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:35:25 devstack sudo[91916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-39ccd09d-4e5e-4e12-95c5-1e09d5782e98.fc49a880-3926-4b2d-90eb-1bc6bfad7a5f
Jul 09 14:35:25 devstack sudo[91916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:35:26 devstack sudo[91916]: pam_unix(sudo:session): session closed for user root
Jul 09 14:35:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dff1c0ba-fa1f-4cd9-b8a5-709884c13fac tempest-VolumesDeleteCascade-1372244469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-39ccd09d-4e5e-4e12-95c5-1e09d5782e98.fc49a880-3926-4b2d-90eb-1bc6bfad7a5f" returned: 0 in 0.633s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:35:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dff1c0ba-fa1f-4cd9-b8a5-709884c13fac tempest-VolumesDeleteCascade-1372244469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-39ccd09d-4e5e-4e12-95c5-1e09d5782e98.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:35:26 devstack sudo[91919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-39ccd09d-4e5e-4e12-95c5-1e09d5782e98.info
Jul 09 14:35:26 devstack sudo[91919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:35:27 devstack sudo[91919]: pam_unix(sudo:session): session closed for user root
Jul 09 14:35:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dff1c0ba-fa1f-4cd9-b8a5-709884c13fac tempest-VolumesDeleteCascade-1372244469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-39ccd09d-4e5e-4e12-95c5-1e09d5782e98.info" returned: 0 in 0.637s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:35:27 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-dff1c0ba-fa1f-4cd9-b8a5-709884c13fac tempest-VolumesDeleteCascade-1372244469 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-39ccd09d-4e5e-4e12-95c5-1e09d5782e98.info is being set with open permissions: ugo+rw
Jul 09 14:35:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dff1c0ba-fa1f-4cd9-b8a5-709884c13fac tempest-VolumesDeleteCascade-1372244469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-39ccd09d-4e5e-4e12-95c5-1e09d5782e98.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:35:27 devstack sudo[91926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-39ccd09d-4e5e-4e12-95c5-1e09d5782e98.info
Jul 09 14:35:27 devstack sudo[91926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:35:27 devstack sudo[91926]: pam_unix(sudo:session): session closed for user root
Jul 09 14:35:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dff1c0ba-fa1f-4cd9-b8a5-709884c13fac tempest-VolumesDeleteCascade-1372244469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-39ccd09d-4e5e-4e12-95c5-1e09d5782e98.info" returned: 0 in 0.700s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:35:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-dff1c0ba-fa1f-4cd9-b8a5-709884c13fac tempest-VolumesDeleteCascade-1372244469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.900s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:35:27 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-dff1c0ba-fa1f-4cd9-b8a5-709884c13fac tempest-VolumesDeleteCascade-1372244469 None] Create snapshot completed successfully
Jul 09 14:35:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1f268d56-dfcf-401e-969a-549c5048f84e tempest-VolumesDeleteCascade-1372244469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:35:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1f268d56-dfcf-401e-969a-549c5048f84e tempest-VolumesDeleteCascade-1372244469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:35:28 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-1f268d56-dfcf-401e-969a-549c5048f84e tempest-VolumesDeleteCascade-1372244469 None] Creating offline snapshot 63439535-23b0-48f4-ab4b-86e5734ff3b4 of volume 39ccd09d-4e5e-4e12-95c5-1e09d5782e98 {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 14:35:28 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[646a0d93-ad4a-4571-94c7-2a4e88427b21]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:35:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1f268d56-dfcf-401e-969a-549c5048f84e tempest-VolumesDeleteCascade-1372244469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-39ccd09d-4e5e-4e12-95c5-1e09d5782e98.fc49a880-3926-4b2d-90eb-1bc6bfad7a5f {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:35:28 devstack sudo[91930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-39ccd09d-4e5e-4e12-95c5-1e09d5782e98.fc49a880-3926-4b2d-90eb-1bc6bfad7a5f
Jul 09 14:35:28 devstack sudo[91930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:35:29 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-e9286c99-16cb-47ac-a3f7-18da04528fc3 req-73b8e662-88a3-4a1b-ae5d-63ef84e8933d tempest-TaggedAttachmentsTest-1717979664 None] Terminate volume connection completed successfully.
Jul 09 14:35:29 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-e9286c99-16cb-47ac-a3f7-18da04528fc3 req-73b8e662-88a3-4a1b-ae5d-63ef84e8933d tempest-TaggedAttachmentsTest-1717979664 None] Deleting attachment 55364310-ce5d-4f44-8bc5-6cb9857e17c0. {{(pid=87230) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 09 14:35:29 devstack sudo[91930]: pam_unix(sudo:session): session closed for user root
Jul 09 14:35:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1f268d56-dfcf-401e-969a-549c5048f84e tempest-VolumesDeleteCascade-1372244469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-39ccd09d-4e5e-4e12-95c5-1e09d5782e98.fc49a880-3926-4b2d-90eb-1bc6bfad7a5f" returned: 0 in 0.858s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:35:29 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-1f268d56-dfcf-401e-969a-549c5048f84e tempest-VolumesDeleteCascade-1372244469 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-39ccd09d-4e5e-4e12-95c5-1e09d5782e98(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 14:35:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1f268d56-dfcf-401e-969a-549c5048f84e tempest-VolumesDeleteCascade-1372244469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-39ccd09d-4e5e-4e12-95c5-1e09d5782e98.fc49a880-3926-4b2d-90eb-1bc6bfad7a5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-39ccd09d-4e5e-4e12-95c5-1e09d5782e98.63439535-23b0-48f4-ab4b-86e5734ff3b4 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:35:29 devstack sudo[91964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-39ccd09d-4e5e-4e12-95c5-1e09d5782e98.fc49a880-3926-4b2d-90eb-1bc6bfad7a5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-39ccd09d-4e5e-4e12-95c5-1e09d5782e98.63439535-23b0-48f4-ab4b-86e5734ff3b4 1G
Jul 09 14:35:29 devstack sudo[91964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:35:30 devstack sudo[91964]: pam_unix(sudo:session): session closed for user root
Jul 09 14:35:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1f268d56-dfcf-401e-969a-549c5048f84e tempest-VolumesDeleteCascade-1372244469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-39ccd09d-4e5e-4e12-95c5-1e09d5782e98.fc49a880-3926-4b2d-90eb-1bc6bfad7a5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-39ccd09d-4e5e-4e12-95c5-1e09d5782e98.63439535-23b0-48f4-ab4b-86e5734ff3b4 1G" returned: 0 in 1.071s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:35:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1f268d56-dfcf-401e-969a-549c5048f84e tempest-VolumesDeleteCascade-1372244469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39ccd09d-4e5e-4e12-95c5-1e09d5782e98.fc49a880-3926-4b2d-90eb-1bc6bfad7a5f -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-39ccd09d-4e5e-4e12-95c5-1e09d5782e98.63439535-23b0-48f4-ab4b-86e5734ff3b4 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:35:30 devstack sudo[91972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39ccd09d-4e5e-4e12-95c5-1e09d5782e98.fc49a880-3926-4b2d-90eb-1bc6bfad7a5f -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-39ccd09d-4e5e-4e12-95c5-1e09d5782e98.63439535-23b0-48f4-ab4b-86e5734ff3b4
Jul 09 14:35:30 devstack sudo[91972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:35:31 devstack sudo[91972]: pam_unix(sudo:session): session closed for user root
Jul 09 14:35:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1f268d56-dfcf-401e-969a-549c5048f84e tempest-VolumesDeleteCascade-1372244469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39ccd09d-4e5e-4e12-95c5-1e09d5782e98.fc49a880-3926-4b2d-90eb-1bc6bfad7a5f -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-39ccd09d-4e5e-4e12-95c5-1e09d5782e98.63439535-23b0-48f4-ab4b-86e5734ff3b4" returned: 0 in 0.883s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:35:31 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-1f268d56-dfcf-401e-969a-549c5048f84e tempest-VolumesDeleteCascade-1372244469 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-39ccd09d-4e5e-4e12-95c5-1e09d5782e98.63439535-23b0-48f4-ab4b-86e5734ff3b4 is being set with open permissions: ugo+rw
Jul 09 14:35:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1f268d56-dfcf-401e-969a-549c5048f84e tempest-VolumesDeleteCascade-1372244469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-39ccd09d-4e5e-4e12-95c5-1e09d5782e98.63439535-23b0-48f4-ab4b-86e5734ff3b4 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:35:31 devstack sudo[91983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-39ccd09d-4e5e-4e12-95c5-1e09d5782e98.63439535-23b0-48f4-ab4b-86e5734ff3b4
Jul 09 14:35:31 devstack sudo[91983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:35:32 devstack sudo[91983]: pam_unix(sudo:session): session closed for user root
Jul 09 14:35:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1f268d56-dfcf-401e-969a-549c5048f84e tempest-VolumesDeleteCascade-1372244469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-39ccd09d-4e5e-4e12-95c5-1e09d5782e98.63439535-23b0-48f4-ab4b-86e5734ff3b4" returned: 0 in 0.931s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:35:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1f268d56-dfcf-401e-969a-549c5048f84e tempest-VolumesDeleteCascade-1372244469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.867s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:35:32 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-1f268d56-dfcf-401e-969a-549c5048f84e tempest-VolumesDeleteCascade-1372244469 None] Create snapshot completed successfully
Jul 09 14:35:32 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e5f1310b-97dd-43f6-9791-c82d6b3ca8db tempest-VolumesDeleteCascade-1372244469 None] Acquiring lock "cinder-39ccd09d-4e5e-4e12-95c5-1e09d5782e98-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:35:32 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e5f1310b-97dd-43f6-9791-c82d6b3ca8db tempest-VolumesDeleteCascade-1372244469 None] Lock "cinder-39ccd09d-4e5e-4e12-95c5-1e09d5782e98-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:35:32 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e5f1310b-97dd-43f6-9791-c82d6b3ca8db tempest-VolumesDeleteCascade-1372244469 None] Performing cascade delete. {{(pid=87230) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Jul 09 14:35:32 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e5f1310b-97dd-43f6-9791-c82d6b3ca8db tempest-VolumesDeleteCascade-1372244469 None] Acquiring lock "cinder-63439535-23b0-48f4-ab4b-86e5734ff3b4-delete_snapshot" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:35:32 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e5f1310b-97dd-43f6-9791-c82d6b3ca8db tempest-VolumesDeleteCascade-1372244469 None] Lock "cinder-63439535-23b0-48f4-ab4b-86e5734ff3b4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:35:32 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e5f1310b-97dd-43f6-9791-c82d6b3ca8db tempest-VolumesDeleteCascade-1372244469 None] Acquiring lock "cinder-quobyte-39ccd09d-4e5e-4e12-95c5-1e09d5782e98" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:35:33 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e5f1310b-97dd-43f6-9791-c82d6b3ca8db tempest-VolumesDeleteCascade-1372244469 None] Lock "cinder-quobyte-39ccd09d-4e5e-4e12-95c5-1e09d5782e98" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:35:33 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e5f1310b-97dd-43f6-9791-c82d6b3ca8db tempest-VolumesDeleteCascade-1372244469 None] Acquiring lock "cinder-quobyte-63439535-23b0-48f4-ab4b-86e5734ff3b4" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:35:33 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e5f1310b-97dd-43f6-9791-c82d6b3ca8db tempest-VolumesDeleteCascade-1372244469 None] Lock "cinder-quobyte-63439535-23b0-48f4-ab4b-86e5734ff3b4" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:35:33 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-e5f1310b-97dd-43f6-9791-c82d6b3ca8db tempest-VolumesDeleteCascade-1372244469 None] Deleting offline snapshot 63439535-23b0-48f4-ab4b-86e5734ff3b4 of volume 39ccd09d-4e5e-4e12-95c5-1e09d5782e98 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 14:35:33 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-e5f1310b-97dd-43f6-9791-c82d6b3ca8db tempest-VolumesDeleteCascade-1372244469 None] snapshot_file for this snap is: volume-39ccd09d-4e5e-4e12-95c5-1e09d5782e98.63439535-23b0-48f4-ab4b-86e5734ff3b4 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 14:35:33 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee0e97f7-7f53-443a-908e-038d21089069]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:35:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e5f1310b-97dd-43f6-9791-c82d6b3ca8db tempest-VolumesDeleteCascade-1372244469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-39ccd09d-4e5e-4e12-95c5-1e09d5782e98.63439535-23b0-48f4-ab4b-86e5734ff3b4 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:35:33 devstack sudo[92017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-39ccd09d-4e5e-4e12-95c5-1e09d5782e98.63439535-23b0-48f4-ab4b-86e5734ff3b4
Jul 09 14:35:33 devstack sudo[92017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:35:33 devstack sudo[92017]: pam_unix(sudo:session): session closed for user root
Jul 09 14:35:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e5f1310b-97dd-43f6-9791-c82d6b3ca8db tempest-VolumesDeleteCascade-1372244469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-39ccd09d-4e5e-4e12-95c5-1e09d5782e98.63439535-23b0-48f4-ab4b-86e5734ff3b4" returned: 0 in 0.894s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:35:33 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-e5f1310b-97dd-43f6-9791-c82d6b3ca8db tempest-VolumesDeleteCascade-1372244469 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-39ccd09d-4e5e-4e12-95c5-1e09d5782e98(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 14:35:33 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a42787-87f1-4110-bd3a-e9d1bcdd594d]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:35:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e5f1310b-97dd-43f6-9791-c82d6b3ca8db tempest-VolumesDeleteCascade-1372244469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-39ccd09d-4e5e-4e12-95c5-1e09d5782e98.fc49a880-3926-4b2d-90eb-1bc6bfad7a5f {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:35:34 devstack sudo[92022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-39ccd09d-4e5e-4e12-95c5-1e09d5782e98.fc49a880-3926-4b2d-90eb-1bc6bfad7a5f
Jul 09 14:35:34 devstack sudo[92022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:35:34 devstack sudo[92022]: pam_unix(sudo:session): session closed for user root
Jul 09 14:35:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e5f1310b-97dd-43f6-9791-c82d6b3ca8db tempest-VolumesDeleteCascade-1372244469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-39ccd09d-4e5e-4e12-95c5-1e09d5782e98.fc49a880-3926-4b2d-90eb-1bc6bfad7a5f" returned: 0 in 0.807s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:35:34 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-e5f1310b-97dd-43f6-9791-c82d6b3ca8db tempest-VolumesDeleteCascade-1372244469 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-39ccd09d-4e5e-4e12-95c5-1e09d5782e98(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 14:35:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e5f1310b-97dd-43f6-9791-c82d6b3ca8db tempest-VolumesDeleteCascade-1372244469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-39ccd09d-4e5e-4e12-95c5-1e09d5782e98.63439535-23b0-48f4-ab4b-86e5734ff3b4 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:35:34 devstack sudo[92027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-39ccd09d-4e5e-4e12-95c5-1e09d5782e98.63439535-23b0-48f4-ab4b-86e5734ff3b4
Jul 09 14:35:34 devstack sudo[92027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:35:36 devstack sudo[92027]: pam_unix(sudo:session): session closed for user root
Jul 09 14:35:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e5f1310b-97dd-43f6-9791-c82d6b3ca8db tempest-VolumesDeleteCascade-1372244469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-39ccd09d-4e5e-4e12-95c5-1e09d5782e98.63439535-23b0-48f4-ab4b-86e5734ff3b4" returned: 0 in 1.475s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:35:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e5f1310b-97dd-43f6-9791-c82d6b3ca8db tempest-VolumesDeleteCascade-1372244469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-39ccd09d-4e5e-4e12-95c5-1e09d5782e98.63439535-23b0-48f4-ab4b-86e5734ff3b4 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:35:36 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-670b3fb9-5de7-4600-bbf1-3137a9fe5347 tempest-AttachVolumeNegativeTest-594851243 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:35:36 devstack sudo[92115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-39ccd09d-4e5e-4e12-95c5-1e09d5782e98.63439535-23b0-48f4-ab4b-86e5734ff3b4
Jul 09 14:35:36 devstack sudo[92115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:35:36 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-670b3fb9-5de7-4600-bbf1-3137a9fe5347 tempest-AttachVolumeNegativeTest-594851243 None] Flow 'volume_create_manager' (2ff427d2-8019-490d-993b-1e04ca1696af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:35:36 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-670b3fb9-5de7-4600-bbf1-3137a9fe5347 tempest-AttachVolumeNegativeTest-594851243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e8544be-b3b1-4249-a9be-a86baf44d2d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:35:36 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-670b3fb9-5de7-4600-bbf1-3137a9fe5347 tempest-AttachVolumeNegativeTest-594851243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e8544be-b3b1-4249-a9be-a86baf44d2d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:35:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1997006701',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83f65cd0-4847-4f35-aafd-8542018a0561,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e12f6e1be054416827515b9bb0da885',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:35:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:35:36Z,use_quota=True,user_id='9c9a26714c9349c2b8e073697960118b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:35:36 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-670b3fb9-5de7-4600-bbf1-3137a9fe5347 tempest-AttachVolumeNegativeTest-594851243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5593e0c5-e2db-4f07-af4f-4cef9f0c8107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:35:36 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-670b3fb9-5de7-4600-bbf1-3137a9fe5347 tempest-AttachVolumeNegativeTest-594851243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5593e0c5-e2db-4f07-af4f-4cef9f0c8107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:35:36 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-670b3fb9-5de7-4600-bbf1-3137a9fe5347 tempest-AttachVolumeNegativeTest-594851243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (298ce8df-4d54-40ab-abc7-214c38642ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:35:36 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-670b3fb9-5de7-4600-bbf1-3137a9fe5347 tempest-AttachVolumeNegativeTest-594851243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (298ce8df-4d54-40ab-abc7-214c38642ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83f65cd0-4847-4f35-aafd-8542018a0561', 'volume_name': 'volume-83f65cd0-4847-4f35-aafd-8542018a0561', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:35:36 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-670b3fb9-5de7-4600-bbf1-3137a9fe5347 tempest-AttachVolumeNegativeTest-594851243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c925951-498c-4e3a-8e34-d41fbbfa63d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:35:36 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-670b3fb9-5de7-4600-bbf1-3137a9fe5347 tempest-AttachVolumeNegativeTest-594851243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c925951-498c-4e3a-8e34-d41fbbfa63d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:35:36 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-670b3fb9-5de7-4600-bbf1-3137a9fe5347 tempest-AttachVolumeNegativeTest-594851243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63b7fbe0-0301-4c0d-bb6f-1b4f92e86524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:35:36 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-670b3fb9-5de7-4600-bbf1-3137a9fe5347 tempest-AttachVolumeNegativeTest-594851243 None] Volume 83f65cd0-4847-4f35-aafd-8542018a0561: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83f65cd0-4847-4f35-aafd-8542018a0561', 'volume_size': 1}
Jul 09 14:35:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-670b3fb9-5de7-4600-bbf1-3137a9fe5347 tempest-AttachVolumeNegativeTest-594851243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:35:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-670b3fb9-5de7-4600-bbf1-3137a9fe5347 tempest-AttachVolumeNegativeTest-594851243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:35:36 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-670b3fb9-5de7-4600-bbf1-3137a9fe5347 tempest-AttachVolumeNegativeTest-594851243 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:35:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1997006701',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83f65cd0-4847-4f35-aafd-8542018a0561,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e12f6e1be054416827515b9bb0da885',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:35:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:35:36Z,use_quota=True,user_id='9c9a26714c9349c2b8e073697960118b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:35:36 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-670b3fb9-5de7-4600-bbf1-3137a9fe5347 tempest-AttachVolumeNegativeTest-594851243 None] Creating volume 83f65cd0-4847-4f35-aafd-8542018a0561 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:35:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-670b3fb9-5de7-4600-bbf1-3137a9fe5347 tempest-AttachVolumeNegativeTest-594851243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:35:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-670b3fb9-5de7-4600-bbf1-3137a9fe5347 tempest-AttachVolumeNegativeTest-594851243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:35:36 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-670b3fb9-5de7-4600-bbf1-3137a9fe5347 tempest-AttachVolumeNegativeTest-594851243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:35:36 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-670b3fb9-5de7-4600-bbf1-3137a9fe5347 tempest-AttachVolumeNegativeTest-594851243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:35:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-670b3fb9-5de7-4600-bbf1-3137a9fe5347 tempest-AttachVolumeNegativeTest-594851243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:35:36 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-670b3fb9-5de7-4600-bbf1-3137a9fe5347 tempest-AttachVolumeNegativeTest-594851243 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:35:36 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-670b3fb9-5de7-4600-bbf1-3137a9fe5347 tempest-AttachVolumeNegativeTest-594851243 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:35:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-670b3fb9-5de7-4600-bbf1-3137a9fe5347 tempest-AttachVolumeNegativeTest-594851243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-83f65cd0-4847-4f35-aafd-8542018a0561 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:35:36 devstack sudo[92117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-83f65cd0-4847-4f35-aafd-8542018a0561 1073741824
Jul 09 14:35:36 devstack sudo[92117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:35:37 devstack sudo[92115]: pam_unix(sudo:session): session closed for user root
Jul 09 14:35:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e5f1310b-97dd-43f6-9791-c82d6b3ca8db tempest-VolumesDeleteCascade-1372244469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-39ccd09d-4e5e-4e12-95c5-1e09d5782e98.63439535-23b0-48f4-ab4b-86e5734ff3b4" returned: 0 in 0.805s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:35:37 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e5f1310b-97dd-43f6-9791-c82d6b3ca8db tempest-VolumesDeleteCascade-1372244469 None] Lock "cinder-quobyte-63439535-23b0-48f4-ab4b-86e5734ff3b4" released by "_delete_snapshot" :: held 4.110s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:35:37 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e5f1310b-97dd-43f6-9791-c82d6b3ca8db tempest-VolumesDeleteCascade-1372244469 None] Lock "cinder-quobyte-39ccd09d-4e5e-4e12-95c5-1e09d5782e98" released by "delete_snapshot" :: held 4.133s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:35:37 devstack cinder-volume[87230]: WARNING cinder.quota [None req-e5f1310b-97dd-43f6-9791-c82d6b3ca8db tempest-VolumesDeleteCascade-1372244469 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jul 09 14:35:37 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-e5f1310b-97dd-43f6-9791-c82d6b3ca8db tempest-VolumesDeleteCascade-1372244469 None] Created reservations ['e231dc63-d74e-4cea-b7e9-19109e620e2f', 'a11bf7f2-67a2-4c15-a359-25d13ec0c4e3', '82f9a200-ff51-4a42-aa22-1459ed9e0cec', '46a1989e-42a6-4894-b7e7-8207fbc63b25'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:35:37 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-e5f1310b-97dd-43f6-9791-c82d6b3ca8db tempest-VolumesDeleteCascade-1372244469 None] Delete snapshot completed successfully.
Jul 09 14:35:37 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e5f1310b-97dd-43f6-9791-c82d6b3ca8db tempest-VolumesDeleteCascade-1372244469 None] Lock "cinder-63439535-23b0-48f4-ab4b-86e5734ff3b4-delete_snapshot" released by "delete_snapshot" :: held 4.355s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:35:37 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e5f1310b-97dd-43f6-9791-c82d6b3ca8db tempest-VolumesDeleteCascade-1372244469 None] Acquiring lock "cinder-fc49a880-3926-4b2d-90eb-1bc6bfad7a5f-delete_snapshot" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:35:37 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e5f1310b-97dd-43f6-9791-c82d6b3ca8db tempest-VolumesDeleteCascade-1372244469 None] Lock "cinder-fc49a880-3926-4b2d-90eb-1bc6bfad7a5f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:35:37 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e5f1310b-97dd-43f6-9791-c82d6b3ca8db tempest-VolumesDeleteCascade-1372244469 None] Acquiring lock "cinder-quobyte-39ccd09d-4e5e-4e12-95c5-1e09d5782e98" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:35:37 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e5f1310b-97dd-43f6-9791-c82d6b3ca8db tempest-VolumesDeleteCascade-1372244469 None] Lock "cinder-quobyte-39ccd09d-4e5e-4e12-95c5-1e09d5782e98" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:35:37 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e5f1310b-97dd-43f6-9791-c82d6b3ca8db tempest-VolumesDeleteCascade-1372244469 None] Acquiring lock "cinder-quobyte-fc49a880-3926-4b2d-90eb-1bc6bfad7a5f" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:35:37 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e5f1310b-97dd-43f6-9791-c82d6b3ca8db tempest-VolumesDeleteCascade-1372244469 None] Lock "cinder-quobyte-fc49a880-3926-4b2d-90eb-1bc6bfad7a5f" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:35:37 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-e5f1310b-97dd-43f6-9791-c82d6b3ca8db tempest-VolumesDeleteCascade-1372244469 None] Deleting offline snapshot fc49a880-3926-4b2d-90eb-1bc6bfad7a5f of volume 39ccd09d-4e5e-4e12-95c5-1e09d5782e98 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 14:35:37 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-e5f1310b-97dd-43f6-9791-c82d6b3ca8db tempest-VolumesDeleteCascade-1372244469 None] snapshot_file for this snap is: volume-39ccd09d-4e5e-4e12-95c5-1e09d5782e98.fc49a880-3926-4b2d-90eb-1bc6bfad7a5f {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 14:35:37 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[154a28f9-63bb-409f-a260-4c8ed9040bde]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:35:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e5f1310b-97dd-43f6-9791-c82d6b3ca8db tempest-VolumesDeleteCascade-1372244469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-39ccd09d-4e5e-4e12-95c5-1e09d5782e98.fc49a880-3926-4b2d-90eb-1bc6bfad7a5f {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:35:37 devstack sudo[92148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-39ccd09d-4e5e-4e12-95c5-1e09d5782e98.fc49a880-3926-4b2d-90eb-1bc6bfad7a5f
Jul 09 14:35:37 devstack sudo[92148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:35:37 devstack sudo[92117]: pam_unix(sudo:session): session closed for user root
Jul 09 14:35:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-670b3fb9-5de7-4600-bbf1-3137a9fe5347 tempest-AttachVolumeNegativeTest-594851243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-83f65cd0-4847-4f35-aafd-8542018a0561 1073741824" returned: 0 in 1.211s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:35:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-670b3fb9-5de7-4600-bbf1-3137a9fe5347 tempest-AttachVolumeNegativeTest-594851243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-83f65cd0-4847-4f35-aafd-8542018a0561 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:35:37 devstack sudo[92150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-83f65cd0-4847-4f35-aafd-8542018a0561
Jul 09 14:35:37 devstack sudo[92150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:35:38 devstack sudo[92150]: pam_unix(sudo:session): session closed for user root
Jul 09 14:35:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-670b3fb9-5de7-4600-bbf1-3137a9fe5347 tempest-AttachVolumeNegativeTest-594851243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-83f65cd0-4847-4f35-aafd-8542018a0561" returned: 0 in 0.882s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:35:38 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-670b3fb9-5de7-4600-bbf1-3137a9fe5347 tempest-AttachVolumeNegativeTest-594851243 None] <== create_volume: return (2159ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:35:38 devstack sudo[92148]: pam_unix(sudo:session): session closed for user root
Jul 09 14:35:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-670b3fb9-5de7-4600-bbf1-3137a9fe5347 tempest-AttachVolumeNegativeTest-594851243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.162s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:35:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e5f1310b-97dd-43f6-9791-c82d6b3ca8db tempest-VolumesDeleteCascade-1372244469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-39ccd09d-4e5e-4e12-95c5-1e09d5782e98.fc49a880-3926-4b2d-90eb-1bc6bfad7a5f" returned: 0 in 1.118s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:35:38 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-e5f1310b-97dd-43f6-9791-c82d6b3ca8db tempest-VolumesDeleteCascade-1372244469 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-39ccd09d-4e5e-4e12-95c5-1e09d5782e98(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 14:35:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-670b3fb9-5de7-4600-bbf1-3137a9fe5347 tempest-AttachVolumeNegativeTest-594851243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63b7fbe0-0301-4c0d-bb6f-1b4f92e86524) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83f65cd0-4847-4f35-aafd-8542018a0561', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:35:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-670b3fb9-5de7-4600-bbf1-3137a9fe5347 tempest-AttachVolumeNegativeTest-594851243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (739f69b6-a188-4b5b-8d8c-77b9e023306f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:35:38 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[20df0f9b-fc7c-41b7-b4d3-c842145a1465]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:35:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e5f1310b-97dd-43f6-9791-c82d6b3ca8db tempest-VolumesDeleteCascade-1372244469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-39ccd09d-4e5e-4e12-95c5-1e09d5782e98 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:35:38 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-670b3fb9-5de7-4600-bbf1-3137a9fe5347 tempest-AttachVolumeNegativeTest-594851243 None] Volume volume-83f65cd0-4847-4f35-aafd-8542018a0561 (83f65cd0-4847-4f35-aafd-8542018a0561): created successfully
Jul 09 14:35:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-670b3fb9-5de7-4600-bbf1-3137a9fe5347 tempest-AttachVolumeNegativeTest-594851243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (739f69b6-a188-4b5b-8d8c-77b9e023306f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:35:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-670b3fb9-5de7-4600-bbf1-3137a9fe5347 tempest-AttachVolumeNegativeTest-594851243 None] Flow 'volume_create_manager' (2ff427d2-8019-490d-993b-1e04ca1696af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:35:38 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-670b3fb9-5de7-4600-bbf1-3137a9fe5347 tempest-AttachVolumeNegativeTest-594851243 None] Created volume successfully.
Jul 09 14:35:38 devstack sudo[92159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-39ccd09d-4e5e-4e12-95c5-1e09d5782e98
Jul 09 14:35:38 devstack sudo[92159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:35:39 devstack sudo[92159]: pam_unix(sudo:session): session closed for user root
Jul 09 14:35:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e5f1310b-97dd-43f6-9791-c82d6b3ca8db tempest-VolumesDeleteCascade-1372244469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-39ccd09d-4e5e-4e12-95c5-1e09d5782e98" returned: 0 in 1.020s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:35:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e5f1310b-97dd-43f6-9791-c82d6b3ca8db tempest-VolumesDeleteCascade-1372244469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-39ccd09d-4e5e-4e12-95c5-1e09d5782e98.fc49a880-3926-4b2d-90eb-1bc6bfad7a5f {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:35:39 devstack sudo[92173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-39ccd09d-4e5e-4e12-95c5-1e09d5782e98.fc49a880-3926-4b2d-90eb-1bc6bfad7a5f
Jul 09 14:35:39 devstack sudo[92173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:35:40 devstack sudo[92173]: pam_unix(sudo:session): session closed for user root
Jul 09 14:35:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e5f1310b-97dd-43f6-9791-c82d6b3ca8db tempest-VolumesDeleteCascade-1372244469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-39ccd09d-4e5e-4e12-95c5-1e09d5782e98.fc49a880-3926-4b2d-90eb-1bc6bfad7a5f" returned: 0 in 1.203s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:35:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e5f1310b-97dd-43f6-9791-c82d6b3ca8db tempest-VolumesDeleteCascade-1372244469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-39ccd09d-4e5e-4e12-95c5-1e09d5782e98.fc49a880-3926-4b2d-90eb-1bc6bfad7a5f {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:35:40 devstack sudo[92194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-39ccd09d-4e5e-4e12-95c5-1e09d5782e98.fc49a880-3926-4b2d-90eb-1bc6bfad7a5f
Jul 09 14:35:40 devstack sudo[92194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:35:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e5f1310b-97dd-43f6-9791-c82d6b3ca8db tempest-VolumesDeleteCascade-1372244469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-39ccd09d-4e5e-4e12-95c5-1e09d5782e98.fc49a880-3926-4b2d-90eb-1bc6bfad7a5f" returned: 0 in 1.148s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:35:41 devstack sudo[92194]: pam_unix(sudo:session): session closed for user root
Jul 09 14:35:42 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e5f1310b-97dd-43f6-9791-c82d6b3ca8db tempest-VolumesDeleteCascade-1372244469 None] Lock "cinder-quobyte-fc49a880-3926-4b2d-90eb-1bc6bfad7a5f" released by "_delete_snapshot" :: held 4.646s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:35:42 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e5f1310b-97dd-43f6-9791-c82d6b3ca8db tempest-VolumesDeleteCascade-1372244469 None] Lock "cinder-quobyte-39ccd09d-4e5e-4e12-95c5-1e09d5782e98" released by "delete_snapshot" :: held 4.683s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:35:42 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-e5f1310b-97dd-43f6-9791-c82d6b3ca8db tempest-VolumesDeleteCascade-1372244469 None] Created reservations ['64efdb72-5f37-4164-a930-038a675ba7a5', 'b9db5be6-126d-43a0-8b34-da925e650884', 'b5c5ac05-92ee-4326-b033-09e8942f0340', '0e89df3e-bf60-4454-9ff8-8df486d7d6df'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:35:42 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-e5f1310b-97dd-43f6-9791-c82d6b3ca8db tempest-VolumesDeleteCascade-1372244469 None] Delete snapshot completed successfully.
Jul 09 14:35:42 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e5f1310b-97dd-43f6-9791-c82d6b3ca8db tempest-VolumesDeleteCascade-1372244469 None] Lock "cinder-fc49a880-3926-4b2d-90eb-1bc6bfad7a5f-delete_snapshot" released by "delete_snapshot" :: held 4.926s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:35:42 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e5f1310b-97dd-43f6-9791-c82d6b3ca8db tempest-VolumesDeleteCascade-1372244469 None] Snapshots deleted, issuing volume delete {{(pid=87230) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Jul 09 14:35:42 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e5f1310b-97dd-43f6-9791-c82d6b3ca8db tempest-VolumesDeleteCascade-1372244469 None] Acquiring lock "cinder-quobyte-39ccd09d-4e5e-4e12-95c5-1e09d5782e98" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:35:42 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e5f1310b-97dd-43f6-9791-c82d6b3ca8db tempest-VolumesDeleteCascade-1372244469 None] Lock "cinder-quobyte-39ccd09d-4e5e-4e12-95c5-1e09d5782e98" acquired by "delete_volume" :: waited 0.021s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:35:42 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdccac4b-323f-452a-95c8-f54cb03da55a]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:35:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e5f1310b-97dd-43f6-9791-c82d6b3ca8db tempest-VolumesDeleteCascade-1372244469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-39ccd09d-4e5e-4e12-95c5-1e09d5782e98 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:35:42 devstack sudo[92202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-39ccd09d-4e5e-4e12-95c5-1e09d5782e98
Jul 09 14:35:42 devstack sudo[92202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:35:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-4e7b70fc-cada-4bec-a05e-214d59f3987c req-232c0b53-9a3a-4d77-88f4-f946c9f18f42 tempest-AttachVolumeNegativeTest-594851243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:35:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-4e7b70fc-cada-4bec-a05e-214d59f3987c req-232c0b53-9a3a-4d77-88f4-f946c9f18f42 tempest-AttachVolumeNegativeTest-594851243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:35:42 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d775032-a73c-43f0-afb1-8ebfe0d5cce6]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:35:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-4e7b70fc-cada-4bec-a05e-214d59f3987c req-232c0b53-9a3a-4d77-88f4-f946c9f18f42 tempest-AttachVolumeNegativeTest-594851243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-83f65cd0-4847-4f35-aafd-8542018a0561 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:35:42 devstack sudo[92213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-83f65cd0-4847-4f35-aafd-8542018a0561
Jul 09 14:35:43 devstack sudo[92213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:35:43 devstack sudo[92202]: pam_unix(sudo:session): session closed for user root
Jul 09 14:35:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e5f1310b-97dd-43f6-9791-c82d6b3ca8db tempest-VolumesDeleteCascade-1372244469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-39ccd09d-4e5e-4e12-95c5-1e09d5782e98" returned: 0 in 1.065s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:35:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e5f1310b-97dd-43f6-9791-c82d6b3ca8db tempest-VolumesDeleteCascade-1372244469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-39ccd09d-4e5e-4e12-95c5-1e09d5782e98 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:35:43 devstack sudo[92219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-39ccd09d-4e5e-4e12-95c5-1e09d5782e98
Jul 09 14:35:43 devstack sudo[92219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:35:43 devstack sudo[92213]: pam_unix(sudo:session): session closed for user root
Jul 09 14:35:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-4e7b70fc-cada-4bec-a05e-214d59f3987c req-232c0b53-9a3a-4d77-88f4-f946c9f18f42 tempest-AttachVolumeNegativeTest-594851243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-83f65cd0-4847-4f35-aafd-8542018a0561" returned: 0 in 1.104s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:35:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-4e7b70fc-cada-4bec-a05e-214d59f3987c req-232c0b53-9a3a-4d77-88f4-f946c9f18f42 tempest-AttachVolumeNegativeTest-594851243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.134s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:35:43 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-4e7b70fc-cada-4bec-a05e-214d59f3987c req-232c0b53-9a3a-4d77-88f4-f946c9f18f42 tempest-AttachVolumeNegativeTest-594851243 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653', 'name': 'volume-83f65cd0-4847-4f35-aafd-8542018a0561', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '04c8f5c3-cff7-45a5-8a0e-7c9666108e78', 'enforce_multipath': True} {{(pid=87230) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 09 14:35:44 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-4e7b70fc-cada-4bec-a05e-214d59f3987c req-232c0b53-9a3a-4d77-88f4-f946c9f18f42 tempest-AttachVolumeNegativeTest-594851243 None] attachment_update completed successfully.
Jul 09 14:35:44 devstack sudo[92219]: pam_unix(sudo:session): session closed for user root
Jul 09 14:35:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e5f1310b-97dd-43f6-9791-c82d6b3ca8db tempest-VolumesDeleteCascade-1372244469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-39ccd09d-4e5e-4e12-95c5-1e09d5782e98" returned: 0 in 0.773s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:35:44 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e5f1310b-97dd-43f6-9791-c82d6b3ca8db tempest-VolumesDeleteCascade-1372244469 None] Lock "cinder-quobyte-39ccd09d-4e5e-4e12-95c5-1e09d5782e98" released by "delete_volume" :: held 1.916s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:35:44 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-e5f1310b-97dd-43f6-9791-c82d6b3ca8db tempest-VolumesDeleteCascade-1372244469 None] Created reservations ['b0e0eb8c-9dc4-4850-aba7-89f0832e1e28', '91ff880c-feec-4d6d-bbb2-8ecf76d30ad2', 'a65ed201-67a1-465c-aa4c-5e9f67e8a3dc', 'd122ca96-bd27-4d9e-9e69-ab0771c45753'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:35:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e5f1310b-97dd-43f6-9791-c82d6b3ca8db tempest-VolumesDeleteCascade-1372244469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:35:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e5f1310b-97dd-43f6-9791-c82d6b3ca8db tempest-VolumesDeleteCascade-1372244469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:35:44 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-e5f1310b-97dd-43f6-9791-c82d6b3ca8db tempest-VolumesDeleteCascade-1372244469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:35:44 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-e5f1310b-97dd-43f6-9791-c82d6b3ca8db tempest-VolumesDeleteCascade-1372244469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:35:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e5f1310b-97dd-43f6-9791-c82d6b3ca8db tempest-VolumesDeleteCascade-1372244469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:35:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e5f1310b-97dd-43f6-9791-c82d6b3ca8db tempest-VolumesDeleteCascade-1372244469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:35:44 devstack sudo[92270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:35:44 devstack sudo[92270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:35:45 devstack sudo[92270]: pam_unix(sudo:session): session closed for user root
Jul 09 14:35:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e5f1310b-97dd-43f6-9791-c82d6b3ca8db tempest-VolumesDeleteCascade-1372244469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.809s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:35:45 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-e5f1310b-97dd-43f6-9791-c82d6b3ca8db tempest-VolumesDeleteCascade-1372244469 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:35:45 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-e5f1310b-97dd-43f6-9791-c82d6b3ca8db tempest-VolumesDeleteCascade-1372244469 None] Deleted volume successfully.
Jul 09 14:35:45 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e5f1310b-97dd-43f6-9791-c82d6b3ca8db tempest-VolumesDeleteCascade-1372244469 None] Lock "cinder-39ccd09d-4e5e-4e12-95c5-1e09d5782e98-delete_volume" released by "delete_volume" :: held 12.512s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:35:45 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b0ac2b3-acc6-4fb1-b324-79a8a9e9ba6a tempest-VolumesDeleteCascade-1372244469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:35:45 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9b0ac2b3-acc6-4fb1-b324-79a8a9e9ba6a tempest-VolumesDeleteCascade-1372244469 None] Flow 'volume_create_manager' (47fc1208-fe10-4ec4-ab02-1328db2887fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:35:45 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9b0ac2b3-acc6-4fb1-b324-79a8a9e9ba6a tempest-VolumesDeleteCascade-1372244469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ab455a2-f315-4a04-ad40-fe464c352b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:35:45 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9b0ac2b3-acc6-4fb1-b324-79a8a9e9ba6a tempest-VolumesDeleteCascade-1372244469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ab455a2-f315-4a04-ad40-fe464c352b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:35:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1241713980',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9097d83-dd72-4c1d-8cde-26af9b2077fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='553674099675468b9bedebdd045eb81d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:35:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:35:45Z,use_quota=True,user_id='96854a59d5bd4b43bc8d199cc04da205',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:35:45 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9b0ac2b3-acc6-4fb1-b324-79a8a9e9ba6a tempest-VolumesDeleteCascade-1372244469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dd05ea0-70e8-4717-8189-4e68d1ead9e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:35:45 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9b0ac2b3-acc6-4fb1-b324-79a8a9e9ba6a tempest-VolumesDeleteCascade-1372244469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dd05ea0-70e8-4717-8189-4e68d1ead9e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:35:45 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9b0ac2b3-acc6-4fb1-b324-79a8a9e9ba6a tempest-VolumesDeleteCascade-1372244469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adc40a07-da90-498d-84da-be8273618e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:35:45 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9b0ac2b3-acc6-4fb1-b324-79a8a9e9ba6a tempest-VolumesDeleteCascade-1372244469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adc40a07-da90-498d-84da-be8273618e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9097d83-dd72-4c1d-8cde-26af9b2077fd', 'volume_name': 'volume-d9097d83-dd72-4c1d-8cde-26af9b2077fd', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:35:45 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9b0ac2b3-acc6-4fb1-b324-79a8a9e9ba6a tempest-VolumesDeleteCascade-1372244469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a77eaca-191f-49fc-89cc-e4def8452dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:35:45 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9b0ac2b3-acc6-4fb1-b324-79a8a9e9ba6a tempest-VolumesDeleteCascade-1372244469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a77eaca-191f-49fc-89cc-e4def8452dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:35:45 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9b0ac2b3-acc6-4fb1-b324-79a8a9e9ba6a tempest-VolumesDeleteCascade-1372244469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bca4010-7b83-457d-b63b-20e7547017e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:35:45 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-9b0ac2b3-acc6-4fb1-b324-79a8a9e9ba6a tempest-VolumesDeleteCascade-1372244469 None] Volume d9097d83-dd72-4c1d-8cde-26af9b2077fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9097d83-dd72-4c1d-8cde-26af9b2077fd', 'volume_size': 1}
Jul 09 14:35:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9b0ac2b3-acc6-4fb1-b324-79a8a9e9ba6a tempest-VolumesDeleteCascade-1372244469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:35:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9b0ac2b3-acc6-4fb1-b324-79a8a9e9ba6a tempest-VolumesDeleteCascade-1372244469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:35:45 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9b0ac2b3-acc6-4fb1-b324-79a8a9e9ba6a tempest-VolumesDeleteCascade-1372244469 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:35:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1241713980',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9097d83-dd72-4c1d-8cde-26af9b2077fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='553674099675468b9bedebdd045eb81d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:35:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:35:45Z,use_quota=True,user_id='96854a59d5bd4b43bc8d199cc04da205',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:35:45 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-9b0ac2b3-acc6-4fb1-b324-79a8a9e9ba6a tempest-VolumesDeleteCascade-1372244469 None] Creating volume d9097d83-dd72-4c1d-8cde-26af9b2077fd {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:35:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9b0ac2b3-acc6-4fb1-b324-79a8a9e9ba6a tempest-VolumesDeleteCascade-1372244469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:35:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9b0ac2b3-acc6-4fb1-b324-79a8a9e9ba6a tempest-VolumesDeleteCascade-1372244469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:35:45 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9b0ac2b3-acc6-4fb1-b324-79a8a9e9ba6a tempest-VolumesDeleteCascade-1372244469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:35:45 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9b0ac2b3-acc6-4fb1-b324-79a8a9e9ba6a tempest-VolumesDeleteCascade-1372244469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:35:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9b0ac2b3-acc6-4fb1-b324-79a8a9e9ba6a tempest-VolumesDeleteCascade-1372244469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:35:45 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9b0ac2b3-acc6-4fb1-b324-79a8a9e9ba6a tempest-VolumesDeleteCascade-1372244469 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:35:45 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-9b0ac2b3-acc6-4fb1-b324-79a8a9e9ba6a tempest-VolumesDeleteCascade-1372244469 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:35:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9b0ac2b3-acc6-4fb1-b324-79a8a9e9ba6a tempest-VolumesDeleteCascade-1372244469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d9097d83-dd72-4c1d-8cde-26af9b2077fd 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:35:45 devstack sudo[92610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d9097d83-dd72-4c1d-8cde-26af9b2077fd 1073741824
Jul 09 14:35:45 devstack sudo[92610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:35:46 devstack sudo[92610]: pam_unix(sudo:session): session closed for user root
Jul 09 14:35:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9b0ac2b3-acc6-4fb1-b324-79a8a9e9ba6a tempest-VolumesDeleteCascade-1372244469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d9097d83-dd72-4c1d-8cde-26af9b2077fd 1073741824" returned: 0 in 1.128s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:35:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9b0ac2b3-acc6-4fb1-b324-79a8a9e9ba6a tempest-VolumesDeleteCascade-1372244469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d9097d83-dd72-4c1d-8cde-26af9b2077fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:35:46 devstack sudo[92616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d9097d83-dd72-4c1d-8cde-26af9b2077fd
Jul 09 14:35:46 devstack sudo[92616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:35:47 devstack sudo[92616]: pam_unix(sudo:session): session closed for user root
Jul 09 14:35:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9b0ac2b3-acc6-4fb1-b324-79a8a9e9ba6a tempest-VolumesDeleteCascade-1372244469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d9097d83-dd72-4c1d-8cde-26af9b2077fd" returned: 0 in 0.753s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:35:47 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9b0ac2b3-acc6-4fb1-b324-79a8a9e9ba6a tempest-VolumesDeleteCascade-1372244469 None] <== create_volume: return (1932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:35:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9b0ac2b3-acc6-4fb1-b324-79a8a9e9ba6a tempest-VolumesDeleteCascade-1372244469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.936s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:35:47 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9b0ac2b3-acc6-4fb1-b324-79a8a9e9ba6a tempest-VolumesDeleteCascade-1372244469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bca4010-7b83-457d-b63b-20e7547017e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9097d83-dd72-4c1d-8cde-26af9b2077fd', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:35:47 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9b0ac2b3-acc6-4fb1-b324-79a8a9e9ba6a tempest-VolumesDeleteCascade-1372244469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c93b1674-4238-4979-af7c-6d261ad42cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:35:47 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-9b0ac2b3-acc6-4fb1-b324-79a8a9e9ba6a tempest-VolumesDeleteCascade-1372244469 None] Volume volume-d9097d83-dd72-4c1d-8cde-26af9b2077fd (d9097d83-dd72-4c1d-8cde-26af9b2077fd): created successfully
Jul 09 14:35:47 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9b0ac2b3-acc6-4fb1-b324-79a8a9e9ba6a tempest-VolumesDeleteCascade-1372244469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c93b1674-4238-4979-af7c-6d261ad42cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:35:47 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9b0ac2b3-acc6-4fb1-b324-79a8a9e9ba6a tempest-VolumesDeleteCascade-1372244469 None] Flow 'volume_create_manager' (47fc1208-fe10-4ec4-ab02-1328db2887fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:35:47 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-9b0ac2b3-acc6-4fb1-b324-79a8a9e9ba6a tempest-VolumesDeleteCascade-1372244469 None] Created volume successfully.
Jul 09 14:35:48 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d64ab6b4-af66-40d5-978b-58031b1c3e02 tempest-TaggedAttachmentsTest-1717979664 None] Acquiring lock "cinder-8a2a10ef-5848-4758-b3c5-f2283f2da7ec-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:35:48 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d64ab6b4-af66-40d5-978b-58031b1c3e02 tempest-TaggedAttachmentsTest-1717979664 None] Lock "cinder-8a2a10ef-5848-4758-b3c5-f2283f2da7ec-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:35:48 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d64ab6b4-af66-40d5-978b-58031b1c3e02 tempest-TaggedAttachmentsTest-1717979664 None] Acquiring lock "cinder-quobyte-8a2a10ef-5848-4758-b3c5-f2283f2da7ec" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:35:48 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d64ab6b4-af66-40d5-978b-58031b1c3e02 tempest-TaggedAttachmentsTest-1717979664 None] Lock "cinder-quobyte-8a2a10ef-5848-4758-b3c5-f2283f2da7ec" acquired by "delete_volume" :: waited 0.020s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:35:48 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[9076da75-a7cf-42d5-ad5e-8ec8eecb0462]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:35:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d64ab6b4-af66-40d5-978b-58031b1c3e02 tempest-TaggedAttachmentsTest-1717979664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8a2a10ef-5848-4758-b3c5-f2283f2da7ec {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:35:48 devstack sudo[92620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8a2a10ef-5848-4758-b3c5-f2283f2da7ec
Jul 09 14:35:48 devstack sudo[92620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:35:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a44fc0f1-9163-4313-a4f5-a4d8a796a28a tempest-VolumesDeleteCascade-1372244469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:35:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a44fc0f1-9163-4313-a4f5-a4d8a796a28a tempest-VolumesDeleteCascade-1372244469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:35:48 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-a44fc0f1-9163-4313-a4f5-a4d8a796a28a tempest-VolumesDeleteCascade-1372244469 None] Creating offline snapshot 687965ee-7395-4c51-bfa1-957f702aa9e3 of volume d9097d83-dd72-4c1d-8cde-26af9b2077fd {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 14:35:48 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e176135-49c4-4714-9ac0-c4c7dd054aae]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:35:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a44fc0f1-9163-4313-a4f5-a4d8a796a28a tempest-VolumesDeleteCascade-1372244469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d9097d83-dd72-4c1d-8cde-26af9b2077fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:35:48 devstack sudo[92623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d9097d83-dd72-4c1d-8cde-26af9b2077fd
Jul 09 14:35:48 devstack sudo[92623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:35:49 devstack sudo[92620]: pam_unix(sudo:session): session closed for user root
Jul 09 14:35:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d64ab6b4-af66-40d5-978b-58031b1c3e02 tempest-TaggedAttachmentsTest-1717979664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8a2a10ef-5848-4758-b3c5-f2283f2da7ec" returned: 0 in 0.949s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:35:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d64ab6b4-af66-40d5-978b-58031b1c3e02 tempest-TaggedAttachmentsTest-1717979664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8a2a10ef-5848-4758-b3c5-f2283f2da7ec {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:35:49 devstack sudo[92629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8a2a10ef-5848-4758-b3c5-f2283f2da7ec
Jul 09 14:35:49 devstack sudo[92629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:35:49 devstack sudo[92623]: pam_unix(sudo:session): session closed for user root
Jul 09 14:35:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a44fc0f1-9163-4313-a4f5-a4d8a796a28a tempest-VolumesDeleteCascade-1372244469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d9097d83-dd72-4c1d-8cde-26af9b2077fd" returned: 0 in 1.075s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:35:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a44fc0f1-9163-4313-a4f5-a4d8a796a28a tempest-VolumesDeleteCascade-1372244469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d9097d83-dd72-4c1d-8cde-26af9b2077fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d9097d83-dd72-4c1d-8cde-26af9b2077fd.687965ee-7395-4c51-bfa1-957f702aa9e3 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:35:49 devstack sudo[92649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d9097d83-dd72-4c1d-8cde-26af9b2077fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d9097d83-dd72-4c1d-8cde-26af9b2077fd.687965ee-7395-4c51-bfa1-957f702aa9e3 1G
Jul 09 14:35:49 devstack sudo[92649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:35:49 devstack sudo[92629]: pam_unix(sudo:session): session closed for user root
Jul 09 14:35:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d64ab6b4-af66-40d5-978b-58031b1c3e02 tempest-TaggedAttachmentsTest-1717979664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8a2a10ef-5848-4758-b3c5-f2283f2da7ec" returned: 0 in 0.897s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:35:49 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d64ab6b4-af66-40d5-978b-58031b1c3e02 tempest-TaggedAttachmentsTest-1717979664 None] Lock "cinder-quobyte-8a2a10ef-5848-4758-b3c5-f2283f2da7ec" released by "delete_volume" :: held 1.895s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:35:50 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-d64ab6b4-af66-40d5-978b-58031b1c3e02 tempest-TaggedAttachmentsTest-1717979664 None] Created reservations ['c559d5aa-80bc-48eb-b5b3-e1799f66bf7b', '2635eba9-ebe1-4f79-9e48-2e13f834fff2', '9bcb2a37-8474-4cab-a3c6-d5469c0cffab', '7e2b0847-b097-45b4-af61-bc21a6bdaa33'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:35:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d64ab6b4-af66-40d5-978b-58031b1c3e02 tempest-TaggedAttachmentsTest-1717979664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:35:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d64ab6b4-af66-40d5-978b-58031b1c3e02 tempest-TaggedAttachmentsTest-1717979664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:35:50 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-d64ab6b4-af66-40d5-978b-58031b1c3e02 tempest-TaggedAttachmentsTest-1717979664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:35:50 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-d64ab6b4-af66-40d5-978b-58031b1c3e02 tempest-TaggedAttachmentsTest-1717979664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:35:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d64ab6b4-af66-40d5-978b-58031b1c3e02 tempest-TaggedAttachmentsTest-1717979664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:35:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d64ab6b4-af66-40d5-978b-58031b1c3e02 tempest-TaggedAttachmentsTest-1717979664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:35:50 devstack sudo[92655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:35:50 devstack sudo[92655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:35:51 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-f5984c23-36e5-46a3-868d-81ed83fd572c req-e48183e1-1a79-4d30-bf79-5113df6ef7a6 tempest-AttachVolumeNegativeTest-594851243 None] Terminate volume connection completed successfully.
Jul 09 14:35:51 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-f5984c23-36e5-46a3-868d-81ed83fd572c req-e48183e1-1a79-4d30-bf79-5113df6ef7a6 tempest-AttachVolumeNegativeTest-594851243 None] Deleting attachment 04c8f5c3-cff7-45a5-8a0e-7c9666108e78. {{(pid=87230) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 09 14:35:51 devstack sudo[92649]: pam_unix(sudo:session): session closed for user root
Jul 09 14:35:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a44fc0f1-9163-4313-a4f5-a4d8a796a28a tempest-VolumesDeleteCascade-1372244469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d9097d83-dd72-4c1d-8cde-26af9b2077fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d9097d83-dd72-4c1d-8cde-26af9b2077fd.687965ee-7395-4c51-bfa1-957f702aa9e3 1G" returned: 0 in 1.248s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:35:51 devstack sudo[92655]: pam_unix(sudo:session): session closed for user root
Jul 09 14:35:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a44fc0f1-9163-4313-a4f5-a4d8a796a28a tempest-VolumesDeleteCascade-1372244469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9097d83-dd72-4c1d-8cde-26af9b2077fd -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d9097d83-dd72-4c1d-8cde-26af9b2077fd.687965ee-7395-4c51-bfa1-957f702aa9e3 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:35:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d64ab6b4-af66-40d5-978b-58031b1c3e02 tempest-TaggedAttachmentsTest-1717979664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 1.012s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:35:51 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-d64ab6b4-af66-40d5-978b-58031b1c3e02 tempest-TaggedAttachmentsTest-1717979664 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:35:51 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-d64ab6b4-af66-40d5-978b-58031b1c3e02 tempest-TaggedAttachmentsTest-1717979664 None] Deleted volume successfully.
Jul 09 14:35:51 devstack sudo[92703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9097d83-dd72-4c1d-8cde-26af9b2077fd -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d9097d83-dd72-4c1d-8cde-26af9b2077fd.687965ee-7395-4c51-bfa1-957f702aa9e3
Jul 09 14:35:51 devstack sudo[92703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:35:51 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d64ab6b4-af66-40d5-978b-58031b1c3e02 tempest-TaggedAttachmentsTest-1717979664 None] Lock "cinder-8a2a10ef-5848-4758-b3c5-f2283f2da7ec-delete_volume" released by "delete_volume" :: held 3.160s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:35:52 devstack sudo[92703]: pam_unix(sudo:session): session closed for user root
Jul 09 14:35:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a44fc0f1-9163-4313-a4f5-a4d8a796a28a tempest-VolumesDeleteCascade-1372244469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9097d83-dd72-4c1d-8cde-26af9b2077fd -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d9097d83-dd72-4c1d-8cde-26af9b2077fd.687965ee-7395-4c51-bfa1-957f702aa9e3" returned: 0 in 0.871s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:35:52 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-a44fc0f1-9163-4313-a4f5-a4d8a796a28a tempest-VolumesDeleteCascade-1372244469 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d9097d83-dd72-4c1d-8cde-26af9b2077fd.687965ee-7395-4c51-bfa1-957f702aa9e3 is being set with open permissions: ugo+rw
Jul 09 14:35:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a44fc0f1-9163-4313-a4f5-a4d8a796a28a tempest-VolumesDeleteCascade-1372244469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d9097d83-dd72-4c1d-8cde-26af9b2077fd.687965ee-7395-4c51-bfa1-957f702aa9e3 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:35:52 devstack sudo[92708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d9097d83-dd72-4c1d-8cde-26af9b2077fd.687965ee-7395-4c51-bfa1-957f702aa9e3
Jul 09 14:35:52 devstack sudo[92708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:35:52 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 14:35:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:35:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:35:52 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:35:52 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:35:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:35:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:35:52 devstack sudo[92711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:35:52 devstack sudo[92711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:35:52 devstack sudo[92708]: pam_unix(sudo:session): session closed for user root
Jul 09 14:35:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a44fc0f1-9163-4313-a4f5-a4d8a796a28a tempest-VolumesDeleteCascade-1372244469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d9097d83-dd72-4c1d-8cde-26af9b2077fd.687965ee-7395-4c51-bfa1-957f702aa9e3" returned: 0 in 0.688s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:35:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a44fc0f1-9163-4313-a4f5-a4d8a796a28a tempest-VolumesDeleteCascade-1372244469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d9097d83-dd72-4c1d-8cde-26af9b2077fd.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:35:52 devstack sudo[92714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d9097d83-dd72-4c1d-8cde-26af9b2077fd.info
Jul 09 14:35:52 devstack sudo[92714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:35:53 devstack sudo[92711]: pam_unix(sudo:session): session closed for user root
Jul 09 14:35:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.827s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:35:53 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:35:53 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Running periodic task VolumeManager._thread_info {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 14:35:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] thread count: 8 {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 09 14:35:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] thread info: [<_MainThread(MainThread, started 125388812103808)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125388713797504)>, <Thread(Thread-3 (stat_writer), started daemon 125388699995392)>, <Thread(Rabbit-heartbeat, started daemon 125388700522560)>, <Thread(Thread-5 (_runner), started daemon 125388698545216)>, <Thread(Thread-7 (_runner), started daemon 125388698611264)>, <Thread(fd_logger, started daemon 125388703020672)>, <Thread(privsep_reader, started daemon 125388696441088)>] {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 09 14:35:53 devstack sudo[92714]: pam_unix(sudo:session): session closed for user root
Jul 09 14:35:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a44fc0f1-9163-4313-a4f5-a4d8a796a28a tempest-VolumesDeleteCascade-1372244469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d9097d83-dd72-4c1d-8cde-26af9b2077fd.info" returned: 0 in 0.861s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:35:53 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-a44fc0f1-9163-4313-a4f5-a4d8a796a28a tempest-VolumesDeleteCascade-1372244469 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d9097d83-dd72-4c1d-8cde-26af9b2077fd.info is being set with open permissions: ugo+rw
Jul 09 14:35:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a44fc0f1-9163-4313-a4f5-a4d8a796a28a tempest-VolumesDeleteCascade-1372244469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d9097d83-dd72-4c1d-8cde-26af9b2077fd.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:35:53 devstack sudo[92719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d9097d83-dd72-4c1d-8cde-26af9b2077fd.info
Jul 09 14:35:53 devstack sudo[92719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:35:54 devstack sudo[92719]: pam_unix(sudo:session): session closed for user root
Jul 09 14:35:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a44fc0f1-9163-4313-a4f5-a4d8a796a28a tempest-VolumesDeleteCascade-1372244469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d9097d83-dd72-4c1d-8cde-26af9b2077fd.info" returned: 0 in 0.796s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:35:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a44fc0f1-9163-4313-a4f5-a4d8a796a28a tempest-VolumesDeleteCascade-1372244469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.754s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:35:54 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-a44fc0f1-9163-4313-a4f5-a4d8a796a28a tempest-VolumesDeleteCascade-1372244469 None] Create snapshot completed successfully
Jul 09 14:35:55 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-da8c3c52-f760-4035-bec2-1662c2d8950f tempest-VolumesDeleteCascade-1372244469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:35:55 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-da8c3c52-f760-4035-bec2-1662c2d8950f tempest-VolumesDeleteCascade-1372244469 None] Flow 'volume_create_manager' (d77146ce-1707-4b9d-ab5d-204def3b0c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:35:55 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-da8c3c52-f760-4035-bec2-1662c2d8950f tempest-VolumesDeleteCascade-1372244469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb2c2098-2e1f-458a-b4a7-0e9b08f5e96e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:35:55 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-da8c3c52-f760-4035-bec2-1662c2d8950f tempest-VolumesDeleteCascade-1372244469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb2c2098-2e1f-458a-b4a7-0e9b08f5e96e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:35:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-322877761',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adb80326-4766-4abc-8900-cd92a23dd4b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='553674099675468b9bedebdd045eb81d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:35:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=687965ee-7395-4c51-bfa1-957f702aa9e3,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:35:56Z,use_quota=True,user_id='96854a59d5bd4b43bc8d199cc04da205',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:35:55 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-da8c3c52-f760-4035-bec2-1662c2d8950f tempest-VolumesDeleteCascade-1372244469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9473f9f-a5aa-49ed-a5c8-2e9f640e1ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:35:55 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-da8c3c52-f760-4035-bec2-1662c2d8950f tempest-VolumesDeleteCascade-1372244469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9473f9f-a5aa-49ed-a5c8-2e9f640e1ca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:35:55 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-da8c3c52-f760-4035-bec2-1662c2d8950f tempest-VolumesDeleteCascade-1372244469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae654f79-449f-4e04-969c-e014e814cbf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:35:55 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-da8c3c52-f760-4035-bec2-1662c2d8950f tempest-VolumesDeleteCascade-1372244469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae654f79-449f-4e04-969c-e014e814cbf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'adb80326-4766-4abc-8900-cd92a23dd4b5', 'volume_name': 'volume-adb80326-4766-4abc-8900-cd92a23dd4b5', 'volume_size': 1, 'snapshot_id': '687965ee-7395-4c51-bfa1-957f702aa9e3'}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:35:55 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-da8c3c52-f760-4035-bec2-1662c2d8950f tempest-VolumesDeleteCascade-1372244469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffa32100-330a-4031-9c96-841eaa0841be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:35:55 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-da8c3c52-f760-4035-bec2-1662c2d8950f tempest-VolumesDeleteCascade-1372244469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffa32100-330a-4031-9c96-841eaa0841be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:35:55 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-da8c3c52-f760-4035-bec2-1662c2d8950f tempest-VolumesDeleteCascade-1372244469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc060029-a17d-4c10-8393-12274b951f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:35:55 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-da8c3c52-f760-4035-bec2-1662c2d8950f tempest-VolumesDeleteCascade-1372244469 None] Volume adb80326-4766-4abc-8900-cd92a23dd4b5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-adb80326-4766-4abc-8900-cd92a23dd4b5', 'volume_size': 1, 'snapshot_id': '687965ee-7395-4c51-bfa1-957f702aa9e3'}
Jul 09 14:35:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-da8c3c52-f760-4035-bec2-1662c2d8950f tempest-VolumesDeleteCascade-1372244469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:35:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-da8c3c52-f760-4035-bec2-1662c2d8950f tempest-VolumesDeleteCascade-1372244469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.003s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:35:55 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-da8c3c52-f760-4035-bec2-1662c2d8950f tempest-VolumesDeleteCascade-1372244469 None] Acquiring lock "cinder-quobyte-687965ee-7395-4c51-bfa1-957f702aa9e3-adb80326-4766-4abc-8900-cd92a23dd4b5" by "_create_volume_from_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:35:55 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-da8c3c52-f760-4035-bec2-1662c2d8950f tempest-VolumesDeleteCascade-1372244469 None] Lock "cinder-quobyte-687965ee-7395-4c51-bfa1-957f702aa9e3-adb80326-4766-4abc-8900-cd92a23dd4b5" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:35:55 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-da8c3c52-f760-4035-bec2-1662c2d8950f tempest-VolumesDeleteCascade-1372244469 None] Creating volume adb80326-4766-4abc-8900-cd92a23dd4b5 from snapshot 687965ee-7395-4c51-bfa1-957f702aa9e3 {{(pid=87230) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 09 14:35:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-da8c3c52-f760-4035-bec2-1662c2d8950f tempest-VolumesDeleteCascade-1372244469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:35:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-da8c3c52-f760-4035-bec2-1662c2d8950f tempest-VolumesDeleteCascade-1372244469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:35:55 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-da8c3c52-f760-4035-bec2-1662c2d8950f tempest-VolumesDeleteCascade-1372244469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:35:55 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-da8c3c52-f760-4035-bec2-1662c2d8950f tempest-VolumesDeleteCascade-1372244469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:35:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-da8c3c52-f760-4035-bec2-1662c2d8950f tempest-VolumesDeleteCascade-1372244469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:35:55 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-da8c3c52-f760-4035-bec2-1662c2d8950f tempest-VolumesDeleteCascade-1372244469 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:35:55 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-da8c3c52-f760-4035-bec2-1662c2d8950f tempest-VolumesDeleteCascade-1372244469 None] Acquiring lock "cinder-quobyte-adb80326-4766-4abc-8900-cd92a23dd4b5" by "_copy_volume_from_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:35:55 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-da8c3c52-f760-4035-bec2-1662c2d8950f tempest-VolumesDeleteCascade-1372244469 None] Lock "cinder-quobyte-adb80326-4766-4abc-8900-cd92a23dd4b5" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:35:55 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-da8c3c52-f760-4035-bec2-1662c2d8950f tempest-VolumesDeleteCascade-1372244469 None] snapshot: 687965ee-7395-4c51-bfa1-957f702aa9e3, volume: adb80326-4766-4abc-8900-cd92a23dd4b5,  {{(pid=87230) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 09 14:35:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-da8c3c52-f760-4035-bec2-1662c2d8950f tempest-VolumesDeleteCascade-1372244469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:35:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-da8c3c52-f760-4035-bec2-1662c2d8950f tempest-VolumesDeleteCascade-1372244469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:35:55 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-da8c3c52-f760-4035-bec2-1662c2d8950f tempest-VolumesDeleteCascade-1372244469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:35:55 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-da8c3c52-f760-4035-bec2-1662c2d8950f tempest-VolumesDeleteCascade-1372244469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:35:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-da8c3c52-f760-4035-bec2-1662c2d8950f tempest-VolumesDeleteCascade-1372244469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:35:56 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b06c31c-00cf-4d3c-a045-d0cd50c8144a]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:35:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-da8c3c52-f760-4035-bec2-1662c2d8950f tempest-VolumesDeleteCascade-1372244469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d9097d83-dd72-4c1d-8cde-26af9b2077fd.687965ee-7395-4c51-bfa1-957f702aa9e3 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:35:56 devstack sudo[92750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d9097d83-dd72-4c1d-8cde-26af9b2077fd.687965ee-7395-4c51-bfa1-957f702aa9e3
Jul 09 14:35:56 devstack sudo[92750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:35:57 devstack sudo[92750]: pam_unix(sudo:session): session closed for user root
Jul 09 14:35:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-da8c3c52-f760-4035-bec2-1662c2d8950f tempest-VolumesDeleteCascade-1372244469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d9097d83-dd72-4c1d-8cde-26af9b2077fd.687965ee-7395-4c51-bfa1-957f702aa9e3" returned: 0 in 1.048s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:35:57 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-da8c3c52-f760-4035-bec2-1662c2d8950f tempest-VolumesDeleteCascade-1372244469 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9097d83-dd72-4c1d-8cde-26af9b2077fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 14:35:57 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-da8c3c52-f760-4035-bec2-1662c2d8950f tempest-VolumesDeleteCascade-1372244469 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d9097d83-dd72-4c1d-8cde-26af9b2077fd {{(pid=87230) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 09 14:35:57 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-da8c3c52-f760-4035-bec2-1662c2d8950f tempest-VolumesDeleteCascade-1372244469 None] Creating direct copy from snapshot {{(pid=87230) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 09 14:35:57 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c8dccc6-833e-4075-84bf-63a6afd60066]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:35:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-da8c3c52-f760-4035-bec2-1662c2d8950f tempest-VolumesDeleteCascade-1372244469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d9097d83-dd72-4c1d-8cde-26af9b2077fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:35:57 devstack sudo[92760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d9097d83-dd72-4c1d-8cde-26af9b2077fd
Jul 09 14:35:57 devstack sudo[92760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:35:57 devstack sudo[92760]: pam_unix(sudo:session): session closed for user root
Jul 09 14:35:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-da8c3c52-f760-4035-bec2-1662c2d8950f tempest-VolumesDeleteCascade-1372244469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d9097d83-dd72-4c1d-8cde-26af9b2077fd" returned: 0 in 0.877s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:35:57 devstack cinder-volume[87230]: DEBUG cinder.utils [None req-da8c3c52-f760-4035-bec2-1662c2d8950f tempest-VolumesDeleteCascade-1372244469 None] Path /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-adb80326-4766-4abc-8900-cd92a23dd4b5 not found in is_blk_device check {{(pid=87230) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 09 14:35:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-da8c3c52-f760-4035-bec2-1662c2d8950f tempest-VolumesDeleteCascade-1372244469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d9097d83-dd72-4c1d-8cde-26af9b2077fd /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-adb80326-4766-4abc-8900-cd92a23dd4b5 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:35:58 devstack sudo[92765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d9097d83-dd72-4c1d-8cde-26af9b2077fd /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-adb80326-4766-4abc-8900-cd92a23dd4b5
Jul 09 14:35:58 devstack sudo[92765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:36:04 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2c9ca95-c205-4aa7-96cb-9cbd7f637a7c tempest-AttachVolumeTestJSON-1021532728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:36:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b2c9ca95-c205-4aa7-96cb-9cbd7f637a7c tempest-AttachVolumeTestJSON-1021532728 None] Flow 'volume_create_manager' (52575906-fd8f-4137-b29b-5b72b12fa373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:36:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b2c9ca95-c205-4aa7-96cb-9cbd7f637a7c tempest-AttachVolumeTestJSON-1021532728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8d38a87-a125-4a93-9d3c-cd2643b88638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:36:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b2c9ca95-c205-4aa7-96cb-9cbd7f637a7c tempest-AttachVolumeTestJSON-1021532728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8d38a87-a125-4a93-9d3c-cd2643b88638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-214098751',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4037ab3-2b95-420a-8f05-28104dae06eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b915bfaa50d440baa3438aa2107e537d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:36:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:36:05Z,use_quota=True,user_id='c37e6e905ebe4532a515ec945d11fb0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:36:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b2c9ca95-c205-4aa7-96cb-9cbd7f637a7c tempest-AttachVolumeTestJSON-1021532728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4127e3c-8689-4b0b-adc2-fd1835a0a26e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:36:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b2c9ca95-c205-4aa7-96cb-9cbd7f637a7c tempest-AttachVolumeTestJSON-1021532728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4127e3c-8689-4b0b-adc2-fd1835a0a26e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:36:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b2c9ca95-c205-4aa7-96cb-9cbd7f637a7c tempest-AttachVolumeTestJSON-1021532728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f92a3f91-3d6c-4294-b0e9-baea8545d94f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:36:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b2c9ca95-c205-4aa7-96cb-9cbd7f637a7c tempest-AttachVolumeTestJSON-1021532728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f92a3f91-3d6c-4294-b0e9-baea8545d94f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4037ab3-2b95-420a-8f05-28104dae06eb', 'volume_name': 'volume-f4037ab3-2b95-420a-8f05-28104dae06eb', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:36:05 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b2c9ca95-c205-4aa7-96cb-9cbd7f637a7c tempest-AttachVolumeTestJSON-1021532728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba1ef45d-634c-4531-9799-8052b809a626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:36:05 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b2c9ca95-c205-4aa7-96cb-9cbd7f637a7c tempest-AttachVolumeTestJSON-1021532728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba1ef45d-634c-4531-9799-8052b809a626) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:36:05 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b2c9ca95-c205-4aa7-96cb-9cbd7f637a7c tempest-AttachVolumeTestJSON-1021532728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff3f5adc-eed8-4198-8c61-af52e986b5fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:36:05 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-b2c9ca95-c205-4aa7-96cb-9cbd7f637a7c tempest-AttachVolumeTestJSON-1021532728 None] Volume f4037ab3-2b95-420a-8f05-28104dae06eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4037ab3-2b95-420a-8f05-28104dae06eb', 'volume_size': 1}
Jul 09 14:36:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b2c9ca95-c205-4aa7-96cb-9cbd7f637a7c tempest-AttachVolumeTestJSON-1021532728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:36:05 devstack sudo[92765]: pam_unix(sudo:session): session closed for user root
Jul 09 14:36:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-da8c3c52-f760-4035-bec2-1662c2d8950f tempest-VolumesDeleteCascade-1372244469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d9097d83-dd72-4c1d-8cde-26af9b2077fd /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-adb80326-4766-4abc-8900-cd92a23dd4b5" returned: 0 in 7.142s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:36:05 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[86483693-0521-4673-8df6-7e9a607d1706]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:36:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-da8c3c52-f760-4035-bec2-1662c2d8950f tempest-VolumesDeleteCascade-1372244469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d9097d83-dd72-4c1d-8cde-26af9b2077fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:36:05 devstack sudo[92788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d9097d83-dd72-4c1d-8cde-26af9b2077fd
Jul 09 14:36:05 devstack sudo[92788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:36:06 devstack sudo[92788]: pam_unix(sudo:session): session closed for user root
Jul 09 14:36:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-da8c3c52-f760-4035-bec2-1662c2d8950f tempest-VolumesDeleteCascade-1372244469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d9097d83-dd72-4c1d-8cde-26af9b2077fd" returned: 0 in 1.062s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:36:06 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-da8c3c52-f760-4035-bec2-1662c2d8950f tempest-VolumesDeleteCascade-1372244469 None] Image conversion details: src /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d9097d83-dd72-4c1d-8cde-26af9b2077fd, size 1024.00 MB, duration 7.14 sec, destination /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-adb80326-4766-4abc-8900-cd92a23dd4b5 {{(pid=87230) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 09 14:36:06 devstack cinder-volume[87230]: INFO cinder.image.image_utils [None req-da8c3c52-f760-4035-bec2-1662c2d8950f tempest-VolumesDeleteCascade-1372244469 None] Converted 1024.00 MB image at 143.36 MB/s
Jul 09 14:36:06 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-da8c3c52-f760-4035-bec2-1662c2d8950f tempest-VolumesDeleteCascade-1372244469 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-adb80326-4766-4abc-8900-cd92a23dd4b5 is being set with open permissions: ugo+rw
Jul 09 14:36:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-da8c3c52-f760-4035-bec2-1662c2d8950f tempest-VolumesDeleteCascade-1372244469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-adb80326-4766-4abc-8900-cd92a23dd4b5 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:36:06 devstack sudo[92793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-adb80326-4766-4abc-8900-cd92a23dd4b5
Jul 09 14:36:06 devstack sudo[92793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:36:06 devstack sudo[92793]: pam_unix(sudo:session): session closed for user root
Jul 09 14:36:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-da8c3c52-f760-4035-bec2-1662c2d8950f tempest-VolumesDeleteCascade-1372244469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-adb80326-4766-4abc-8900-cd92a23dd4b5" returned: 0 in 0.742s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:36:06 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-da8c3c52-f760-4035-bec2-1662c2d8950f tempest-VolumesDeleteCascade-1372244469 None] Lock "cinder-quobyte-adb80326-4766-4abc-8900-cd92a23dd4b5" released by "_copy_volume_from_snapshot" :: held 11.043s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:36:06 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-da8c3c52-f760-4035-bec2-1662c2d8950f tempest-VolumesDeleteCascade-1372244469 None] Lock "cinder-quobyte-687965ee-7395-4c51-bfa1-957f702aa9e3-adb80326-4766-4abc-8900-cd92a23dd4b5" released by "_create_volume_from_snapshot" :: held 11.100s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:36:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-da8c3c52-f760-4035-bec2-1662c2d8950f tempest-VolumesDeleteCascade-1372244469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.133s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:36:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b2c9ca95-c205-4aa7-96cb-9cbd7f637a7c tempest-AttachVolumeTestJSON-1021532728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.986s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:36:07 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b2c9ca95-c205-4aa7-96cb-9cbd7f637a7c tempest-AttachVolumeTestJSON-1021532728 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-214098751',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4037ab3-2b95-420a-8f05-28104dae06eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b915bfaa50d440baa3438aa2107e537d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:36:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:36:05Z,use_quota=True,user_id='c37e6e905ebe4532a515ec945d11fb0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:36:07 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-b2c9ca95-c205-4aa7-96cb-9cbd7f637a7c tempest-AttachVolumeTestJSON-1021532728 None] Creating volume f4037ab3-2b95-420a-8f05-28104dae06eb {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:36:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b2c9ca95-c205-4aa7-96cb-9cbd7f637a7c tempest-AttachVolumeTestJSON-1021532728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:36:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b2c9ca95-c205-4aa7-96cb-9cbd7f637a7c tempest-AttachVolumeTestJSON-1021532728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:36:07 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b2c9ca95-c205-4aa7-96cb-9cbd7f637a7c tempest-AttachVolumeTestJSON-1021532728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:36:07 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b2c9ca95-c205-4aa7-96cb-9cbd7f637a7c tempest-AttachVolumeTestJSON-1021532728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:36:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b2c9ca95-c205-4aa7-96cb-9cbd7f637a7c tempest-AttachVolumeTestJSON-1021532728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:36:07 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b2c9ca95-c205-4aa7-96cb-9cbd7f637a7c tempest-AttachVolumeTestJSON-1021532728 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:36:07 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-b2c9ca95-c205-4aa7-96cb-9cbd7f637a7c tempest-AttachVolumeTestJSON-1021532728 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:36:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b2c9ca95-c205-4aa7-96cb-9cbd7f637a7c tempest-AttachVolumeTestJSON-1021532728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-f4037ab3-2b95-420a-8f05-28104dae06eb 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:36:07 devstack sudo[92796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-f4037ab3-2b95-420a-8f05-28104dae06eb 1073741824
Jul 09 14:36:07 devstack sudo[92796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:36:07 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-da8c3c52-f760-4035-bec2-1662c2d8950f tempest-VolumesDeleteCascade-1372244469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc060029-a17d-4c10-8393-12274b951f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adb80326-4766-4abc-8900-cd92a23dd4b5', 'volume_size': 1, 'snapshot_id': '687965ee-7395-4c51-bfa1-957f702aa9e3'}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:36:07 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-da8c3c52-f760-4035-bec2-1662c2d8950f tempest-VolumesDeleteCascade-1372244469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19814e16-592e-4169-856e-0f4a93915dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:36:07 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-da8c3c52-f760-4035-bec2-1662c2d8950f tempest-VolumesDeleteCascade-1372244469 None] Volume volume-adb80326-4766-4abc-8900-cd92a23dd4b5 (adb80326-4766-4abc-8900-cd92a23dd4b5): created successfully
Jul 09 14:36:07 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-da8c3c52-f760-4035-bec2-1662c2d8950f tempest-VolumesDeleteCascade-1372244469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19814e16-592e-4169-856e-0f4a93915dac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:36:07 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-da8c3c52-f760-4035-bec2-1662c2d8950f tempest-VolumesDeleteCascade-1372244469 None] Flow 'volume_create_manager' (d77146ce-1707-4b9d-ab5d-204def3b0c5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:36:07 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-da8c3c52-f760-4035-bec2-1662c2d8950f tempest-VolumesDeleteCascade-1372244469 None] Created volume successfully.
Jul 09 14:36:08 devstack sudo[92796]: pam_unix(sudo:session): session closed for user root
Jul 09 14:36:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b2c9ca95-c205-4aa7-96cb-9cbd7f637a7c tempest-AttachVolumeTestJSON-1021532728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-f4037ab3-2b95-420a-8f05-28104dae06eb 1073741824" returned: 0 in 1.102s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:36:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b2c9ca95-c205-4aa7-96cb-9cbd7f637a7c tempest-AttachVolumeTestJSON-1021532728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-f4037ab3-2b95-420a-8f05-28104dae06eb {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:36:08 devstack sudo[92805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-f4037ab3-2b95-420a-8f05-28104dae06eb
Jul 09 14:36:08 devstack sudo[92805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:36:08 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d9c30c78-3485-4410-b9a9-080242ece6a8 tempest-VolumesDeleteCascade-1372244469 None] Acquiring lock "cinder-d9097d83-dd72-4c1d-8cde-26af9b2077fd-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:36:08 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d9c30c78-3485-4410-b9a9-080242ece6a8 tempest-VolumesDeleteCascade-1372244469 None] Lock "cinder-d9097d83-dd72-4c1d-8cde-26af9b2077fd-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:36:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d9c30c78-3485-4410-b9a9-080242ece6a8 tempest-VolumesDeleteCascade-1372244469 None] Performing cascade delete. {{(pid=87230) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Jul 09 14:36:08 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d9c30c78-3485-4410-b9a9-080242ece6a8 tempest-VolumesDeleteCascade-1372244469 None] Acquiring lock "cinder-687965ee-7395-4c51-bfa1-957f702aa9e3-delete_snapshot" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:36:08 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d9c30c78-3485-4410-b9a9-080242ece6a8 tempest-VolumesDeleteCascade-1372244469 None] Lock "cinder-687965ee-7395-4c51-bfa1-957f702aa9e3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:36:08 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d9c30c78-3485-4410-b9a9-080242ece6a8 tempest-VolumesDeleteCascade-1372244469 None] Acquiring lock "cinder-quobyte-d9097d83-dd72-4c1d-8cde-26af9b2077fd" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:36:08 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d9c30c78-3485-4410-b9a9-080242ece6a8 tempest-VolumesDeleteCascade-1372244469 None] Lock "cinder-quobyte-d9097d83-dd72-4c1d-8cde-26af9b2077fd" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:36:08 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d9c30c78-3485-4410-b9a9-080242ece6a8 tempest-VolumesDeleteCascade-1372244469 None] Acquiring lock "cinder-quobyte-687965ee-7395-4c51-bfa1-957f702aa9e3" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:36:08 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d9c30c78-3485-4410-b9a9-080242ece6a8 tempest-VolumesDeleteCascade-1372244469 None] Lock "cinder-quobyte-687965ee-7395-4c51-bfa1-957f702aa9e3" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:36:08 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-d9c30c78-3485-4410-b9a9-080242ece6a8 tempest-VolumesDeleteCascade-1372244469 None] Deleting offline snapshot 687965ee-7395-4c51-bfa1-957f702aa9e3 of volume d9097d83-dd72-4c1d-8cde-26af9b2077fd {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 14:36:08 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-d9c30c78-3485-4410-b9a9-080242ece6a8 tempest-VolumesDeleteCascade-1372244469 None] snapshot_file for this snap is: volume-d9097d83-dd72-4c1d-8cde-26af9b2077fd.687965ee-7395-4c51-bfa1-957f702aa9e3 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 14:36:08 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad80d7d9-b378-40d2-a644-f388e9227935]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:36:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d9c30c78-3485-4410-b9a9-080242ece6a8 tempest-VolumesDeleteCascade-1372244469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d9097d83-dd72-4c1d-8cde-26af9b2077fd.687965ee-7395-4c51-bfa1-957f702aa9e3 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:36:08 devstack sudo[92808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d9097d83-dd72-4c1d-8cde-26af9b2077fd.687965ee-7395-4c51-bfa1-957f702aa9e3
Jul 09 14:36:08 devstack sudo[92808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:36:09 devstack sudo[92805]: pam_unix(sudo:session): session closed for user root
Jul 09 14:36:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b2c9ca95-c205-4aa7-96cb-9cbd7f637a7c tempest-AttachVolumeTestJSON-1021532728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-f4037ab3-2b95-420a-8f05-28104dae06eb" returned: 0 in 0.881s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:36:09 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b2c9ca95-c205-4aa7-96cb-9cbd7f637a7c tempest-AttachVolumeTestJSON-1021532728 None] <== create_volume: return (2041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:36:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b2c9ca95-c205-4aa7-96cb-9cbd7f637a7c tempest-AttachVolumeTestJSON-1021532728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.046s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:36:09 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b2c9ca95-c205-4aa7-96cb-9cbd7f637a7c tempest-AttachVolumeTestJSON-1021532728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff3f5adc-eed8-4198-8c61-af52e986b5fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4037ab3-2b95-420a-8f05-28104dae06eb', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:36:09 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b2c9ca95-c205-4aa7-96cb-9cbd7f637a7c tempest-AttachVolumeTestJSON-1021532728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b94108e6-e7ff-45c1-9775-6e4012730928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:36:09 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-b2c9ca95-c205-4aa7-96cb-9cbd7f637a7c tempest-AttachVolumeTestJSON-1021532728 None] Volume volume-f4037ab3-2b95-420a-8f05-28104dae06eb (f4037ab3-2b95-420a-8f05-28104dae06eb): created successfully
Jul 09 14:36:09 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b2c9ca95-c205-4aa7-96cb-9cbd7f637a7c tempest-AttachVolumeTestJSON-1021532728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b94108e6-e7ff-45c1-9775-6e4012730928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:36:09 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b2c9ca95-c205-4aa7-96cb-9cbd7f637a7c tempest-AttachVolumeTestJSON-1021532728 None] Flow 'volume_create_manager' (52575906-fd8f-4137-b29b-5b72b12fa373) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:36:09 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-b2c9ca95-c205-4aa7-96cb-9cbd7f637a7c tempest-AttachVolumeTestJSON-1021532728 None] Created volume successfully.
Jul 09 14:36:09 devstack sudo[92808]: pam_unix(sudo:session): session closed for user root
Jul 09 14:36:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d9c30c78-3485-4410-b9a9-080242ece6a8 tempest-VolumesDeleteCascade-1372244469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d9097d83-dd72-4c1d-8cde-26af9b2077fd.687965ee-7395-4c51-bfa1-957f702aa9e3" returned: 0 in 1.021s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:36:09 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-d9c30c78-3485-4410-b9a9-080242ece6a8 tempest-VolumesDeleteCascade-1372244469 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9097d83-dd72-4c1d-8cde-26af9b2077fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 14:36:09 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef9416c-ac85-48dd-8b09-15b0c5e76551]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:36:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d9c30c78-3485-4410-b9a9-080242ece6a8 tempest-VolumesDeleteCascade-1372244469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d9097d83-dd72-4c1d-8cde-26af9b2077fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:36:09 devstack sudo[92815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d9097d83-dd72-4c1d-8cde-26af9b2077fd
Jul 09 14:36:09 devstack sudo[92815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:36:10 devstack sudo[92815]: pam_unix(sudo:session): session closed for user root
Jul 09 14:36:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d9c30c78-3485-4410-b9a9-080242ece6a8 tempest-VolumesDeleteCascade-1372244469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d9097d83-dd72-4c1d-8cde-26af9b2077fd" returned: 0 in 0.929s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:36:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d9c30c78-3485-4410-b9a9-080242ece6a8 tempest-VolumesDeleteCascade-1372244469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d9097d83-dd72-4c1d-8cde-26af9b2077fd.687965ee-7395-4c51-bfa1-957f702aa9e3 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:36:10 devstack sudo[92825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d9097d83-dd72-4c1d-8cde-26af9b2077fd.687965ee-7395-4c51-bfa1-957f702aa9e3
Jul 09 14:36:10 devstack sudo[92825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:36:11 devstack sudo[92825]: pam_unix(sudo:session): session closed for user root
Jul 09 14:36:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d9c30c78-3485-4410-b9a9-080242ece6a8 tempest-VolumesDeleteCascade-1372244469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d9097d83-dd72-4c1d-8cde-26af9b2077fd.687965ee-7395-4c51-bfa1-957f702aa9e3" returned: 0 in 0.785s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:36:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d9c30c78-3485-4410-b9a9-080242ece6a8 tempest-VolumesDeleteCascade-1372244469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d9097d83-dd72-4c1d-8cde-26af9b2077fd.687965ee-7395-4c51-bfa1-957f702aa9e3 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:36:11 devstack sudo[92831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d9097d83-dd72-4c1d-8cde-26af9b2077fd.687965ee-7395-4c51-bfa1-957f702aa9e3
Jul 09 14:36:11 devstack sudo[92831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:36:12 devstack sudo[92831]: pam_unix(sudo:session): session closed for user root
Jul 09 14:36:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d9c30c78-3485-4410-b9a9-080242ece6a8 tempest-VolumesDeleteCascade-1372244469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d9097d83-dd72-4c1d-8cde-26af9b2077fd.687965ee-7395-4c51-bfa1-957f702aa9e3" returned: 0 in 0.735s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:36:12 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d9c30c78-3485-4410-b9a9-080242ece6a8 tempest-VolumesDeleteCascade-1372244469 None] Lock "cinder-quobyte-687965ee-7395-4c51-bfa1-957f702aa9e3" released by "_delete_snapshot" :: held 3.613s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:36:12 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d9c30c78-3485-4410-b9a9-080242ece6a8 tempest-VolumesDeleteCascade-1372244469 None] Lock "cinder-quobyte-d9097d83-dd72-4c1d-8cde-26af9b2077fd" released by "delete_snapshot" :: held 3.649s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:36:12 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:UPDATE=46,cinder:SELECT=58,cinder:INSERT=14,cinder:DELETE=7 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 14:36:12 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-d9c30c78-3485-4410-b9a9-080242ece6a8 tempest-VolumesDeleteCascade-1372244469 None] Created reservations ['7170deb4-be08-41ad-aaae-094dc3aab4c2', '24a06561-4819-42a2-82a7-5b4b5636f35b', '7d281b19-e56f-4dca-8234-d328b3888b3b', '37475e0f-cdad-4960-ba8d-fb199d908e09'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:36:12 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-d9c30c78-3485-4410-b9a9-080242ece6a8 tempest-VolumesDeleteCascade-1372244469 None] Delete snapshot completed successfully.
Jul 09 14:36:12 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d9c30c78-3485-4410-b9a9-080242ece6a8 tempest-VolumesDeleteCascade-1372244469 None] Lock "cinder-687965ee-7395-4c51-bfa1-957f702aa9e3-delete_snapshot" released by "delete_snapshot" :: held 3.873s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:36:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d9c30c78-3485-4410-b9a9-080242ece6a8 tempest-VolumesDeleteCascade-1372244469 None] Snapshots deleted, issuing volume delete {{(pid=87230) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Jul 09 14:36:12 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d9c30c78-3485-4410-b9a9-080242ece6a8 tempest-VolumesDeleteCascade-1372244469 None] Acquiring lock "cinder-quobyte-d9097d83-dd72-4c1d-8cde-26af9b2077fd" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:36:12 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d9c30c78-3485-4410-b9a9-080242ece6a8 tempest-VolumesDeleteCascade-1372244469 None] Lock "cinder-quobyte-d9097d83-dd72-4c1d-8cde-26af9b2077fd" acquired by "delete_volume" :: waited 0.018s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:36:12 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[8269e69f-61b3-4e27-802a-cc22f9eab5fa]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:36:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d9c30c78-3485-4410-b9a9-080242ece6a8 tempest-VolumesDeleteCascade-1372244469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d9097d83-dd72-4c1d-8cde-26af9b2077fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:36:12 devstack sudo[92835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d9097d83-dd72-4c1d-8cde-26af9b2077fd
Jul 09 14:36:12 devstack sudo[92835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:36:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-b71ab6db-5491-47a2-a77b-6884369f9762 req-5f813cc0-bbcc-4997-bcb7-5a3f982232db tempest-AttachVolumeTestJSON-1021532728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:36:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-b71ab6db-5491-47a2-a77b-6884369f9762 req-5f813cc0-bbcc-4997-bcb7-5a3f982232db tempest-AttachVolumeTestJSON-1021532728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:36:13 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[7800d4bc-0c9b-4777-b4fe-c7e2350a005e]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:36:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-b71ab6db-5491-47a2-a77b-6884369f9762 req-5f813cc0-bbcc-4997-bcb7-5a3f982232db tempest-AttachVolumeTestJSON-1021532728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-f4037ab3-2b95-420a-8f05-28104dae06eb {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:36:13 devstack sudo[92845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-f4037ab3-2b95-420a-8f05-28104dae06eb
Jul 09 14:36:13 devstack sudo[92845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:36:13 devstack sudo[92835]: pam_unix(sudo:session): session closed for user root
Jul 09 14:36:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d9c30c78-3485-4410-b9a9-080242ece6a8 tempest-VolumesDeleteCascade-1372244469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d9097d83-dd72-4c1d-8cde-26af9b2077fd" returned: 0 in 1.204s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:36:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d9c30c78-3485-4410-b9a9-080242ece6a8 tempest-VolumesDeleteCascade-1372244469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d9097d83-dd72-4c1d-8cde-26af9b2077fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:36:13 devstack sudo[92851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d9097d83-dd72-4c1d-8cde-26af9b2077fd
Jul 09 14:36:13 devstack sudo[92851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:36:14 devstack sudo[92845]: pam_unix(sudo:session): session closed for user root
Jul 09 14:36:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-b71ab6db-5491-47a2-a77b-6884369f9762 req-5f813cc0-bbcc-4997-bcb7-5a3f982232db tempest-AttachVolumeTestJSON-1021532728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-f4037ab3-2b95-420a-8f05-28104dae06eb" returned: 0 in 1.140s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:36:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-b71ab6db-5491-47a2-a77b-6884369f9762 req-5f813cc0-bbcc-4997-bcb7-5a3f982232db tempest-AttachVolumeTestJSON-1021532728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.177s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:36:14 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=61,cinder:UPDATE=60,cinder:INSERT=9,cinder:DELETE=3 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 14:36:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-b71ab6db-5491-47a2-a77b-6884369f9762 req-5f813cc0-bbcc-4997-bcb7-5a3f982232db tempest-AttachVolumeTestJSON-1021532728 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653', 'name': 'volume-f4037ab3-2b95-420a-8f05-28104dae06eb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '088d0194-024d-4b3d-a1d1-3687b9f8d9ee', 'enforce_multipath': True} {{(pid=87230) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 09 14:36:14 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-b71ab6db-5491-47a2-a77b-6884369f9762 req-5f813cc0-bbcc-4997-bcb7-5a3f982232db tempest-AttachVolumeTestJSON-1021532728 None] attachment_update completed successfully.
Jul 09 14:36:14 devstack sudo[92851]: pam_unix(sudo:session): session closed for user root
Jul 09 14:36:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d9c30c78-3485-4410-b9a9-080242ece6a8 tempest-VolumesDeleteCascade-1372244469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d9097d83-dd72-4c1d-8cde-26af9b2077fd" returned: 0 in 0.985s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:36:14 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d9c30c78-3485-4410-b9a9-080242ece6a8 tempest-VolumesDeleteCascade-1372244469 None] Lock "cinder-quobyte-d9097d83-dd72-4c1d-8cde-26af9b2077fd" released by "delete_volume" :: held 2.307s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:36:14 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-d9c30c78-3485-4410-b9a9-080242ece6a8 tempest-VolumesDeleteCascade-1372244469 None] Created reservations ['822cc7e3-a9db-40fc-b667-ebf26b7120a2', '26b4028f-ab52-4dfc-8ec4-0537446407e5', '6748434a-437c-4fbc-909c-e1365581f570', 'bd0245e7-3198-4c08-8c3d-520f0c785780'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:36:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d9c30c78-3485-4410-b9a9-080242ece6a8 tempest-VolumesDeleteCascade-1372244469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:36:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d9c30c78-3485-4410-b9a9-080242ece6a8 tempest-VolumesDeleteCascade-1372244469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:36:14 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-d9c30c78-3485-4410-b9a9-080242ece6a8 tempest-VolumesDeleteCascade-1372244469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:36:14 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-d9c30c78-3485-4410-b9a9-080242ece6a8 tempest-VolumesDeleteCascade-1372244469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:36:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d9c30c78-3485-4410-b9a9-080242ece6a8 tempest-VolumesDeleteCascade-1372244469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:36:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d9c30c78-3485-4410-b9a9-080242ece6a8 tempest-VolumesDeleteCascade-1372244469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:36:14 devstack sudo[92927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:36:14 devstack sudo[92927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:36:15 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b46515a8-a080-47d0-b167-dabc1d4c32f9 tempest-VolumesDeleteCascade-1372244469 None] Acquiring lock "cinder-adb80326-4766-4abc-8900-cd92a23dd4b5-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:36:15 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b46515a8-a080-47d0-b167-dabc1d4c32f9 tempest-VolumesDeleteCascade-1372244469 None] Lock "cinder-adb80326-4766-4abc-8900-cd92a23dd4b5-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:36:15 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b46515a8-a080-47d0-b167-dabc1d4c32f9 tempest-VolumesDeleteCascade-1372244469 None] Acquiring lock "cinder-quobyte-adb80326-4766-4abc-8900-cd92a23dd4b5" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:36:15 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b46515a8-a080-47d0-b167-dabc1d4c32f9 tempest-VolumesDeleteCascade-1372244469 None] Lock "cinder-quobyte-adb80326-4766-4abc-8900-cd92a23dd4b5" acquired by "delete_volume" :: waited 0.021s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:36:15 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b60863-5731-4b5d-9491-af79ba0d532e]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:36:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b46515a8-a080-47d0-b167-dabc1d4c32f9 tempest-VolumesDeleteCascade-1372244469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-adb80326-4766-4abc-8900-cd92a23dd4b5 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:36:15 devstack sudo[93256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-adb80326-4766-4abc-8900-cd92a23dd4b5
Jul 09 14:36:15 devstack sudo[93256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:36:16 devstack sudo[92927]: pam_unix(sudo:session): session closed for user root
Jul 09 14:36:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d9c30c78-3485-4410-b9a9-080242ece6a8 tempest-VolumesDeleteCascade-1372244469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 1.257s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:36:16 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-d9c30c78-3485-4410-b9a9-080242ece6a8 tempest-VolumesDeleteCascade-1372244469 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:36:16 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-d9c30c78-3485-4410-b9a9-080242ece6a8 tempest-VolumesDeleteCascade-1372244469 None] Deleted volume successfully.
Jul 09 14:36:16 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d9c30c78-3485-4410-b9a9-080242ece6a8 tempest-VolumesDeleteCascade-1372244469 None] Lock "cinder-d9097d83-dd72-4c1d-8cde-26af9b2077fd-delete_volume" released by "delete_volume" :: held 7.948s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:36:16 devstack sudo[93256]: pam_unix(sudo:session): session closed for user root
Jul 09 14:36:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b46515a8-a080-47d0-b167-dabc1d4c32f9 tempest-VolumesDeleteCascade-1372244469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-adb80326-4766-4abc-8900-cd92a23dd4b5" returned: 0 in 1.199s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:36:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b46515a8-a080-47d0-b167-dabc1d4c32f9 tempest-VolumesDeleteCascade-1372244469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-adb80326-4766-4abc-8900-cd92a23dd4b5 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:36:16 devstack sudo[93266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-adb80326-4766-4abc-8900-cd92a23dd4b5
Jul 09 14:36:16 devstack sudo[93266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:36:17 devstack sudo[93266]: pam_unix(sudo:session): session closed for user root
Jul 09 14:36:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b46515a8-a080-47d0-b167-dabc1d4c32f9 tempest-VolumesDeleteCascade-1372244469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-adb80326-4766-4abc-8900-cd92a23dd4b5" returned: 0 in 0.815s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:36:17 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b46515a8-a080-47d0-b167-dabc1d4c32f9 tempest-VolumesDeleteCascade-1372244469 None] Lock "cinder-quobyte-adb80326-4766-4abc-8900-cd92a23dd4b5" released by "delete_volume" :: held 2.098s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:36:17 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-b46515a8-a080-47d0-b167-dabc1d4c32f9 tempest-VolumesDeleteCascade-1372244469 None] Created reservations ['c4bb467e-7bcb-4a2a-8922-3d7b50ee748f', 'ccd03263-59d5-44b3-a95d-1fe16e877103', '8dbcaec2-244b-4695-8884-35c7dfc9e883', 'bbe1afba-f0f3-4387-81db-a08a7cd21e08'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:36:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b46515a8-a080-47d0-b167-dabc1d4c32f9 tempest-VolumesDeleteCascade-1372244469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:36:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b46515a8-a080-47d0-b167-dabc1d4c32f9 tempest-VolumesDeleteCascade-1372244469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:36:17 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b46515a8-a080-47d0-b167-dabc1d4c32f9 tempest-VolumesDeleteCascade-1372244469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:36:17 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b46515a8-a080-47d0-b167-dabc1d4c32f9 tempest-VolumesDeleteCascade-1372244469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:36:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b46515a8-a080-47d0-b167-dabc1d4c32f9 tempest-VolumesDeleteCascade-1372244469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:36:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b46515a8-a080-47d0-b167-dabc1d4c32f9 tempest-VolumesDeleteCascade-1372244469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:36:17 devstack sudo[93269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:36:17 devstack sudo[93269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:36:18 devstack sudo[93269]: pam_unix(sudo:session): session closed for user root
Jul 09 14:36:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b46515a8-a080-47d0-b167-dabc1d4c32f9 tempest-VolumesDeleteCascade-1372244469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.902s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:36:18 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-b46515a8-a080-47d0-b167-dabc1d4c32f9 tempest-VolumesDeleteCascade-1372244469 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:36:18 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-b46515a8-a080-47d0-b167-dabc1d4c32f9 tempest-VolumesDeleteCascade-1372244469 None] Deleted volume successfully.
Jul 09 14:36:18 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b46515a8-a080-47d0-b167-dabc1d4c32f9 tempest-VolumesDeleteCascade-1372244469 None] Lock "cinder-adb80326-4766-4abc-8900-cd92a23dd4b5-delete_volume" released by "delete_volume" :: held 3.322s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:36:26 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-b508731c-6bc0-442d-a13f-e050d8d33db9 tempest-VolumesTransfersTest-1528737589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:36:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b508731c-6bc0-442d-a13f-e050d8d33db9 tempest-VolumesTransfersTest-1528737589 None] Flow 'volume_create_manager' (bdbcfc9a-3fb7-4775-b8db-b659e84b2567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:36:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b508731c-6bc0-442d-a13f-e050d8d33db9 tempest-VolumesTransfersTest-1528737589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9baf24aa-deb2-4076-82ea-682d2ce17e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:36:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b508731c-6bc0-442d-a13f-e050d8d33db9 tempest-VolumesTransfersTest-1528737589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9baf24aa-deb2-4076-82ea-682d2ce17e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:36:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-224356076',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6252d726-7b49-4911-b9c8-e93b6cd4e9a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18fb4f176473439dabcbf2e0ac55fe7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:36:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:36:26Z,use_quota=True,user_id='4ec1e683edbe49159f374da3579eb233',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:36:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b508731c-6bc0-442d-a13f-e050d8d33db9 tempest-VolumesTransfersTest-1528737589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e17d143-b672-4bba-ba30-053a66c1d233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:36:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b508731c-6bc0-442d-a13f-e050d8d33db9 tempest-VolumesTransfersTest-1528737589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e17d143-b672-4bba-ba30-053a66c1d233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:36:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b508731c-6bc0-442d-a13f-e050d8d33db9 tempest-VolumesTransfersTest-1528737589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1c5d616-d0d0-4919-b7fe-a29f49d37814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:36:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b508731c-6bc0-442d-a13f-e050d8d33db9 tempest-VolumesTransfersTest-1528737589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1c5d616-d0d0-4919-b7fe-a29f49d37814) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6252d726-7b49-4911-b9c8-e93b6cd4e9a6', 'volume_name': 'volume-6252d726-7b49-4911-b9c8-e93b6cd4e9a6', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:36:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b508731c-6bc0-442d-a13f-e050d8d33db9 tempest-VolumesTransfersTest-1528737589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (436be2f9-fc05-41e1-895a-726018aade57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:36:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b508731c-6bc0-442d-a13f-e050d8d33db9 tempest-VolumesTransfersTest-1528737589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (436be2f9-fc05-41e1-895a-726018aade57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:36:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b508731c-6bc0-442d-a13f-e050d8d33db9 tempest-VolumesTransfersTest-1528737589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8216246-5ba3-451d-9faa-1b9b1616a720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:36:26 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-b508731c-6bc0-442d-a13f-e050d8d33db9 tempest-VolumesTransfersTest-1528737589 None] Volume 6252d726-7b49-4911-b9c8-e93b6cd4e9a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6252d726-7b49-4911-b9c8-e93b6cd4e9a6', 'volume_size': 1}
Jul 09 14:36:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b508731c-6bc0-442d-a13f-e050d8d33db9 tempest-VolumesTransfersTest-1528737589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:36:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b508731c-6bc0-442d-a13f-e050d8d33db9 tempest-VolumesTransfersTest-1528737589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:36:26 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b508731c-6bc0-442d-a13f-e050d8d33db9 tempest-VolumesTransfersTest-1528737589 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:36:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-224356076',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6252d726-7b49-4911-b9c8-e93b6cd4e9a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18fb4f176473439dabcbf2e0ac55fe7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:36:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:36:26Z,use_quota=True,user_id='4ec1e683edbe49159f374da3579eb233',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:36:26 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-b508731c-6bc0-442d-a13f-e050d8d33db9 tempest-VolumesTransfersTest-1528737589 None] Creating volume 6252d726-7b49-4911-b9c8-e93b6cd4e9a6 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:36:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b508731c-6bc0-442d-a13f-e050d8d33db9 tempest-VolumesTransfersTest-1528737589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:36:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b508731c-6bc0-442d-a13f-e050d8d33db9 tempest-VolumesTransfersTest-1528737589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:36:26 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b508731c-6bc0-442d-a13f-e050d8d33db9 tempest-VolumesTransfersTest-1528737589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:36:26 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b508731c-6bc0-442d-a13f-e050d8d33db9 tempest-VolumesTransfersTest-1528737589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:36:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b508731c-6bc0-442d-a13f-e050d8d33db9 tempest-VolumesTransfersTest-1528737589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:36:26 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b508731c-6bc0-442d-a13f-e050d8d33db9 tempest-VolumesTransfersTest-1528737589 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:36:26 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-b508731c-6bc0-442d-a13f-e050d8d33db9 tempest-VolumesTransfersTest-1528737589 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:36:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b508731c-6bc0-442d-a13f-e050d8d33db9 tempest-VolumesTransfersTest-1528737589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-6252d726-7b49-4911-b9c8-e93b6cd4e9a6 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:36:26 devstack sudo[93357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-6252d726-7b49-4911-b9c8-e93b6cd4e9a6 1073741824
Jul 09 14:36:26 devstack sudo[93357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:36:27 devstack sudo[93357]: pam_unix(sudo:session): session closed for user root
Jul 09 14:36:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b508731c-6bc0-442d-a13f-e050d8d33db9 tempest-VolumesTransfersTest-1528737589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-6252d726-7b49-4911-b9c8-e93b6cd4e9a6 1073741824" returned: 0 in 1.629s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:36:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b508731c-6bc0-442d-a13f-e050d8d33db9 tempest-VolumesTransfersTest-1528737589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-6252d726-7b49-4911-b9c8-e93b6cd4e9a6 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:36:27 devstack sudo[93365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-6252d726-7b49-4911-b9c8-e93b6cd4e9a6
Jul 09 14:36:27 devstack sudo[93365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:36:29 devstack sudo[93365]: pam_unix(sudo:session): session closed for user root
Jul 09 14:36:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b508731c-6bc0-442d-a13f-e050d8d33db9 tempest-VolumesTransfersTest-1528737589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-6252d726-7b49-4911-b9c8-e93b6cd4e9a6" returned: 0 in 1.819s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:36:29 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b508731c-6bc0-442d-a13f-e050d8d33db9 tempest-VolumesTransfersTest-1528737589 None] <== create_volume: return (3552ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:36:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b508731c-6bc0-442d-a13f-e050d8d33db9 tempest-VolumesTransfersTest-1528737589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.555s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:36:29 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b508731c-6bc0-442d-a13f-e050d8d33db9 tempest-VolumesTransfersTest-1528737589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8216246-5ba3-451d-9faa-1b9b1616a720) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6252d726-7b49-4911-b9c8-e93b6cd4e9a6', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:36:29 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b508731c-6bc0-442d-a13f-e050d8d33db9 tempest-VolumesTransfersTest-1528737589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f99bbba-9a6d-46a1-acea-439094d5f373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:36:29 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-b508731c-6bc0-442d-a13f-e050d8d33db9 tempest-VolumesTransfersTest-1528737589 None] Volume volume-6252d726-7b49-4911-b9c8-e93b6cd4e9a6 (6252d726-7b49-4911-b9c8-e93b6cd4e9a6): created successfully
Jul 09 14:36:29 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b508731c-6bc0-442d-a13f-e050d8d33db9 tempest-VolumesTransfersTest-1528737589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f99bbba-9a6d-46a1-acea-439094d5f373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:36:29 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b508731c-6bc0-442d-a13f-e050d8d33db9 tempest-VolumesTransfersTest-1528737589 None] Flow 'volume_create_manager' (bdbcfc9a-3fb7-4775-b8db-b659e84b2567) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:36:29 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-b508731c-6bc0-442d-a13f-e050d8d33db9 tempest-VolumesTransfersTest-1528737589 None] Created volume successfully.
Jul 09 14:36:31 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-ed0c4b28-7839-46ca-849a-e6095ada4264 tempest-VolumesTransfersTest-674653839 None] Transfer volume completed successfully.
Jul 09 14:36:33 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-92482857-4920-453e-902e-445de44e02ed tempest-VolumesTransfersTest-643033624 None] Acquiring lock "cinder-6252d726-7b49-4911-b9c8-e93b6cd4e9a6-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:36:33 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-92482857-4920-453e-902e-445de44e02ed tempest-VolumesTransfersTest-643033624 None] Lock "cinder-6252d726-7b49-4911-b9c8-e93b6cd4e9a6-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:36:33 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-92482857-4920-453e-902e-445de44e02ed tempest-VolumesTransfersTest-643033624 None] Acquiring lock "cinder-quobyte-6252d726-7b49-4911-b9c8-e93b6cd4e9a6" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:36:33 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-92482857-4920-453e-902e-445de44e02ed tempest-VolumesTransfersTest-643033624 None] Lock "cinder-quobyte-6252d726-7b49-4911-b9c8-e93b6cd4e9a6" acquired by "delete_volume" :: waited 0.039s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:36:33 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[41874a0a-c4d3-4921-91f7-f273046e6c8f]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:36:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-92482857-4920-453e-902e-445de44e02ed tempest-VolumesTransfersTest-643033624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-6252d726-7b49-4911-b9c8-e93b6cd4e9a6 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:36:33 devstack sudo[93882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-6252d726-7b49-4911-b9c8-e93b6cd4e9a6
Jul 09 14:36:33 devstack sudo[93882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:36:36 devstack sudo[93882]: pam_unix(sudo:session): session closed for user root
Jul 09 14:36:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-92482857-4920-453e-902e-445de44e02ed tempest-VolumesTransfersTest-643033624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-6252d726-7b49-4911-b9c8-e93b6cd4e9a6" returned: 0 in 2.807s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:36:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-92482857-4920-453e-902e-445de44e02ed tempest-VolumesTransfersTest-643033624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-6252d726-7b49-4911-b9c8-e93b6cd4e9a6 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:36:36 devstack sudo[93940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-6252d726-7b49-4911-b9c8-e93b6cd4e9a6
Jul 09 14:36:36 devstack sudo[93940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:36:37 devstack sudo[93940]: pam_unix(sudo:session): session closed for user root
Jul 09 14:36:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-92482857-4920-453e-902e-445de44e02ed tempest-VolumesTransfersTest-643033624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-6252d726-7b49-4911-b9c8-e93b6cd4e9a6" returned: 0 in 1.684s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:36:37 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-92482857-4920-453e-902e-445de44e02ed tempest-VolumesTransfersTest-643033624 None] Lock "cinder-quobyte-6252d726-7b49-4911-b9c8-e93b6cd4e9a6" released by "delete_volume" :: held 4.619s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:36:38 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-92482857-4920-453e-902e-445de44e02ed tempest-VolumesTransfersTest-643033624 None] Created reservations ['a9823ae8-0e1b-43d7-beec-fc5240f5e736', '03437616-2ccf-4f73-9538-46566b627848', '92c060f3-807a-40a0-ab55-d85e9236e5e0', '577a8f6f-6476-449f-be92-96d9c78d806c'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:36:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-92482857-4920-453e-902e-445de44e02ed tempest-VolumesTransfersTest-643033624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:36:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-92482857-4920-453e-902e-445de44e02ed tempest-VolumesTransfersTest-643033624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:36:38 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-92482857-4920-453e-902e-445de44e02ed tempest-VolumesTransfersTest-643033624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:36:38 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-92482857-4920-453e-902e-445de44e02ed tempest-VolumesTransfersTest-643033624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:36:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-92482857-4920-453e-902e-445de44e02ed tempest-VolumesTransfersTest-643033624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:36:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-92482857-4920-453e-902e-445de44e02ed tempest-VolumesTransfersTest-643033624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:36:38 devstack sudo[93996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:36:38 devstack sudo[93996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:36:39 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-80238420-169c-46b7-8ab9-83b88037d01b tempest-VolumesTransfersTest-1528737589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:36:39 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-80238420-169c-46b7-8ab9-83b88037d01b tempest-VolumesTransfersTest-1528737589 None] Flow 'volume_create_manager' (bf20d7d4-b131-46da-b7fe-d7d835b49eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:36:39 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-80238420-169c-46b7-8ab9-83b88037d01b tempest-VolumesTransfersTest-1528737589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4d0d15d-b3d2-4e7c-8f7c-d070cb82c4d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:36:39 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-80238420-169c-46b7-8ab9-83b88037d01b tempest-VolumesTransfersTest-1528737589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4d0d15d-b3d2-4e7c-8f7c-d070cb82c4d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:36:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1617436261',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af7b738e-bada-4a93-9a25-b34630bba40b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18fb4f176473439dabcbf2e0ac55fe7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:36:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:36:39Z,use_quota=True,user_id='4ec1e683edbe49159f374da3579eb233',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:36:39 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-80238420-169c-46b7-8ab9-83b88037d01b tempest-VolumesTransfersTest-1528737589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (250d23c7-5e01-433e-8f8c-c19dba59c496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:36:39 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-80238420-169c-46b7-8ab9-83b88037d01b tempest-VolumesTransfersTest-1528737589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (250d23c7-5e01-433e-8f8c-c19dba59c496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:36:39 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-80238420-169c-46b7-8ab9-83b88037d01b tempest-VolumesTransfersTest-1528737589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08d55299-de6d-450c-9a4e-7d7fdbc9d70f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:36:39 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-80238420-169c-46b7-8ab9-83b88037d01b tempest-VolumesTransfersTest-1528737589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08d55299-de6d-450c-9a4e-7d7fdbc9d70f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af7b738e-bada-4a93-9a25-b34630bba40b', 'volume_name': 'volume-af7b738e-bada-4a93-9a25-b34630bba40b', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:36:39 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-80238420-169c-46b7-8ab9-83b88037d01b tempest-VolumesTransfersTest-1528737589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e070e49-c9fe-4ed2-8adb-92d8dc51955e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:36:39 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-80238420-169c-46b7-8ab9-83b88037d01b tempest-VolumesTransfersTest-1528737589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e070e49-c9fe-4ed2-8adb-92d8dc51955e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:36:39 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-80238420-169c-46b7-8ab9-83b88037d01b tempest-VolumesTransfersTest-1528737589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09a93493-2f76-4e13-96bb-50337dd4bfa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:36:39 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-80238420-169c-46b7-8ab9-83b88037d01b tempest-VolumesTransfersTest-1528737589 None] Volume af7b738e-bada-4a93-9a25-b34630bba40b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af7b738e-bada-4a93-9a25-b34630bba40b', 'volume_size': 1}
Jul 09 14:36:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-80238420-169c-46b7-8ab9-83b88037d01b tempest-VolumesTransfersTest-1528737589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:36:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-80238420-169c-46b7-8ab9-83b88037d01b tempest-VolumesTransfersTest-1528737589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:36:39 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-80238420-169c-46b7-8ab9-83b88037d01b tempest-VolumesTransfersTest-1528737589 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:36:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1617436261',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af7b738e-bada-4a93-9a25-b34630bba40b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18fb4f176473439dabcbf2e0ac55fe7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:36:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:36:39Z,use_quota=True,user_id='4ec1e683edbe49159f374da3579eb233',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:36:39 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-80238420-169c-46b7-8ab9-83b88037d01b tempest-VolumesTransfersTest-1528737589 None] Creating volume af7b738e-bada-4a93-9a25-b34630bba40b {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:36:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-80238420-169c-46b7-8ab9-83b88037d01b tempest-VolumesTransfersTest-1528737589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:36:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-80238420-169c-46b7-8ab9-83b88037d01b tempest-VolumesTransfersTest-1528737589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:36:39 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-80238420-169c-46b7-8ab9-83b88037d01b tempest-VolumesTransfersTest-1528737589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:36:39 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-80238420-169c-46b7-8ab9-83b88037d01b tempest-VolumesTransfersTest-1528737589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:36:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-80238420-169c-46b7-8ab9-83b88037d01b tempest-VolumesTransfersTest-1528737589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:36:39 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-80238420-169c-46b7-8ab9-83b88037d01b tempest-VolumesTransfersTest-1528737589 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:36:39 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-80238420-169c-46b7-8ab9-83b88037d01b tempest-VolumesTransfersTest-1528737589 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:36:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-80238420-169c-46b7-8ab9-83b88037d01b tempest-VolumesTransfersTest-1528737589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-af7b738e-bada-4a93-9a25-b34630bba40b 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:36:39 devstack sudo[93996]: pam_unix(sudo:session): session closed for user root
Jul 09 14:36:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-92482857-4920-453e-902e-445de44e02ed tempest-VolumesTransfersTest-643033624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 1.595s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:36:39 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-92482857-4920-453e-902e-445de44e02ed tempest-VolumesTransfersTest-643033624 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:36:39 devstack sudo[94002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-af7b738e-bada-4a93-9a25-b34630bba40b 1073741824
Jul 09 14:36:39 devstack sudo[94002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:36:39 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-92482857-4920-453e-902e-445de44e02ed tempest-VolumesTransfersTest-643033624 None] Deleted volume successfully.
Jul 09 14:36:39 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-92482857-4920-453e-902e-445de44e02ed tempest-VolumesTransfersTest-643033624 None] Lock "cinder-6252d726-7b49-4911-b9c8-e93b6cd4e9a6-delete_volume" released by "delete_volume" :: held 6.595s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:36:41 devstack sudo[94002]: pam_unix(sudo:session): session closed for user root
Jul 09 14:36:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-80238420-169c-46b7-8ab9-83b88037d01b tempest-VolumesTransfersTest-1528737589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-af7b738e-bada-4a93-9a25-b34630bba40b 1073741824" returned: 0 in 1.340s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:36:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-80238420-169c-46b7-8ab9-83b88037d01b tempest-VolumesTransfersTest-1528737589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-af7b738e-bada-4a93-9a25-b34630bba40b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:36:41 devstack sudo[94028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-af7b738e-bada-4a93-9a25-b34630bba40b
Jul 09 14:36:41 devstack sudo[94028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:36:41 devstack sudo[94028]: pam_unix(sudo:session): session closed for user root
Jul 09 14:36:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-80238420-169c-46b7-8ab9-83b88037d01b tempest-VolumesTransfersTest-1528737589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-af7b738e-bada-4a93-9a25-b34630bba40b" returned: 0 in 0.792s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:36:41 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-80238420-169c-46b7-8ab9-83b88037d01b tempest-VolumesTransfersTest-1528737589 None] <== create_volume: return (2199ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:36:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-80238420-169c-46b7-8ab9-83b88037d01b tempest-VolumesTransfersTest-1528737589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.202s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:36:41 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-80238420-169c-46b7-8ab9-83b88037d01b tempest-VolumesTransfersTest-1528737589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09a93493-2f76-4e13-96bb-50337dd4bfa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af7b738e-bada-4a93-9a25-b34630bba40b', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:36:41 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-80238420-169c-46b7-8ab9-83b88037d01b tempest-VolumesTransfersTest-1528737589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b922aee3-a98c-45ac-a343-8c348faa6fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:36:41 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-80238420-169c-46b7-8ab9-83b88037d01b tempest-VolumesTransfersTest-1528737589 None] Volume volume-af7b738e-bada-4a93-9a25-b34630bba40b (af7b738e-bada-4a93-9a25-b34630bba40b): created successfully
Jul 09 14:36:41 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-80238420-169c-46b7-8ab9-83b88037d01b tempest-VolumesTransfersTest-1528737589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b922aee3-a98c-45ac-a343-8c348faa6fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:36:41 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-80238420-169c-46b7-8ab9-83b88037d01b tempest-VolumesTransfersTest-1528737589 None] Flow 'volume_create_manager' (bf20d7d4-b131-46da-b7fe-d7d835b49eb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:36:41 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-80238420-169c-46b7-8ab9-83b88037d01b tempest-VolumesTransfersTest-1528737589 None] Created volume successfully.
Jul 09 14:36:43 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-519407bb-2b85-4afa-bae9-767e9564da23 tempest-VolumesTransfersTest-643033624 None] Acquiring lock "cinder-af7b738e-bada-4a93-9a25-b34630bba40b-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:36:43 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-519407bb-2b85-4afa-bae9-767e9564da23 tempest-VolumesTransfersTest-643033624 None] Lock "cinder-af7b738e-bada-4a93-9a25-b34630bba40b-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:36:43 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-519407bb-2b85-4afa-bae9-767e9564da23 tempest-VolumesTransfersTest-643033624 None] Acquiring lock "cinder-quobyte-af7b738e-bada-4a93-9a25-b34630bba40b" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:36:43 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-519407bb-2b85-4afa-bae9-767e9564da23 tempest-VolumesTransfersTest-643033624 None] Lock "cinder-quobyte-af7b738e-bada-4a93-9a25-b34630bba40b" acquired by "delete_volume" :: waited 0.015s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:36:43 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde315fa-8121-426b-ac0b-9e5edc7fb2e8]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:36:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-519407bb-2b85-4afa-bae9-767e9564da23 tempest-VolumesTransfersTest-643033624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-af7b738e-bada-4a93-9a25-b34630bba40b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:36:43 devstack sudo[94033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-af7b738e-bada-4a93-9a25-b34630bba40b
Jul 09 14:36:43 devstack sudo[94033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:36:44 devstack sudo[94033]: pam_unix(sudo:session): session closed for user root
Jul 09 14:36:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-519407bb-2b85-4afa-bae9-767e9564da23 tempest-VolumesTransfersTest-643033624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-af7b738e-bada-4a93-9a25-b34630bba40b" returned: 0 in 0.793s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:36:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-519407bb-2b85-4afa-bae9-767e9564da23 tempest-VolumesTransfersTest-643033624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-af7b738e-bada-4a93-9a25-b34630bba40b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:36:44 devstack sudo[94038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-af7b738e-bada-4a93-9a25-b34630bba40b
Jul 09 14:36:44 devstack sudo[94038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:36:44 devstack sudo[94038]: pam_unix(sudo:session): session closed for user root
Jul 09 14:36:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-519407bb-2b85-4afa-bae9-767e9564da23 tempest-VolumesTransfersTest-643033624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-af7b738e-bada-4a93-9a25-b34630bba40b" returned: 0 in 0.716s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:36:44 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-519407bb-2b85-4afa-bae9-767e9564da23 tempest-VolumesTransfersTest-643033624 None] Lock "cinder-quobyte-af7b738e-bada-4a93-9a25-b34630bba40b" released by "delete_volume" :: held 1.568s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:36:44 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-519407bb-2b85-4afa-bae9-767e9564da23 tempest-VolumesTransfersTest-643033624 None] Created reservations ['a08743a3-7b53-404e-bf3b-64b590613460', 'c5fd24e2-939d-4e74-9ded-af0fbacbabc6', '8861c48b-21d3-4045-9eee-03b6c42d27e8', 'a4a690aa-7154-4c3c-b874-80005cf91108'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:36:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-519407bb-2b85-4afa-bae9-767e9564da23 tempest-VolumesTransfersTest-643033624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:36:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-519407bb-2b85-4afa-bae9-767e9564da23 tempest-VolumesTransfersTest-643033624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:36:44 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-519407bb-2b85-4afa-bae9-767e9564da23 tempest-VolumesTransfersTest-643033624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:36:44 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-519407bb-2b85-4afa-bae9-767e9564da23 tempest-VolumesTransfersTest-643033624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:36:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-519407bb-2b85-4afa-bae9-767e9564da23 tempest-VolumesTransfersTest-643033624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:36:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-519407bb-2b85-4afa-bae9-767e9564da23 tempest-VolumesTransfersTest-643033624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:36:44 devstack sudo[94041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:36:44 devstack sudo[94041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:36:45 devstack sudo[94041]: pam_unix(sudo:session): session closed for user root
Jul 09 14:36:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-519407bb-2b85-4afa-bae9-767e9564da23 tempest-VolumesTransfersTest-643033624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.817s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:36:45 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-519407bb-2b85-4afa-bae9-767e9564da23 tempest-VolumesTransfersTest-643033624 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:36:45 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-519407bb-2b85-4afa-bae9-767e9564da23 tempest-VolumesTransfersTest-643033624 None] Deleted volume successfully.
Jul 09 14:36:45 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-519407bb-2b85-4afa-bae9-767e9564da23 tempest-VolumesTransfersTest-643033624 None] Lock "cinder-af7b738e-bada-4a93-9a25-b34630bba40b-delete_volume" released by "delete_volume" :: held 2.636s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:36:52 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c840ca8-ff2d-4e7b-af9a-26bcc3a0f9f9 tempest-VolumesCloneNegativeTest-836242236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:36:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3c840ca8-ff2d-4e7b-af9a-26bcc3a0f9f9 tempest-VolumesCloneNegativeTest-836242236 None] Flow 'volume_create_manager' (eb951425-83e7-4701-a6b8-91600124bbf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:36:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3c840ca8-ff2d-4e7b-af9a-26bcc3a0f9f9 tempest-VolumesCloneNegativeTest-836242236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a04e7ea-98a1-4e68-a934-c928cca55313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:36:52 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 14:36:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:36:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:36:52 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:36:52 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:36:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:36:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:36:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3c840ca8-ff2d-4e7b-af9a-26bcc3a0f9f9 tempest-VolumesCloneNegativeTest-836242236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a04e7ea-98a1-4e68-a934-c928cca55313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:36:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1764405196',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc3a1c5d-4f93-49d1-8591-23a443e2a1d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72e09f7a90044c5cb4e8caf3ca7551ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:36:52Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:36:52Z,use_quota=True,user_id='44b579e6d3e8477bb29bbfef4481bae9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:36:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3c840ca8-ff2d-4e7b-af9a-26bcc3a0f9f9 tempest-VolumesCloneNegativeTest-836242236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8243d12c-49b3-4068-b897-109624965c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:36:52 devstack sudo[94128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:36:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3c840ca8-ff2d-4e7b-af9a-26bcc3a0f9f9 tempest-VolumesCloneNegativeTest-836242236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8243d12c-49b3-4068-b897-109624965c80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:36:52 devstack sudo[94128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:36:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3c840ca8-ff2d-4e7b-af9a-26bcc3a0f9f9 tempest-VolumesCloneNegativeTest-836242236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (937d9d78-d94b-49a0-844c-2a503bb15640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:36:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3c840ca8-ff2d-4e7b-af9a-26bcc3a0f9f9 tempest-VolumesCloneNegativeTest-836242236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (937d9d78-d94b-49a0-844c-2a503bb15640) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc3a1c5d-4f93-49d1-8591-23a443e2a1d9', 'volume_name': 'volume-dc3a1c5d-4f93-49d1-8591-23a443e2a1d9', 'volume_size': 2}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:36:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3c840ca8-ff2d-4e7b-af9a-26bcc3a0f9f9 tempest-VolumesCloneNegativeTest-836242236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8abfebbb-8887-4516-b402-d75e0a067de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:36:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3c840ca8-ff2d-4e7b-af9a-26bcc3a0f9f9 tempest-VolumesCloneNegativeTest-836242236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8abfebbb-8887-4516-b402-d75e0a067de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:36:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3c840ca8-ff2d-4e7b-af9a-26bcc3a0f9f9 tempest-VolumesCloneNegativeTest-836242236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6947ade-31a4-4ccf-b5e9-ed3e7f2682ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:36:52 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-3c840ca8-ff2d-4e7b-af9a-26bcc3a0f9f9 tempest-VolumesCloneNegativeTest-836242236 None] Volume dc3a1c5d-4f93-49d1-8591-23a443e2a1d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc3a1c5d-4f93-49d1-8591-23a443e2a1d9', 'volume_size': 2}
Jul 09 14:36:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3c840ca8-ff2d-4e7b-af9a-26bcc3a0f9f9 tempest-VolumesCloneNegativeTest-836242236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:36:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3c840ca8-ff2d-4e7b-af9a-26bcc3a0f9f9 tempest-VolumesCloneNegativeTest-836242236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:36:52 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3c840ca8-ff2d-4e7b-af9a-26bcc3a0f9f9 tempest-VolumesCloneNegativeTest-836242236 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:36:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1764405196',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc3a1c5d-4f93-49d1-8591-23a443e2a1d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72e09f7a90044c5cb4e8caf3ca7551ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:36:52Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:36:52Z,use_quota=True,user_id='44b579e6d3e8477bb29bbfef4481bae9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:36:52 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-3c840ca8-ff2d-4e7b-af9a-26bcc3a0f9f9 tempest-VolumesCloneNegativeTest-836242236 None] Creating volume dc3a1c5d-4f93-49d1-8591-23a443e2a1d9 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:36:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3c840ca8-ff2d-4e7b-af9a-26bcc3a0f9f9 tempest-VolumesCloneNegativeTest-836242236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:36:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3c840ca8-ff2d-4e7b-af9a-26bcc3a0f9f9 tempest-VolumesCloneNegativeTest-836242236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:36:52 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3c840ca8-ff2d-4e7b-af9a-26bcc3a0f9f9 tempest-VolumesCloneNegativeTest-836242236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:36:52 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3c840ca8-ff2d-4e7b-af9a-26bcc3a0f9f9 tempest-VolumesCloneNegativeTest-836242236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:36:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3c840ca8-ff2d-4e7b-af9a-26bcc3a0f9f9 tempest-VolumesCloneNegativeTest-836242236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:36:52 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3c840ca8-ff2d-4e7b-af9a-26bcc3a0f9f9 tempest-VolumesCloneNegativeTest-836242236 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:36:52 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-3c840ca8-ff2d-4e7b-af9a-26bcc3a0f9f9 tempest-VolumesCloneNegativeTest-836242236 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:36:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3c840ca8-ff2d-4e7b-af9a-26bcc3a0f9f9 tempest-VolumesCloneNegativeTest-836242236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-dc3a1c5d-4f93-49d1-8591-23a443e2a1d9 2147483648 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:36:52 devstack sudo[94130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-dc3a1c5d-4f93-49d1-8591-23a443e2a1d9 2147483648
Jul 09 14:36:52 devstack sudo[94130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:36:53 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa1ba0cf-554f-48fd-8b3b-c96891c42d89 tempest-AttachVolumeNegativeTest-594851243 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:36:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-aa1ba0cf-554f-48fd-8b3b-c96891c42d89 tempest-AttachVolumeNegativeTest-594851243 None] Flow 'volume_create_manager' (bd4364b9-bf8c-44fb-b2d9-42970663272b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:36:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-aa1ba0cf-554f-48fd-8b3b-c96891c42d89 tempest-AttachVolumeNegativeTest-594851243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50a20722-cd4f-4fbe-bce3-433a9d83a357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:36:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-aa1ba0cf-554f-48fd-8b3b-c96891c42d89 tempest-AttachVolumeNegativeTest-594851243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50a20722-cd4f-4fbe-bce3-433a9d83a357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:36:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1822040727',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3701af68-1b86-4d1e-8707-f041d34d5c14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e12f6e1be054416827515b9bb0da885',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:36:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:36:53Z,use_quota=True,user_id='9c9a26714c9349c2b8e073697960118b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:36:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-aa1ba0cf-554f-48fd-8b3b-c96891c42d89 tempest-AttachVolumeNegativeTest-594851243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (012f9737-41ea-4432-b3da-db21c2352130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:36:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-aa1ba0cf-554f-48fd-8b3b-c96891c42d89 tempest-AttachVolumeNegativeTest-594851243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (012f9737-41ea-4432-b3da-db21c2352130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:36:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-aa1ba0cf-554f-48fd-8b3b-c96891c42d89 tempest-AttachVolumeNegativeTest-594851243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2081b88-cb4e-4f34-b656-1e8713be346a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:36:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-aa1ba0cf-554f-48fd-8b3b-c96891c42d89 tempest-AttachVolumeNegativeTest-594851243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2081b88-cb4e-4f34-b656-1e8713be346a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3701af68-1b86-4d1e-8707-f041d34d5c14', 'volume_name': 'volume-3701af68-1b86-4d1e-8707-f041d34d5c14', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:36:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-aa1ba0cf-554f-48fd-8b3b-c96891c42d89 tempest-AttachVolumeNegativeTest-594851243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1b1d91c-61d0-42e8-be90-8903caba3670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:36:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-aa1ba0cf-554f-48fd-8b3b-c96891c42d89 tempest-AttachVolumeNegativeTest-594851243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1b1d91c-61d0-42e8-be90-8903caba3670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:36:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-aa1ba0cf-554f-48fd-8b3b-c96891c42d89 tempest-AttachVolumeNegativeTest-594851243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c563482-1db7-4899-90a8-edbc5022f744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:36:53 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-aa1ba0cf-554f-48fd-8b3b-c96891c42d89 tempest-AttachVolumeNegativeTest-594851243 None] Volume 3701af68-1b86-4d1e-8707-f041d34d5c14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3701af68-1b86-4d1e-8707-f041d34d5c14', 'volume_size': 1}
Jul 09 14:36:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-aa1ba0cf-554f-48fd-8b3b-c96891c42d89 tempest-AttachVolumeNegativeTest-594851243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:36:53 devstack sudo[94128]: pam_unix(sudo:session): session closed for user root
Jul 09 14:36:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.833s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:36:53 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:36:53 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Running periodic task VolumeManager._thread_info {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 14:36:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] thread count: 8 {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 09 14:36:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] thread info: [<_MainThread(MainThread, started 125388812103808)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125388713797504)>, <Thread(Thread-3 (stat_writer), started daemon 125388699995392)>, <Thread(Rabbit-heartbeat, started daemon 125388700522560)>, <Thread(Thread-5 (_runner), started daemon 125388698545216)>, <Thread(Thread-7 (_runner), started daemon 125388698611264)>, <Thread(fd_logger, started daemon 125388703020672)>, <Thread(privsep_reader, started daemon 125388696441088)>] {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 09 14:36:53 devstack sudo[94130]: pam_unix(sudo:session): session closed for user root
Jul 09 14:36:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3c840ca8-ff2d-4e7b-af9a-26bcc3a0f9f9 tempest-VolumesCloneNegativeTest-836242236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-dc3a1c5d-4f93-49d1-8591-23a443e2a1d9 2147483648" returned: 0 in 0.964s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:36:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3c840ca8-ff2d-4e7b-af9a-26bcc3a0f9f9 tempest-VolumesCloneNegativeTest-836242236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-dc3a1c5d-4f93-49d1-8591-23a443e2a1d9 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:36:53 devstack sudo[94137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-dc3a1c5d-4f93-49d1-8591-23a443e2a1d9
Jul 09 14:36:53 devstack sudo[94137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:36:54 devstack sudo[94137]: pam_unix(sudo:session): session closed for user root
Jul 09 14:36:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3c840ca8-ff2d-4e7b-af9a-26bcc3a0f9f9 tempest-VolumesCloneNegativeTest-836242236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-dc3a1c5d-4f93-49d1-8591-23a443e2a1d9" returned: 0 in 0.640s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:36:54 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3c840ca8-ff2d-4e7b-af9a-26bcc3a0f9f9 tempest-VolumesCloneNegativeTest-836242236 None] <== create_volume: return (1649ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:36:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3c840ca8-ff2d-4e7b-af9a-26bcc3a0f9f9 tempest-VolumesCloneNegativeTest-836242236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.652s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:36:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-aa1ba0cf-554f-48fd-8b3b-c96891c42d89 tempest-AttachVolumeNegativeTest-594851243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.996s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:36:54 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-aa1ba0cf-554f-48fd-8b3b-c96891c42d89 tempest-AttachVolumeNegativeTest-594851243 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:36:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1822040727',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3701af68-1b86-4d1e-8707-f041d34d5c14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e12f6e1be054416827515b9bb0da885',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:36:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:36:53Z,use_quota=True,user_id='9c9a26714c9349c2b8e073697960118b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:36:54 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-aa1ba0cf-554f-48fd-8b3b-c96891c42d89 tempest-AttachVolumeNegativeTest-594851243 None] Creating volume 3701af68-1b86-4d1e-8707-f041d34d5c14 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:36:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-aa1ba0cf-554f-48fd-8b3b-c96891c42d89 tempest-AttachVolumeNegativeTest-594851243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:36:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-aa1ba0cf-554f-48fd-8b3b-c96891c42d89 tempest-AttachVolumeNegativeTest-594851243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:36:54 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-aa1ba0cf-554f-48fd-8b3b-c96891c42d89 tempest-AttachVolumeNegativeTest-594851243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:36:54 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-aa1ba0cf-554f-48fd-8b3b-c96891c42d89 tempest-AttachVolumeNegativeTest-594851243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:36:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-aa1ba0cf-554f-48fd-8b3b-c96891c42d89 tempest-AttachVolumeNegativeTest-594851243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:36:54 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-aa1ba0cf-554f-48fd-8b3b-c96891c42d89 tempest-AttachVolumeNegativeTest-594851243 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:36:54 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-aa1ba0cf-554f-48fd-8b3b-c96891c42d89 tempest-AttachVolumeNegativeTest-594851243 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:36:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-aa1ba0cf-554f-48fd-8b3b-c96891c42d89 tempest-AttachVolumeNegativeTest-594851243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-3701af68-1b86-4d1e-8707-f041d34d5c14 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:36:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3c840ca8-ff2d-4e7b-af9a-26bcc3a0f9f9 tempest-VolumesCloneNegativeTest-836242236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6947ade-31a4-4ccf-b5e9-ed3e7f2682ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc3a1c5d-4f93-49d1-8591-23a443e2a1d9', 'volume_size': 2}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:36:54 devstack sudo[94140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-3701af68-1b86-4d1e-8707-f041d34d5c14 1073741824
Jul 09 14:36:54 devstack sudo[94140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:36:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3c840ca8-ff2d-4e7b-af9a-26bcc3a0f9f9 tempest-VolumesCloneNegativeTest-836242236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7781972-8b90-488b-8701-6d20211f6f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:36:54 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-3c840ca8-ff2d-4e7b-af9a-26bcc3a0f9f9 tempest-VolumesCloneNegativeTest-836242236 None] Volume volume-dc3a1c5d-4f93-49d1-8591-23a443e2a1d9 (dc3a1c5d-4f93-49d1-8591-23a443e2a1d9): created successfully
Jul 09 14:36:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3c840ca8-ff2d-4e7b-af9a-26bcc3a0f9f9 tempest-VolumesCloneNegativeTest-836242236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7781972-8b90-488b-8701-6d20211f6f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:36:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3c840ca8-ff2d-4e7b-af9a-26bcc3a0f9f9 tempest-VolumesCloneNegativeTest-836242236 None] Flow 'volume_create_manager' (eb951425-83e7-4701-a6b8-91600124bbf0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:36:54 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-3c840ca8-ff2d-4e7b-af9a-26bcc3a0f9f9 tempest-VolumesCloneNegativeTest-836242236 None] Created volume successfully.
Jul 09 14:36:54 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-cb37637d-c400-44e4-a4ea-1b012dc87e03 tempest-VolumesCloneNegativeTest-836242236 None] Acquiring lock "cinder-dc3a1c5d-4f93-49d1-8591-23a443e2a1d9-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:36:54 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-cb37637d-c400-44e4-a4ea-1b012dc87e03 tempest-VolumesCloneNegativeTest-836242236 None] Lock "cinder-dc3a1c5d-4f93-49d1-8591-23a443e2a1d9-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:36:54 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-cb37637d-c400-44e4-a4ea-1b012dc87e03 tempest-VolumesCloneNegativeTest-836242236 None] Acquiring lock "cinder-quobyte-dc3a1c5d-4f93-49d1-8591-23a443e2a1d9" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:36:54 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-cb37637d-c400-44e4-a4ea-1b012dc87e03 tempest-VolumesCloneNegativeTest-836242236 None] Lock "cinder-quobyte-dc3a1c5d-4f93-49d1-8591-23a443e2a1d9" acquired by "delete_volume" :: waited 0.015s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:36:54 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d30a0c5-6c36-4498-8c3d-5811ba8ecc57]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:36:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-cb37637d-c400-44e4-a4ea-1b012dc87e03 tempest-VolumesCloneNegativeTest-836242236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-dc3a1c5d-4f93-49d1-8591-23a443e2a1d9 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:36:54 devstack sudo[94148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-dc3a1c5d-4f93-49d1-8591-23a443e2a1d9
Jul 09 14:36:54 devstack sudo[94148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:36:54 devstack sudo[94140]: pam_unix(sudo:session): session closed for user root
Jul 09 14:36:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-aa1ba0cf-554f-48fd-8b3b-c96891c42d89 tempest-AttachVolumeNegativeTest-594851243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-3701af68-1b86-4d1e-8707-f041d34d5c14 1073741824" returned: 0 in 0.814s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:36:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-aa1ba0cf-554f-48fd-8b3b-c96891c42d89 tempest-AttachVolumeNegativeTest-594851243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-3701af68-1b86-4d1e-8707-f041d34d5c14 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:36:55 devstack sudo[94154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-3701af68-1b86-4d1e-8707-f041d34d5c14
Jul 09 14:36:55 devstack sudo[94154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:36:55 devstack sudo[94148]: pam_unix(sudo:session): session closed for user root
Jul 09 14:36:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-cb37637d-c400-44e4-a4ea-1b012dc87e03 tempest-VolumesCloneNegativeTest-836242236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-dc3a1c5d-4f93-49d1-8591-23a443e2a1d9" returned: 0 in 0.821s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:36:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-cb37637d-c400-44e4-a4ea-1b012dc87e03 tempest-VolumesCloneNegativeTest-836242236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-dc3a1c5d-4f93-49d1-8591-23a443e2a1d9 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:36:55 devstack sudo[94159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-dc3a1c5d-4f93-49d1-8591-23a443e2a1d9
Jul 09 14:36:55 devstack sudo[94159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:36:55 devstack sudo[94154]: pam_unix(sudo:session): session closed for user root
Jul 09 14:36:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-aa1ba0cf-554f-48fd-8b3b-c96891c42d89 tempest-AttachVolumeNegativeTest-594851243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-3701af68-1b86-4d1e-8707-f041d34d5c14" returned: 0 in 0.696s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:36:55 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-aa1ba0cf-554f-48fd-8b3b-c96891c42d89 tempest-AttachVolumeNegativeTest-594851243 None] <== create_volume: return (1565ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:36:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-aa1ba0cf-554f-48fd-8b3b-c96891c42d89 tempest-AttachVolumeNegativeTest-594851243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.569s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:36:55 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-aa1ba0cf-554f-48fd-8b3b-c96891c42d89 tempest-AttachVolumeNegativeTest-594851243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c563482-1db7-4899-90a8-edbc5022f744) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3701af68-1b86-4d1e-8707-f041d34d5c14', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:36:55 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-aa1ba0cf-554f-48fd-8b3b-c96891c42d89 tempest-AttachVolumeNegativeTest-594851243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b59d920-f19b-44e9-9281-e62216490da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:36:55 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-aa1ba0cf-554f-48fd-8b3b-c96891c42d89 tempest-AttachVolumeNegativeTest-594851243 None] Volume volume-3701af68-1b86-4d1e-8707-f041d34d5c14 (3701af68-1b86-4d1e-8707-f041d34d5c14): created successfully
Jul 09 14:36:55 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-aa1ba0cf-554f-48fd-8b3b-c96891c42d89 tempest-AttachVolumeNegativeTest-594851243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b59d920-f19b-44e9-9281-e62216490da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:36:55 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-aa1ba0cf-554f-48fd-8b3b-c96891c42d89 tempest-AttachVolumeNegativeTest-594851243 None] Flow 'volume_create_manager' (bd4364b9-bf8c-44fb-b2d9-42970663272b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:36:55 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-aa1ba0cf-554f-48fd-8b3b-c96891c42d89 tempest-AttachVolumeNegativeTest-594851243 None] Created volume successfully.
Jul 09 14:36:56 devstack sudo[94159]: pam_unix(sudo:session): session closed for user root
Jul 09 14:36:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-cb37637d-c400-44e4-a4ea-1b012dc87e03 tempest-VolumesCloneNegativeTest-836242236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-dc3a1c5d-4f93-49d1-8591-23a443e2a1d9" returned: 0 in 0.641s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:36:56 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-cb37637d-c400-44e4-a4ea-1b012dc87e03 tempest-VolumesCloneNegativeTest-836242236 None] Lock "cinder-quobyte-dc3a1c5d-4f93-49d1-8591-23a443e2a1d9" released by "delete_volume" :: held 1.512s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:36:56 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-cb37637d-c400-44e4-a4ea-1b012dc87e03 tempest-VolumesCloneNegativeTest-836242236 None] Created reservations ['da446b1c-965e-4023-96f4-3b378dddb92e', '1059486c-f823-475d-97da-967e154f28fd', '8b57d608-57e1-4e14-b0c4-d65dc2973454', 'ed8f3e54-bdb0-439c-a091-50937e36f8bc'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:36:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-cb37637d-c400-44e4-a4ea-1b012dc87e03 tempest-VolumesCloneNegativeTest-836242236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:36:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-cb37637d-c400-44e4-a4ea-1b012dc87e03 tempest-VolumesCloneNegativeTest-836242236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:36:56 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-cb37637d-c400-44e4-a4ea-1b012dc87e03 tempest-VolumesCloneNegativeTest-836242236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:36:56 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-cb37637d-c400-44e4-a4ea-1b012dc87e03 tempest-VolumesCloneNegativeTest-836242236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:36:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-cb37637d-c400-44e4-a4ea-1b012dc87e03 tempest-VolumesCloneNegativeTest-836242236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:36:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-cb37637d-c400-44e4-a4ea-1b012dc87e03 tempest-VolumesCloneNegativeTest-836242236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:36:56 devstack sudo[94165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:36:56 devstack sudo[94165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:36:56 devstack sudo[94165]: pam_unix(sudo:session): session closed for user root
Jul 09 14:36:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-cb37637d-c400-44e4-a4ea-1b012dc87e03 tempest-VolumesCloneNegativeTest-836242236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.675s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:36:56 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-cb37637d-c400-44e4-a4ea-1b012dc87e03 tempest-VolumesCloneNegativeTest-836242236 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:36:56 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-cb37637d-c400-44e4-a4ea-1b012dc87e03 tempest-VolumesCloneNegativeTest-836242236 None] Deleted volume successfully.
Jul 09 14:36:56 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-cb37637d-c400-44e4-a4ea-1b012dc87e03 tempest-VolumesCloneNegativeTest-836242236 None] Lock "cinder-dc3a1c5d-4f93-49d1-8591-23a443e2a1d9-delete_volume" released by "delete_volume" :: held 2.427s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:36:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-bba8d343-4024-4cb2-865a-9780e53d87e2 req-ced25333-3be6-4fe2-8446-33463b15803c tempest-AttachVolumeNegativeTest-594851243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:36:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-bba8d343-4024-4cb2-865a-9780e53d87e2 req-ced25333-3be6-4fe2-8446-33463b15803c tempest-AttachVolumeNegativeTest-594851243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:36:59 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[1193f8b9-df3b-4491-adf6-4c6b65cd17ca]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:36:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-bba8d343-4024-4cb2-865a-9780e53d87e2 req-ced25333-3be6-4fe2-8446-33463b15803c tempest-AttachVolumeNegativeTest-594851243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-3701af68-1b86-4d1e-8707-f041d34d5c14 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:36:59 devstack sudo[94179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-3701af68-1b86-4d1e-8707-f041d34d5c14
Jul 09 14:36:59 devstack sudo[94179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:36:59 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-59f347d4-1497-4a49-8040-0631b132ba83 tempest-VolumesNegativeTest-960260932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:36:59 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-59f347d4-1497-4a49-8040-0631b132ba83 tempest-VolumesNegativeTest-960260932 None] Flow 'volume_create_manager' (cf60b32d-291e-4a6a-a0a7-b7a3233a1b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:36:59 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-59f347d4-1497-4a49-8040-0631b132ba83 tempest-VolumesNegativeTest-960260932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (167bd107-519c-4625-a56c-c84a3bc1e917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:36:59 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-59f347d4-1497-4a49-8040-0631b132ba83 tempest-VolumesNegativeTest-960260932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (167bd107-519c-4625-a56c-c84a3bc1e917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:36:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1839785755',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eeaeec51-9e16-4f83-b20c-a87189ad8c3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cab430a03194c60804ff621f65b84de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:37:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:37:00Z,use_quota=True,user_id='fade171bd1894ab180e73919c755bdc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:36:59 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-59f347d4-1497-4a49-8040-0631b132ba83 tempest-VolumesNegativeTest-960260932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6fea7d2-f344-4e5e-92aa-f5fbd93406ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:36:59 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-59f347d4-1497-4a49-8040-0631b132ba83 tempest-VolumesNegativeTest-960260932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6fea7d2-f344-4e5e-92aa-f5fbd93406ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:36:59 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-59f347d4-1497-4a49-8040-0631b132ba83 tempest-VolumesNegativeTest-960260932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba322c77-fbbf-4fe1-a423-33439d848768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:36:59 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-59f347d4-1497-4a49-8040-0631b132ba83 tempest-VolumesNegativeTest-960260932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba322c77-fbbf-4fe1-a423-33439d848768) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eeaeec51-9e16-4f83-b20c-a87189ad8c3b', 'volume_name': 'volume-eeaeec51-9e16-4f83-b20c-a87189ad8c3b', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:36:59 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-59f347d4-1497-4a49-8040-0631b132ba83 tempest-VolumesNegativeTest-960260932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abaf893a-9858-4641-ab27-6dcdb53c5285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:36:59 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-59f347d4-1497-4a49-8040-0631b132ba83 tempest-VolumesNegativeTest-960260932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abaf893a-9858-4641-ab27-6dcdb53c5285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:36:59 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-59f347d4-1497-4a49-8040-0631b132ba83 tempest-VolumesNegativeTest-960260932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9e98afc-732d-426b-bc23-489ca30e5d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:36:59 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-59f347d4-1497-4a49-8040-0631b132ba83 tempest-VolumesNegativeTest-960260932 None] Volume eeaeec51-9e16-4f83-b20c-a87189ad8c3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eeaeec51-9e16-4f83-b20c-a87189ad8c3b', 'volume_size': 1}
Jul 09 14:36:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-59f347d4-1497-4a49-8040-0631b132ba83 tempest-VolumesNegativeTest-960260932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:37:00 devstack sudo[94179]: pam_unix(sudo:session): session closed for user root
Jul 09 14:37:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-bba8d343-4024-4cb2-865a-9780e53d87e2 req-ced25333-3be6-4fe2-8446-33463b15803c tempest-AttachVolumeNegativeTest-594851243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-3701af68-1b86-4d1e-8707-f041d34d5c14" returned: 0 in 0.894s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:37:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-bba8d343-4024-4cb2-865a-9780e53d87e2 req-ced25333-3be6-4fe2-8446-33463b15803c tempest-AttachVolumeNegativeTest-594851243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.914s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:37:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-59f347d4-1497-4a49-8040-0631b132ba83 tempest-VolumesNegativeTest-960260932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.272s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:37:00 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-59f347d4-1497-4a49-8040-0631b132ba83 tempest-VolumesNegativeTest-960260932 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:36:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1839785755',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eeaeec51-9e16-4f83-b20c-a87189ad8c3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cab430a03194c60804ff621f65b84de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:37:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:37:00Z,use_quota=True,user_id='fade171bd1894ab180e73919c755bdc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:37:00 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-59f347d4-1497-4a49-8040-0631b132ba83 tempest-VolumesNegativeTest-960260932 None] Creating volume eeaeec51-9e16-4f83-b20c-a87189ad8c3b {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:37:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-59f347d4-1497-4a49-8040-0631b132ba83 tempest-VolumesNegativeTest-960260932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:37:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-59f347d4-1497-4a49-8040-0631b132ba83 tempest-VolumesNegativeTest-960260932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:37:00 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-59f347d4-1497-4a49-8040-0631b132ba83 tempest-VolumesNegativeTest-960260932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:37:00 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-59f347d4-1497-4a49-8040-0631b132ba83 tempest-VolumesNegativeTest-960260932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:37:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-59f347d4-1497-4a49-8040-0631b132ba83 tempest-VolumesNegativeTest-960260932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:37:00 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-59f347d4-1497-4a49-8040-0631b132ba83 tempest-VolumesNegativeTest-960260932 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:37:00 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-59f347d4-1497-4a49-8040-0631b132ba83 tempest-VolumesNegativeTest-960260932 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:37:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-59f347d4-1497-4a49-8040-0631b132ba83 tempest-VolumesNegativeTest-960260932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-eeaeec51-9e16-4f83-b20c-a87189ad8c3b 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:37:00 devstack sudo[94186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-eeaeec51-9e16-4f83-b20c-a87189ad8c3b 1073741824
Jul 09 14:37:00 devstack sudo[94186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:37:00 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-bba8d343-4024-4cb2-865a-9780e53d87e2 req-ced25333-3be6-4fe2-8446-33463b15803c tempest-AttachVolumeNegativeTest-594851243 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653', 'name': 'volume-3701af68-1b86-4d1e-8707-f041d34d5c14', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1a9d69e2-fb69-4d03-9012-3439e8354586', 'enforce_multipath': True} {{(pid=87230) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 09 14:37:00 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-bba8d343-4024-4cb2-865a-9780e53d87e2 req-ced25333-3be6-4fe2-8446-33463b15803c tempest-AttachVolumeNegativeTest-594851243 None] attachment_update completed successfully.
Jul 09 14:37:01 devstack sudo[94186]: pam_unix(sudo:session): session closed for user root
Jul 09 14:37:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-59f347d4-1497-4a49-8040-0631b132ba83 tempest-VolumesNegativeTest-960260932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-eeaeec51-9e16-4f83-b20c-a87189ad8c3b 1073741824" returned: 0 in 0.960s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:37:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-59f347d4-1497-4a49-8040-0631b132ba83 tempest-VolumesNegativeTest-960260932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-eeaeec51-9e16-4f83-b20c-a87189ad8c3b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:37:01 devstack sudo[94194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-eeaeec51-9e16-4f83-b20c-a87189ad8c3b
Jul 09 14:37:01 devstack sudo[94194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:37:01 devstack sudo[94194]: pam_unix(sudo:session): session closed for user root
Jul 09 14:37:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-59f347d4-1497-4a49-8040-0631b132ba83 tempest-VolumesNegativeTest-960260932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-eeaeec51-9e16-4f83-b20c-a87189ad8c3b" returned: 0 in 0.721s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:37:01 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-59f347d4-1497-4a49-8040-0631b132ba83 tempest-VolumesNegativeTest-960260932 None] <== create_volume: return (1730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:37:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-59f347d4-1497-4a49-8040-0631b132ba83 tempest-VolumesNegativeTest-960260932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.733s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:37:01 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-59f347d4-1497-4a49-8040-0631b132ba83 tempest-VolumesNegativeTest-960260932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9e98afc-732d-426b-bc23-489ca30e5d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eeaeec51-9e16-4f83-b20c-a87189ad8c3b', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:37:01 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-59f347d4-1497-4a49-8040-0631b132ba83 tempest-VolumesNegativeTest-960260932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94a723bb-bbbe-499a-a778-8061f9c25efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:37:01 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-59f347d4-1497-4a49-8040-0631b132ba83 tempest-VolumesNegativeTest-960260932 None] Volume volume-eeaeec51-9e16-4f83-b20c-a87189ad8c3b (eeaeec51-9e16-4f83-b20c-a87189ad8c3b): created successfully
Jul 09 14:37:01 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-59f347d4-1497-4a49-8040-0631b132ba83 tempest-VolumesNegativeTest-960260932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94a723bb-bbbe-499a-a778-8061f9c25efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:37:01 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-59f347d4-1497-4a49-8040-0631b132ba83 tempest-VolumesNegativeTest-960260932 None] Flow 'volume_create_manager' (cf60b32d-291e-4a6a-a0a7-b7a3233a1b9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:37:01 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-59f347d4-1497-4a49-8040-0631b132ba83 tempest-VolumesNegativeTest-960260932 None] Created volume successfully.
Jul 09 14:37:02 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-a22cdc09-ec4b-4c66-9637-c60961d28539 req-aeac497a-f7b0-4754-b1de-2511af0c982e tempest-AttachVolumeTestJSON-1021532728 None] Terminate volume connection completed successfully.
Jul 09 14:37:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-a22cdc09-ec4b-4c66-9637-c60961d28539 req-aeac497a-f7b0-4754-b1de-2511af0c982e tempest-AttachVolumeTestJSON-1021532728 None] Deleting attachment 088d0194-024d-4b3d-a1d1-3687b9f8d9ee. {{(pid=87230) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 09 14:37:02 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-05ec2244-2d7b-49af-9438-d9f6288ebc0e tempest-ServerActionsTestOtherA-318969881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:37:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-05ec2244-2d7b-49af-9438-d9f6288ebc0e tempest-ServerActionsTestOtherA-318969881 None] Flow 'volume_create_manager' (1d35b277-5545-4bda-81fe-79367043cec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:37:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-05ec2244-2d7b-49af-9438-d9f6288ebc0e tempest-ServerActionsTestOtherA-318969881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22c7ee38-69c2-4b30-8b3f-8e66af321370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:37:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-05ec2244-2d7b-49af-9438-d9f6288ebc0e tempest-ServerActionsTestOtherA-318969881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22c7ee38-69c2-4b30-8b3f-8e66af321370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:37:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-451297099',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a425af93-c49d-46e6-95cc-6240c1ec5f43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf833f588707444bb90a8ac2ee421641',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:37:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:37:02Z,use_quota=True,user_id='b71a1133a5aa486a8fb4ddbe1de9e931',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:37:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-05ec2244-2d7b-49af-9438-d9f6288ebc0e tempest-ServerActionsTestOtherA-318969881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdd66369-9c0d-442c-91a2-ff1609f8ace6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:37:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-05ec2244-2d7b-49af-9438-d9f6288ebc0e tempest-ServerActionsTestOtherA-318969881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdd66369-9c0d-442c-91a2-ff1609f8ace6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:37:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-05ec2244-2d7b-49af-9438-d9f6288ebc0e tempest-ServerActionsTestOtherA-318969881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (762225ce-d1d5-4ab5-8ead-b978a21f38f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:37:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-05ec2244-2d7b-49af-9438-d9f6288ebc0e tempest-ServerActionsTestOtherA-318969881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (762225ce-d1d5-4ab5-8ead-b978a21f38f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a425af93-c49d-46e6-95cc-6240c1ec5f43', 'volume_name': 'volume-a425af93-c49d-46e6-95cc-6240c1ec5f43', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:37:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-05ec2244-2d7b-49af-9438-d9f6288ebc0e tempest-ServerActionsTestOtherA-318969881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5abbf57-dd8b-40e0-8b84-88e4700f2547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:37:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-05ec2244-2d7b-49af-9438-d9f6288ebc0e tempest-ServerActionsTestOtherA-318969881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5abbf57-dd8b-40e0-8b84-88e4700f2547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:37:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-05ec2244-2d7b-49af-9438-d9f6288ebc0e tempest-ServerActionsTestOtherA-318969881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d7bce09-2848-4969-9740-752babf27e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:37:02 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-05ec2244-2d7b-49af-9438-d9f6288ebc0e tempest-ServerActionsTestOtherA-318969881 None] Volume a425af93-c49d-46e6-95cc-6240c1ec5f43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a425af93-c49d-46e6-95cc-6240c1ec5f43', 'volume_size': 1}
Jul 09 14:37:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-05ec2244-2d7b-49af-9438-d9f6288ebc0e tempest-ServerActionsTestOtherA-318969881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:37:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-05ec2244-2d7b-49af-9438-d9f6288ebc0e tempest-ServerActionsTestOtherA-318969881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:37:02 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-05ec2244-2d7b-49af-9438-d9f6288ebc0e tempest-ServerActionsTestOtherA-318969881 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:37:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-451297099',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a425af93-c49d-46e6-95cc-6240c1ec5f43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf833f588707444bb90a8ac2ee421641',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:37:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:37:02Z,use_quota=True,user_id='b71a1133a5aa486a8fb4ddbe1de9e931',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:37:02 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-05ec2244-2d7b-49af-9438-d9f6288ebc0e tempest-ServerActionsTestOtherA-318969881 None] Creating volume a425af93-c49d-46e6-95cc-6240c1ec5f43 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:37:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-05ec2244-2d7b-49af-9438-d9f6288ebc0e tempest-ServerActionsTestOtherA-318969881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:37:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-05ec2244-2d7b-49af-9438-d9f6288ebc0e tempest-ServerActionsTestOtherA-318969881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:37:02 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-05ec2244-2d7b-49af-9438-d9f6288ebc0e tempest-ServerActionsTestOtherA-318969881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:37:02 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-05ec2244-2d7b-49af-9438-d9f6288ebc0e tempest-ServerActionsTestOtherA-318969881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:37:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-05ec2244-2d7b-49af-9438-d9f6288ebc0e tempest-ServerActionsTestOtherA-318969881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:37:02 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-05ec2244-2d7b-49af-9438-d9f6288ebc0e tempest-ServerActionsTestOtherA-318969881 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:37:02 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-05ec2244-2d7b-49af-9438-d9f6288ebc0e tempest-ServerActionsTestOtherA-318969881 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:37:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-05ec2244-2d7b-49af-9438-d9f6288ebc0e tempest-ServerActionsTestOtherA-318969881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a425af93-c49d-46e6-95cc-6240c1ec5f43 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:37:02 devstack sudo[94204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a425af93-c49d-46e6-95cc-6240c1ec5f43 1073741824
Jul 09 14:37:02 devstack sudo[94204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:37:03 devstack sudo[94204]: pam_unix(sudo:session): session closed for user root
Jul 09 14:37:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-05ec2244-2d7b-49af-9438-d9f6288ebc0e tempest-ServerActionsTestOtherA-318969881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a425af93-c49d-46e6-95cc-6240c1ec5f43 1073741824" returned: 0 in 1.113s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:37:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-05ec2244-2d7b-49af-9438-d9f6288ebc0e tempest-ServerActionsTestOtherA-318969881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a425af93-c49d-46e6-95cc-6240c1ec5f43 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:37:03 devstack sudo[94215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a425af93-c49d-46e6-95cc-6240c1ec5f43
Jul 09 14:37:03 devstack sudo[94215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:37:04 devstack sudo[94215]: pam_unix(sudo:session): session closed for user root
Jul 09 14:37:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-05ec2244-2d7b-49af-9438-d9f6288ebc0e tempest-ServerActionsTestOtherA-318969881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a425af93-c49d-46e6-95cc-6240c1ec5f43" returned: 0 in 0.789s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:37:04 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-05ec2244-2d7b-49af-9438-d9f6288ebc0e tempest-ServerActionsTestOtherA-318969881 None] <== create_volume: return (1965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:37:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-05ec2244-2d7b-49af-9438-d9f6288ebc0e tempest-ServerActionsTestOtherA-318969881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.967s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:37:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-05ec2244-2d7b-49af-9438-d9f6288ebc0e tempest-ServerActionsTestOtherA-318969881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d7bce09-2848-4969-9740-752babf27e01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a425af93-c49d-46e6-95cc-6240c1ec5f43', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:37:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-05ec2244-2d7b-49af-9438-d9f6288ebc0e tempest-ServerActionsTestOtherA-318969881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9e695bb-e05a-4e90-84b9-f41b217626ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:37:04 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-05ec2244-2d7b-49af-9438-d9f6288ebc0e tempest-ServerActionsTestOtherA-318969881 None] Volume volume-a425af93-c49d-46e6-95cc-6240c1ec5f43 (a425af93-c49d-46e6-95cc-6240c1ec5f43): created successfully
Jul 09 14:37:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-05ec2244-2d7b-49af-9438-d9f6288ebc0e tempest-ServerActionsTestOtherA-318969881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9e695bb-e05a-4e90-84b9-f41b217626ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:37:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-05ec2244-2d7b-49af-9438-d9f6288ebc0e tempest-ServerActionsTestOtherA-318969881 None] Flow 'volume_create_manager' (1d35b277-5545-4bda-81fe-79367043cec5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:37:04 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-05ec2244-2d7b-49af-9438-d9f6288ebc0e tempest-ServerActionsTestOtherA-318969881 None] Created volume successfully.
Jul 09 14:37:06 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-bda00c8d-9eb7-44dc-968e-c5e8565a6c9d req-a033fe57-5d33-4978-b5f1-9f5f5259a966 tempest-AttachVolumeNegativeTest-594851243 None] Terminate volume connection completed successfully.
Jul 09 14:37:06 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-bda00c8d-9eb7-44dc-968e-c5e8565a6c9d req-a033fe57-5d33-4978-b5f1-9f5f5259a966 tempest-AttachVolumeNegativeTest-594851243 None] Deleting attachment 1a9d69e2-fb69-4d03-9012-3439e8354586. {{(pid=87230) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 09 14:37:16 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=52,cinder:INSERT=18,cinder:UPDATE=61,cinder:DELETE=7 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 14:37:16 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:UPDATE=63,cinder:SELECT=49,cinder:INSERT=11,cinder:DELETE=4 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 14:37:20 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b4a10b34-5f13-4568-baf3-812427a78339 tempest-AttachVolumeNegativeTest-594851243 None] Acquiring lock "cinder-3701af68-1b86-4d1e-8707-f041d34d5c14-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:37:20 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b4a10b34-5f13-4568-baf3-812427a78339 tempest-AttachVolumeNegativeTest-594851243 None] Lock "cinder-3701af68-1b86-4d1e-8707-f041d34d5c14-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:37:20 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b4a10b34-5f13-4568-baf3-812427a78339 tempest-AttachVolumeNegativeTest-594851243 None] Acquiring lock "cinder-quobyte-3701af68-1b86-4d1e-8707-f041d34d5c14" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:37:20 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b4a10b34-5f13-4568-baf3-812427a78339 tempest-AttachVolumeNegativeTest-594851243 None] Lock "cinder-quobyte-3701af68-1b86-4d1e-8707-f041d34d5c14" acquired by "delete_volume" :: waited 0.027s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:37:20 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[d789d914-2eed-4745-a72c-e8403305eb0d]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:37:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b4a10b34-5f13-4568-baf3-812427a78339 tempest-AttachVolumeNegativeTest-594851243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-3701af68-1b86-4d1e-8707-f041d34d5c14 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:37:20 devstack sudo[94492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-3701af68-1b86-4d1e-8707-f041d34d5c14
Jul 09 14:37:20 devstack sudo[94492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:37:21 devstack sudo[94492]: pam_unix(sudo:session): session closed for user root
Jul 09 14:37:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b4a10b34-5f13-4568-baf3-812427a78339 tempest-AttachVolumeNegativeTest-594851243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-3701af68-1b86-4d1e-8707-f041d34d5c14" returned: 0 in 1.045s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:37:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b4a10b34-5f13-4568-baf3-812427a78339 tempest-AttachVolumeNegativeTest-594851243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-3701af68-1b86-4d1e-8707-f041d34d5c14 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:37:21 devstack sudo[94501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-3701af68-1b86-4d1e-8707-f041d34d5c14
Jul 09 14:37:21 devstack sudo[94501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:37:22 devstack sudo[94501]: pam_unix(sudo:session): session closed for user root
Jul 09 14:37:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b4a10b34-5f13-4568-baf3-812427a78339 tempest-AttachVolumeNegativeTest-594851243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-3701af68-1b86-4d1e-8707-f041d34d5c14" returned: 0 in 1.171s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:37:22 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b4a10b34-5f13-4568-baf3-812427a78339 tempest-AttachVolumeNegativeTest-594851243 None] Lock "cinder-quobyte-3701af68-1b86-4d1e-8707-f041d34d5c14" released by "delete_volume" :: held 2.332s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:37:22 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-b4a10b34-5f13-4568-baf3-812427a78339 tempest-AttachVolumeNegativeTest-594851243 None] Created reservations ['d1791bcc-971c-4c1a-afd1-fb3397158072', 'ef2b9e67-61e0-476e-b249-fdbde45044bd', '87c22326-9160-41b5-ae44-63f755165f4b', 'b4e6d020-ce0c-4e7c-9b4a-0c446bbf0696'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:37:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b4a10b34-5f13-4568-baf3-812427a78339 tempest-AttachVolumeNegativeTest-594851243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:37:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b4a10b34-5f13-4568-baf3-812427a78339 tempest-AttachVolumeNegativeTest-594851243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:37:22 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b4a10b34-5f13-4568-baf3-812427a78339 tempest-AttachVolumeNegativeTest-594851243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:37:22 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b4a10b34-5f13-4568-baf3-812427a78339 tempest-AttachVolumeNegativeTest-594851243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:37:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b4a10b34-5f13-4568-baf3-812427a78339 tempest-AttachVolumeNegativeTest-594851243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:37:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b4a10b34-5f13-4568-baf3-812427a78339 tempest-AttachVolumeNegativeTest-594851243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:37:22 devstack sudo[94504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:37:22 devstack sudo[94504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:37:23 devstack sudo[94504]: pam_unix(sudo:session): session closed for user root
Jul 09 14:37:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b4a10b34-5f13-4568-baf3-812427a78339 tempest-AttachVolumeNegativeTest-594851243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 1.184s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:37:23 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-b4a10b34-5f13-4568-baf3-812427a78339 tempest-AttachVolumeNegativeTest-594851243 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:37:23 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-b4a10b34-5f13-4568-baf3-812427a78339 tempest-AttachVolumeNegativeTest-594851243 None] Deleted volume successfully.
Jul 09 14:37:24 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b4a10b34-5f13-4568-baf3-812427a78339 tempest-AttachVolumeNegativeTest-594851243 None] Lock "cinder-3701af68-1b86-4d1e-8707-f041d34d5c14-delete_volume" released by "delete_volume" :: held 3.911s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:37:24 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-120221d8-036f-40ce-a1ea-c52b458e4656 tempest-AttachVolumeNegativeTest-594851243 None] Acquiring lock "cinder-83f65cd0-4847-4f35-aafd-8542018a0561-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:37:24 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-120221d8-036f-40ce-a1ea-c52b458e4656 tempest-AttachVolumeNegativeTest-594851243 None] Lock "cinder-83f65cd0-4847-4f35-aafd-8542018a0561-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:37:24 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-120221d8-036f-40ce-a1ea-c52b458e4656 tempest-AttachVolumeNegativeTest-594851243 None] Acquiring lock "cinder-quobyte-83f65cd0-4847-4f35-aafd-8542018a0561" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:37:24 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-120221d8-036f-40ce-a1ea-c52b458e4656 tempest-AttachVolumeNegativeTest-594851243 None] Lock "cinder-quobyte-83f65cd0-4847-4f35-aafd-8542018a0561" acquired by "delete_volume" :: waited 0.048s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:37:24 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[da5015a7-17bf-44f2-a24b-c0be5437ef1a]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:37:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-120221d8-036f-40ce-a1ea-c52b458e4656 tempest-AttachVolumeNegativeTest-594851243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-83f65cd0-4847-4f35-aafd-8542018a0561 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:37:24 devstack sudo[94509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-83f65cd0-4847-4f35-aafd-8542018a0561
Jul 09 14:37:24 devstack sudo[94509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:37:25 devstack sudo[94509]: pam_unix(sudo:session): session closed for user root
Jul 09 14:37:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-120221d8-036f-40ce-a1ea-c52b458e4656 tempest-AttachVolumeNegativeTest-594851243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-83f65cd0-4847-4f35-aafd-8542018a0561" returned: 0 in 1.205s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:37:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-120221d8-036f-40ce-a1ea-c52b458e4656 tempest-AttachVolumeNegativeTest-594851243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-83f65cd0-4847-4f35-aafd-8542018a0561 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:37:25 devstack sudo[94521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-83f65cd0-4847-4f35-aafd-8542018a0561
Jul 09 14:37:25 devstack sudo[94521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:37:27 devstack sudo[94521]: pam_unix(sudo:session): session closed for user root
Jul 09 14:37:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-120221d8-036f-40ce-a1ea-c52b458e4656 tempest-AttachVolumeNegativeTest-594851243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-83f65cd0-4847-4f35-aafd-8542018a0561" returned: 0 in 1.620s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:37:27 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-120221d8-036f-40ce-a1ea-c52b458e4656 tempest-AttachVolumeNegativeTest-594851243 None] Lock "cinder-quobyte-83f65cd0-4847-4f35-aafd-8542018a0561" released by "delete_volume" :: held 2.955s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:37:27 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-120221d8-036f-40ce-a1ea-c52b458e4656 tempest-AttachVolumeNegativeTest-594851243 None] Created reservations ['5c501928-e316-4f1f-bc56-b05311ae27a1', '824c26d3-ecfc-42c7-ac39-fced01948690', '2e98cb7d-96a1-4e18-a590-dc92ae678852', '19b7c12e-4e16-4b81-aa3a-bf18e680d005'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:37:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-120221d8-036f-40ce-a1ea-c52b458e4656 tempest-AttachVolumeNegativeTest-594851243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:37:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-120221d8-036f-40ce-a1ea-c52b458e4656 tempest-AttachVolumeNegativeTest-594851243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:37:27 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-120221d8-036f-40ce-a1ea-c52b458e4656 tempest-AttachVolumeNegativeTest-594851243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:37:27 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-120221d8-036f-40ce-a1ea-c52b458e4656 tempest-AttachVolumeNegativeTest-594851243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:37:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-120221d8-036f-40ce-a1ea-c52b458e4656 tempest-AttachVolumeNegativeTest-594851243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:37:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-120221d8-036f-40ce-a1ea-c52b458e4656 tempest-AttachVolumeNegativeTest-594851243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:37:27 devstack sudo[94540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:37:27 devstack sudo[94540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:37:28 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d10cc3a7-1626-4af2-a1d6-d0e57ecc4f45 tempest-AttachVolumeNegativeTest-594851243 None] Acquiring lock "cinder-7468e7e6-2849-45eb-a656-10c997e948fc-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:37:28 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d10cc3a7-1626-4af2-a1d6-d0e57ecc4f45 tempest-AttachVolumeNegativeTest-594851243 None] Lock "cinder-7468e7e6-2849-45eb-a656-10c997e948fc-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:37:28 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d10cc3a7-1626-4af2-a1d6-d0e57ecc4f45 tempest-AttachVolumeNegativeTest-594851243 None] Acquiring lock "cinder-quobyte-7468e7e6-2849-45eb-a656-10c997e948fc" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:37:28 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d10cc3a7-1626-4af2-a1d6-d0e57ecc4f45 tempest-AttachVolumeNegativeTest-594851243 None] Lock "cinder-quobyte-7468e7e6-2849-45eb-a656-10c997e948fc" acquired by "delete_volume" :: waited 0.029s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:37:28 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba106100-b5a3-4dfc-b295-b5fb04e455d2]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:37:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d10cc3a7-1626-4af2-a1d6-d0e57ecc4f45 tempest-AttachVolumeNegativeTest-594851243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7468e7e6-2849-45eb-a656-10c997e948fc {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:37:28 devstack sudo[94544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7468e7e6-2849-45eb-a656-10c997e948fc
Jul 09 14:37:28 devstack sudo[94544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:37:28 devstack sudo[94540]: pam_unix(sudo:session): session closed for user root
Jul 09 14:37:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-120221d8-036f-40ce-a1ea-c52b458e4656 tempest-AttachVolumeNegativeTest-594851243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 1.235s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:37:28 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-120221d8-036f-40ce-a1ea-c52b458e4656 tempest-AttachVolumeNegativeTest-594851243 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:37:28 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-120221d8-036f-40ce-a1ea-c52b458e4656 tempest-AttachVolumeNegativeTest-594851243 None] Deleted volume successfully.
Jul 09 14:37:28 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-120221d8-036f-40ce-a1ea-c52b458e4656 tempest-AttachVolumeNegativeTest-594851243 None] Lock "cinder-83f65cd0-4847-4f35-aafd-8542018a0561-delete_volume" released by "delete_volume" :: held 4.656s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:37:29 devstack sudo[94544]: pam_unix(sudo:session): session closed for user root
Jul 09 14:37:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d10cc3a7-1626-4af2-a1d6-d0e57ecc4f45 tempest-AttachVolumeNegativeTest-594851243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7468e7e6-2849-45eb-a656-10c997e948fc" returned: 0 in 0.953s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:37:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d10cc3a7-1626-4af2-a1d6-d0e57ecc4f45 tempest-AttachVolumeNegativeTest-594851243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7468e7e6-2849-45eb-a656-10c997e948fc {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:37:29 devstack sudo[94550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7468e7e6-2849-45eb-a656-10c997e948fc
Jul 09 14:37:29 devstack sudo[94550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:37:30 devstack sudo[94550]: pam_unix(sudo:session): session closed for user root
Jul 09 14:37:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d10cc3a7-1626-4af2-a1d6-d0e57ecc4f45 tempest-AttachVolumeNegativeTest-594851243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7468e7e6-2849-45eb-a656-10c997e948fc" returned: 0 in 0.754s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:37:30 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d10cc3a7-1626-4af2-a1d6-d0e57ecc4f45 tempest-AttachVolumeNegativeTest-594851243 None] Lock "cinder-quobyte-7468e7e6-2849-45eb-a656-10c997e948fc" released by "delete_volume" :: held 1.769s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:37:30 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-d10cc3a7-1626-4af2-a1d6-d0e57ecc4f45 tempest-AttachVolumeNegativeTest-594851243 None] Created reservations ['ac84f3ae-80ba-45aa-88b1-72f9eaf4c0dc', '17b1ee4f-c86d-4cdc-9790-bf849bb352cf', '7165cf99-66c1-4a2c-b3f3-babbdef8dd07', '7a16423d-da9b-48e6-9040-9c071cf714ec'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:37:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d10cc3a7-1626-4af2-a1d6-d0e57ecc4f45 tempest-AttachVolumeNegativeTest-594851243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:37:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d10cc3a7-1626-4af2-a1d6-d0e57ecc4f45 tempest-AttachVolumeNegativeTest-594851243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:37:30 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-d10cc3a7-1626-4af2-a1d6-d0e57ecc4f45 tempest-AttachVolumeNegativeTest-594851243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:37:30 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-d10cc3a7-1626-4af2-a1d6-d0e57ecc4f45 tempest-AttachVolumeNegativeTest-594851243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:37:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d10cc3a7-1626-4af2-a1d6-d0e57ecc4f45 tempest-AttachVolumeNegativeTest-594851243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:37:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d10cc3a7-1626-4af2-a1d6-d0e57ecc4f45 tempest-AttachVolumeNegativeTest-594851243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:37:30 devstack sudo[94554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:37:30 devstack sudo[94554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:37:31 devstack sudo[94554]: pam_unix(sudo:session): session closed for user root
Jul 09 14:37:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d10cc3a7-1626-4af2-a1d6-d0e57ecc4f45 tempest-AttachVolumeNegativeTest-594851243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.862s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:37:31 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-d10cc3a7-1626-4af2-a1d6-d0e57ecc4f45 tempest-AttachVolumeNegativeTest-594851243 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:37:31 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-d10cc3a7-1626-4af2-a1d6-d0e57ecc4f45 tempest-AttachVolumeNegativeTest-594851243 None] Deleted volume successfully.
Jul 09 14:37:31 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d10cc3a7-1626-4af2-a1d6-d0e57ecc4f45 tempest-AttachVolumeNegativeTest-594851243 None] Lock "cinder-7468e7e6-2849-45eb-a656-10c997e948fc-delete_volume" released by "delete_volume" :: held 2.901s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:37:38 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [req-235d2630-27ca-45b7-986e-60ba103f8d29 req-e0e8f37e-5699-4f28-9055-cdb356de5e18 tempest-VolumesSnapshotsTestJSON-1506359695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:37:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-235d2630-27ca-45b7-986e-60ba103f8d29 req-e0e8f37e-5699-4f28-9055-cdb356de5e18 tempest-VolumesSnapshotsTestJSON-1506359695 None] Flow 'volume_create_manager' (a8bbff9f-418d-4017-a25f-3d3a2dbac43f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:37:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-235d2630-27ca-45b7-986e-60ba103f8d29 req-e0e8f37e-5699-4f28-9055-cdb356de5e18 tempest-VolumesSnapshotsTestJSON-1506359695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (097337c5-7931-467e-a4b4-23403cf5dbd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:37:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-235d2630-27ca-45b7-986e-60ba103f8d29 req-e0e8f37e-5699-4f28-9055-cdb356de5e18 tempest-VolumesSnapshotsTestJSON-1506359695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (097337c5-7931-467e-a4b4-23403cf5dbd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:37:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-772105544',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17e05982-4099-4058-bfac-0eeea5e43bae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b421c6690ff45a490b3f2949a9be290',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:37:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:37:39Z,use_quota=True,user_id='9eaadb2c2e254614aec9b7518b6da2f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:37:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-235d2630-27ca-45b7-986e-60ba103f8d29 req-e0e8f37e-5699-4f28-9055-cdb356de5e18 tempest-VolumesSnapshotsTestJSON-1506359695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21e2da6b-b746-4fb2-8402-8a9b9b36125e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:37:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-235d2630-27ca-45b7-986e-60ba103f8d29 req-e0e8f37e-5699-4f28-9055-cdb356de5e18 tempest-VolumesSnapshotsTestJSON-1506359695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21e2da6b-b746-4fb2-8402-8a9b9b36125e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:37:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-235d2630-27ca-45b7-986e-60ba103f8d29 req-e0e8f37e-5699-4f28-9055-cdb356de5e18 tempest-VolumesSnapshotsTestJSON-1506359695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4be5a72-fe0f-4053-98fd-9f62754f89b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:37:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-235d2630-27ca-45b7-986e-60ba103f8d29 req-e0e8f37e-5699-4f28-9055-cdb356de5e18 tempest-VolumesSnapshotsTestJSON-1506359695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4be5a72-fe0f-4053-98fd-9f62754f89b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17e05982-4099-4058-bfac-0eeea5e43bae', 'volume_name': 'volume-17e05982-4099-4058-bfac-0eeea5e43bae', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:37:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-235d2630-27ca-45b7-986e-60ba103f8d29 req-e0e8f37e-5699-4f28-9055-cdb356de5e18 tempest-VolumesSnapshotsTestJSON-1506359695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55c2a645-d556-4095-b646-212f86cc08ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:37:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-235d2630-27ca-45b7-986e-60ba103f8d29 req-e0e8f37e-5699-4f28-9055-cdb356de5e18 tempest-VolumesSnapshotsTestJSON-1506359695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55c2a645-d556-4095-b646-212f86cc08ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:37:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-235d2630-27ca-45b7-986e-60ba103f8d29 req-e0e8f37e-5699-4f28-9055-cdb356de5e18 tempest-VolumesSnapshotsTestJSON-1506359695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dad73435-54b1-41ae-9269-4eec14de67cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:37:38 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [req-235d2630-27ca-45b7-986e-60ba103f8d29 req-e0e8f37e-5699-4f28-9055-cdb356de5e18 tempest-VolumesSnapshotsTestJSON-1506359695 None] Volume 17e05982-4099-4058-bfac-0eeea5e43bae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17e05982-4099-4058-bfac-0eeea5e43bae', 'volume_size': 1}
Jul 09 14:37:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-235d2630-27ca-45b7-986e-60ba103f8d29 req-e0e8f37e-5699-4f28-9055-cdb356de5e18 tempest-VolumesSnapshotsTestJSON-1506359695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:37:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-235d2630-27ca-45b7-986e-60ba103f8d29 req-e0e8f37e-5699-4f28-9055-cdb356de5e18 tempest-VolumesSnapshotsTestJSON-1506359695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:37:38 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [req-235d2630-27ca-45b7-986e-60ba103f8d29 req-e0e8f37e-5699-4f28-9055-cdb356de5e18 tempest-VolumesSnapshotsTestJSON-1506359695 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:37:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-772105544',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17e05982-4099-4058-bfac-0eeea5e43bae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b421c6690ff45a490b3f2949a9be290',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:37:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:37:39Z,use_quota=True,user_id='9eaadb2c2e254614aec9b7518b6da2f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:37:38 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [req-235d2630-27ca-45b7-986e-60ba103f8d29 req-e0e8f37e-5699-4f28-9055-cdb356de5e18 tempest-VolumesSnapshotsTestJSON-1506359695 None] Creating volume 17e05982-4099-4058-bfac-0eeea5e43bae {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:37:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-235d2630-27ca-45b7-986e-60ba103f8d29 req-e0e8f37e-5699-4f28-9055-cdb356de5e18 tempest-VolumesSnapshotsTestJSON-1506359695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:37:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-235d2630-27ca-45b7-986e-60ba103f8d29 req-e0e8f37e-5699-4f28-9055-cdb356de5e18 tempest-VolumesSnapshotsTestJSON-1506359695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:37:38 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [req-235d2630-27ca-45b7-986e-60ba103f8d29 req-e0e8f37e-5699-4f28-9055-cdb356de5e18 tempest-VolumesSnapshotsTestJSON-1506359695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:37:38 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [req-235d2630-27ca-45b7-986e-60ba103f8d29 req-e0e8f37e-5699-4f28-9055-cdb356de5e18 tempest-VolumesSnapshotsTestJSON-1506359695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:37:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-235d2630-27ca-45b7-986e-60ba103f8d29 req-e0e8f37e-5699-4f28-9055-cdb356de5e18 tempest-VolumesSnapshotsTestJSON-1506359695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:37:38 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [req-235d2630-27ca-45b7-986e-60ba103f8d29 req-e0e8f37e-5699-4f28-9055-cdb356de5e18 tempest-VolumesSnapshotsTestJSON-1506359695 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:37:38 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [req-235d2630-27ca-45b7-986e-60ba103f8d29 req-e0e8f37e-5699-4f28-9055-cdb356de5e18 tempest-VolumesSnapshotsTestJSON-1506359695 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:37:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-235d2630-27ca-45b7-986e-60ba103f8d29 req-e0e8f37e-5699-4f28-9055-cdb356de5e18 tempest-VolumesSnapshotsTestJSON-1506359695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-17e05982-4099-4058-bfac-0eeea5e43bae 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:37:38 devstack sudo[94620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-17e05982-4099-4058-bfac-0eeea5e43bae 1073741824
Jul 09 14:37:38 devstack sudo[94620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:37:39 devstack sudo[94620]: pam_unix(sudo:session): session closed for user root
Jul 09 14:37:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-235d2630-27ca-45b7-986e-60ba103f8d29 req-e0e8f37e-5699-4f28-9055-cdb356de5e18 tempest-VolumesSnapshotsTestJSON-1506359695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-17e05982-4099-4058-bfac-0eeea5e43bae 1073741824" returned: 0 in 1.016s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:37:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-235d2630-27ca-45b7-986e-60ba103f8d29 req-e0e8f37e-5699-4f28-9055-cdb356de5e18 tempest-VolumesSnapshotsTestJSON-1506359695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-17e05982-4099-4058-bfac-0eeea5e43bae {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:37:40 devstack sudo[94627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-17e05982-4099-4058-bfac-0eeea5e43bae
Jul 09 14:37:40 devstack sudo[94627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:37:40 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-31293bd2-57fc-4db1-8187-677334da840a tempest-VolumesNegativeTest-960260932 None] Acquiring lock "cinder-eeaeec51-9e16-4f83-b20c-a87189ad8c3b-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:37:40 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-31293bd2-57fc-4db1-8187-677334da840a tempest-VolumesNegativeTest-960260932 None] Lock "cinder-eeaeec51-9e16-4f83-b20c-a87189ad8c3b-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:37:40 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-31293bd2-57fc-4db1-8187-677334da840a tempest-VolumesNegativeTest-960260932 None] Acquiring lock "cinder-quobyte-eeaeec51-9e16-4f83-b20c-a87189ad8c3b" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:37:40 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-31293bd2-57fc-4db1-8187-677334da840a tempest-VolumesNegativeTest-960260932 None] Lock "cinder-quobyte-eeaeec51-9e16-4f83-b20c-a87189ad8c3b" acquired by "delete_volume" :: waited 0.019s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:37:40 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[4464e9d8-98af-4420-b4c0-947baac26e5e]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:37:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-31293bd2-57fc-4db1-8187-677334da840a tempest-VolumesNegativeTest-960260932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-eeaeec51-9e16-4f83-b20c-a87189ad8c3b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:37:40 devstack sudo[94627]: pam_unix(sudo:session): session closed for user root
Jul 09 14:37:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-235d2630-27ca-45b7-986e-60ba103f8d29 req-e0e8f37e-5699-4f28-9055-cdb356de5e18 tempest-VolumesSnapshotsTestJSON-1506359695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-17e05982-4099-4058-bfac-0eeea5e43bae" returned: 0 in 0.730s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:37:40 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [req-235d2630-27ca-45b7-986e-60ba103f8d29 req-e0e8f37e-5699-4f28-9055-cdb356de5e18 tempest-VolumesSnapshotsTestJSON-1506359695 None] <== create_volume: return (1800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:37:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-235d2630-27ca-45b7-986e-60ba103f8d29 req-e0e8f37e-5699-4f28-9055-cdb356de5e18 tempest-VolumesSnapshotsTestJSON-1506359695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.802s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:37:40 devstack sudo[94632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-eeaeec51-9e16-4f83-b20c-a87189ad8c3b
Jul 09 14:37:40 devstack sudo[94632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:37:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-235d2630-27ca-45b7-986e-60ba103f8d29 req-e0e8f37e-5699-4f28-9055-cdb356de5e18 tempest-VolumesSnapshotsTestJSON-1506359695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dad73435-54b1-41ae-9269-4eec14de67cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17e05982-4099-4058-bfac-0eeea5e43bae', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:37:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-235d2630-27ca-45b7-986e-60ba103f8d29 req-e0e8f37e-5699-4f28-9055-cdb356de5e18 tempest-VolumesSnapshotsTestJSON-1506359695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e4bb894-b594-4732-a18d-376092f62579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:37:40 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [req-235d2630-27ca-45b7-986e-60ba103f8d29 req-e0e8f37e-5699-4f28-9055-cdb356de5e18 tempest-VolumesSnapshotsTestJSON-1506359695 None] Volume volume-17e05982-4099-4058-bfac-0eeea5e43bae (17e05982-4099-4058-bfac-0eeea5e43bae): created successfully
Jul 09 14:37:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-235d2630-27ca-45b7-986e-60ba103f8d29 req-e0e8f37e-5699-4f28-9055-cdb356de5e18 tempest-VolumesSnapshotsTestJSON-1506359695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e4bb894-b594-4732-a18d-376092f62579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:37:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-235d2630-27ca-45b7-986e-60ba103f8d29 req-e0e8f37e-5699-4f28-9055-cdb356de5e18 tempest-VolumesSnapshotsTestJSON-1506359695 None] Flow 'volume_create_manager' (a8bbff9f-418d-4017-a25f-3d3a2dbac43f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:37:40 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-235d2630-27ca-45b7-986e-60ba103f8d29 req-e0e8f37e-5699-4f28-9055-cdb356de5e18 tempest-VolumesSnapshotsTestJSON-1506359695 None] Created volume successfully.
Jul 09 14:37:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-5b99ab2e-8ff0-4603-bf52-3c22076a2467 req-e593982e-83f0-4aad-8ea2-98a917221426 tempest-VolumesSnapshotsTestJSON-1506359695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:37:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-5b99ab2e-8ff0-4603-bf52-3c22076a2467 req-e593982e-83f0-4aad-8ea2-98a917221426 tempest-VolumesSnapshotsTestJSON-1506359695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:37:41 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [req-5b99ab2e-8ff0-4603-bf52-3c22076a2467 req-e593982e-83f0-4aad-8ea2-98a917221426 tempest-VolumesSnapshotsTestJSON-1506359695 None] Creating offline snapshot 6dcaa0a6-6ef5-4eab-952e-235a818fcd4c of volume 17e05982-4099-4058-bfac-0eeea5e43bae {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 14:37:41 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[c76e95e2-1b39-4df0-95f7-d6f86e2ab204]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:37:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-5b99ab2e-8ff0-4603-bf52-3c22076a2467 req-e593982e-83f0-4aad-8ea2-98a917221426 tempest-VolumesSnapshotsTestJSON-1506359695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-17e05982-4099-4058-bfac-0eeea5e43bae {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:37:41 devstack sudo[94632]: pam_unix(sudo:session): session closed for user root
Jul 09 14:37:41 devstack sudo[94637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-17e05982-4099-4058-bfac-0eeea5e43bae
Jul 09 14:37:41 devstack sudo[94637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:37:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-31293bd2-57fc-4db1-8187-677334da840a tempest-VolumesNegativeTest-960260932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-eeaeec51-9e16-4f83-b20c-a87189ad8c3b" returned: 0 in 0.774s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:37:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-31293bd2-57fc-4db1-8187-677334da840a tempest-VolumesNegativeTest-960260932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-eeaeec51-9e16-4f83-b20c-a87189ad8c3b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:37:41 devstack sudo[94639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-eeaeec51-9e16-4f83-b20c-a87189ad8c3b
Jul 09 14:37:41 devstack sudo[94639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:37:42 devstack sudo[94639]: pam_unix(sudo:session): session closed for user root
Jul 09 14:37:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-31293bd2-57fc-4db1-8187-677334da840a tempest-VolumesNegativeTest-960260932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-eeaeec51-9e16-4f83-b20c-a87189ad8c3b" returned: 0 in 0.640s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:37:42 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-31293bd2-57fc-4db1-8187-677334da840a tempest-VolumesNegativeTest-960260932 None] Lock "cinder-quobyte-eeaeec51-9e16-4f83-b20c-a87189ad8c3b" released by "delete_volume" :: held 1.471s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:37:42 devstack sudo[94637]: pam_unix(sudo:session): session closed for user root
Jul 09 14:37:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-5b99ab2e-8ff0-4603-bf52-3c22076a2467 req-e593982e-83f0-4aad-8ea2-98a917221426 tempest-VolumesSnapshotsTestJSON-1506359695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-17e05982-4099-4058-bfac-0eeea5e43bae" returned: 0 in 0.807s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:37:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-5b99ab2e-8ff0-4603-bf52-3c22076a2467 req-e593982e-83f0-4aad-8ea2-98a917221426 tempest-VolumesSnapshotsTestJSON-1506359695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-17e05982-4099-4058-bfac-0eeea5e43bae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-17e05982-4099-4058-bfac-0eeea5e43bae.6dcaa0a6-6ef5-4eab-952e-235a818fcd4c 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:37:42 devstack sudo[94645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-17e05982-4099-4058-bfac-0eeea5e43bae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-17e05982-4099-4058-bfac-0eeea5e43bae.6dcaa0a6-6ef5-4eab-952e-235a818fcd4c 1G
Jul 09 14:37:42 devstack sudo[94645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:37:42 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-31293bd2-57fc-4db1-8187-677334da840a tempest-VolumesNegativeTest-960260932 None] Created reservations ['ecf01426-4dab-44e5-becb-e7b9254170e7', 'da98d45a-ad87-49ac-a091-73827151d439', 'c1e546c2-0eca-435b-870d-e9bcdbe81ffa', '0cbd0997-50ee-4d4d-87f7-9fe17f055d15'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:37:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-31293bd2-57fc-4db1-8187-677334da840a tempest-VolumesNegativeTest-960260932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:37:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-31293bd2-57fc-4db1-8187-677334da840a tempest-VolumesNegativeTest-960260932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:37:42 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-31293bd2-57fc-4db1-8187-677334da840a tempest-VolumesNegativeTest-960260932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:37:42 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-31293bd2-57fc-4db1-8187-677334da840a tempest-VolumesNegativeTest-960260932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:37:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-31293bd2-57fc-4db1-8187-677334da840a tempest-VolumesNegativeTest-960260932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:37:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-31293bd2-57fc-4db1-8187-677334da840a tempest-VolumesNegativeTest-960260932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:37:42 devstack sudo[94647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:37:42 devstack sudo[94647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:37:43 devstack sudo[94645]: pam_unix(sudo:session): session closed for user root
Jul 09 14:37:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-5b99ab2e-8ff0-4603-bf52-3c22076a2467 req-e593982e-83f0-4aad-8ea2-98a917221426 tempest-VolumesSnapshotsTestJSON-1506359695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-17e05982-4099-4058-bfac-0eeea5e43bae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-17e05982-4099-4058-bfac-0eeea5e43bae.6dcaa0a6-6ef5-4eab-952e-235a818fcd4c 1G" returned: 0 in 0.903s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:37:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-5b99ab2e-8ff0-4603-bf52-3c22076a2467 req-e593982e-83f0-4aad-8ea2-98a917221426 tempest-VolumesSnapshotsTestJSON-1506359695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17e05982-4099-4058-bfac-0eeea5e43bae -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-17e05982-4099-4058-bfac-0eeea5e43bae.6dcaa0a6-6ef5-4eab-952e-235a818fcd4c {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:37:43 devstack sudo[94647]: pam_unix(sudo:session): session closed for user root
Jul 09 14:37:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-31293bd2-57fc-4db1-8187-677334da840a tempest-VolumesNegativeTest-960260932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.798s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:37:43 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-31293bd2-57fc-4db1-8187-677334da840a tempest-VolumesNegativeTest-960260932 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:37:43 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-31293bd2-57fc-4db1-8187-677334da840a tempest-VolumesNegativeTest-960260932 None] Deleted volume successfully.
Jul 09 14:37:43 devstack sudo[94653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17e05982-4099-4058-bfac-0eeea5e43bae -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-17e05982-4099-4058-bfac-0eeea5e43bae.6dcaa0a6-6ef5-4eab-952e-235a818fcd4c
Jul 09 14:37:43 devstack sudo[94653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:37:43 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-31293bd2-57fc-4db1-8187-677334da840a tempest-VolumesNegativeTest-960260932 None] Lock "cinder-eeaeec51-9e16-4f83-b20c-a87189ad8c3b-delete_volume" released by "delete_volume" :: held 2.514s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:37:43 devstack sudo[94653]: pam_unix(sudo:session): session closed for user root
Jul 09 14:37:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-5b99ab2e-8ff0-4603-bf52-3c22076a2467 req-e593982e-83f0-4aad-8ea2-98a917221426 tempest-VolumesSnapshotsTestJSON-1506359695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17e05982-4099-4058-bfac-0eeea5e43bae -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-17e05982-4099-4058-bfac-0eeea5e43bae.6dcaa0a6-6ef5-4eab-952e-235a818fcd4c" returned: 0 in 0.769s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:37:43 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [req-5b99ab2e-8ff0-4603-bf52-3c22076a2467 req-e593982e-83f0-4aad-8ea2-98a917221426 tempest-VolumesSnapshotsTestJSON-1506359695 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-17e05982-4099-4058-bfac-0eeea5e43bae.6dcaa0a6-6ef5-4eab-952e-235a818fcd4c is being set with open permissions: ugo+rw
Jul 09 14:37:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-5b99ab2e-8ff0-4603-bf52-3c22076a2467 req-e593982e-83f0-4aad-8ea2-98a917221426 tempest-VolumesSnapshotsTestJSON-1506359695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-17e05982-4099-4058-bfac-0eeea5e43bae.6dcaa0a6-6ef5-4eab-952e-235a818fcd4c {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:37:43 devstack sudo[94658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-17e05982-4099-4058-bfac-0eeea5e43bae.6dcaa0a6-6ef5-4eab-952e-235a818fcd4c
Jul 09 14:37:43 devstack sudo[94658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:37:44 devstack sudo[94658]: pam_unix(sudo:session): session closed for user root
Jul 09 14:37:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-5b99ab2e-8ff0-4603-bf52-3c22076a2467 req-e593982e-83f0-4aad-8ea2-98a917221426 tempest-VolumesSnapshotsTestJSON-1506359695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-17e05982-4099-4058-bfac-0eeea5e43bae.6dcaa0a6-6ef5-4eab-952e-235a818fcd4c" returned: 0 in 0.678s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:37:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-5b99ab2e-8ff0-4603-bf52-3c22076a2467 req-e593982e-83f0-4aad-8ea2-98a917221426 tempest-VolumesSnapshotsTestJSON-1506359695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-17e05982-4099-4058-bfac-0eeea5e43bae.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:37:44 devstack sudo[94661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-17e05982-4099-4058-bfac-0eeea5e43bae.info
Jul 09 14:37:44 devstack sudo[94661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:37:45 devstack sudo[94661]: pam_unix(sudo:session): session closed for user root
Jul 09 14:37:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-5b99ab2e-8ff0-4603-bf52-3c22076a2467 req-e593982e-83f0-4aad-8ea2-98a917221426 tempest-VolumesSnapshotsTestJSON-1506359695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-17e05982-4099-4058-bfac-0eeea5e43bae.info" returned: 0 in 0.685s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:37:45 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [req-5b99ab2e-8ff0-4603-bf52-3c22076a2467 req-e593982e-83f0-4aad-8ea2-98a917221426 tempest-VolumesSnapshotsTestJSON-1506359695 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-17e05982-4099-4058-bfac-0eeea5e43bae.info is being set with open permissions: ugo+rw
Jul 09 14:37:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-5b99ab2e-8ff0-4603-bf52-3c22076a2467 req-e593982e-83f0-4aad-8ea2-98a917221426 tempest-VolumesSnapshotsTestJSON-1506359695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-17e05982-4099-4058-bfac-0eeea5e43bae.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:37:45 devstack sudo[94666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-17e05982-4099-4058-bfac-0eeea5e43bae.info
Jul 09 14:37:45 devstack sudo[94666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:37:45 devstack sudo[94666]: pam_unix(sudo:session): session closed for user root
Jul 09 14:37:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-5b99ab2e-8ff0-4603-bf52-3c22076a2467 req-e593982e-83f0-4aad-8ea2-98a917221426 tempest-VolumesSnapshotsTestJSON-1506359695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-17e05982-4099-4058-bfac-0eeea5e43bae.info" returned: 0 in 0.710s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:37:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-5b99ab2e-8ff0-4603-bf52-3c22076a2467 req-e593982e-83f0-4aad-8ea2-98a917221426 tempest-VolumesSnapshotsTestJSON-1506359695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.646s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:37:45 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-5b99ab2e-8ff0-4603-bf52-3c22076a2467 req-e593982e-83f0-4aad-8ea2-98a917221426 tempest-VolumesSnapshotsTestJSON-1506359695 None] Create snapshot completed successfully
Jul 09 14:37:46 devstack cinder-volume[87230]: DEBUG cinder.coordination [req-4fc9072f-aa50-4921-8bcf-4cedce2fc13f req-436c3fe1-027a-4209-87ec-d922d74a97b7 tempest-VolumesSnapshotsTestJSON-1506359695 None] Acquiring lock "cinder-6dcaa0a6-6ef5-4eab-952e-235a818fcd4c-delete_snapshot" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:37:46 devstack cinder-volume[87230]: DEBUG cinder.coordination [req-4fc9072f-aa50-4921-8bcf-4cedce2fc13f req-436c3fe1-027a-4209-87ec-d922d74a97b7 tempest-VolumesSnapshotsTestJSON-1506359695 None] Lock "cinder-6dcaa0a6-6ef5-4eab-952e-235a818fcd4c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:37:46 devstack cinder-volume[87230]: DEBUG cinder.coordination [req-4fc9072f-aa50-4921-8bcf-4cedce2fc13f req-436c3fe1-027a-4209-87ec-d922d74a97b7 tempest-VolumesSnapshotsTestJSON-1506359695 None] Acquiring lock "cinder-quobyte-17e05982-4099-4058-bfac-0eeea5e43bae" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:37:46 devstack cinder-volume[87230]: DEBUG cinder.coordination [req-4fc9072f-aa50-4921-8bcf-4cedce2fc13f req-436c3fe1-027a-4209-87ec-d922d74a97b7 tempest-VolumesSnapshotsTestJSON-1506359695 None] Lock "cinder-quobyte-17e05982-4099-4058-bfac-0eeea5e43bae" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:37:46 devstack cinder-volume[87230]: DEBUG cinder.coordination [req-4fc9072f-aa50-4921-8bcf-4cedce2fc13f req-436c3fe1-027a-4209-87ec-d922d74a97b7 tempest-VolumesSnapshotsTestJSON-1506359695 None] Acquiring lock "cinder-quobyte-6dcaa0a6-6ef5-4eab-952e-235a818fcd4c" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:37:46 devstack cinder-volume[87230]: DEBUG cinder.coordination [req-4fc9072f-aa50-4921-8bcf-4cedce2fc13f req-436c3fe1-027a-4209-87ec-d922d74a97b7 tempest-VolumesSnapshotsTestJSON-1506359695 None] Lock "cinder-quobyte-6dcaa0a6-6ef5-4eab-952e-235a818fcd4c" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:37:46 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [req-4fc9072f-aa50-4921-8bcf-4cedce2fc13f req-436c3fe1-027a-4209-87ec-d922d74a97b7 tempest-VolumesSnapshotsTestJSON-1506359695 None] Deleting offline snapshot 6dcaa0a6-6ef5-4eab-952e-235a818fcd4c of volume 17e05982-4099-4058-bfac-0eeea5e43bae {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 14:37:46 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [req-4fc9072f-aa50-4921-8bcf-4cedce2fc13f req-436c3fe1-027a-4209-87ec-d922d74a97b7 tempest-VolumesSnapshotsTestJSON-1506359695 None] snapshot_file for this snap is: volume-17e05982-4099-4058-bfac-0eeea5e43bae.6dcaa0a6-6ef5-4eab-952e-235a818fcd4c {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 14:37:47 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c286e6-4414-4c68-8e9b-6627f4611488]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:37:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-4fc9072f-aa50-4921-8bcf-4cedce2fc13f req-436c3fe1-027a-4209-87ec-d922d74a97b7 tempest-VolumesSnapshotsTestJSON-1506359695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-17e05982-4099-4058-bfac-0eeea5e43bae.6dcaa0a6-6ef5-4eab-952e-235a818fcd4c {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:37:47 devstack sudo[94673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-17e05982-4099-4058-bfac-0eeea5e43bae.6dcaa0a6-6ef5-4eab-952e-235a818fcd4c
Jul 09 14:37:47 devstack sudo[94673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:37:47 devstack sudo[94673]: pam_unix(sudo:session): session closed for user root
Jul 09 14:37:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-4fc9072f-aa50-4921-8bcf-4cedce2fc13f req-436c3fe1-027a-4209-87ec-d922d74a97b7 tempest-VolumesSnapshotsTestJSON-1506359695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-17e05982-4099-4058-bfac-0eeea5e43bae.6dcaa0a6-6ef5-4eab-952e-235a818fcd4c" returned: 0 in 0.827s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:37:47 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [req-4fc9072f-aa50-4921-8bcf-4cedce2fc13f req-436c3fe1-027a-4209-87ec-d922d74a97b7 tempest-VolumesSnapshotsTestJSON-1506359695 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17e05982-4099-4058-bfac-0eeea5e43bae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 14:37:47 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3dcdca4-6bb8-4489-90cd-6905af332f0f]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:37:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-4fc9072f-aa50-4921-8bcf-4cedce2fc13f req-436c3fe1-027a-4209-87ec-d922d74a97b7 tempest-VolumesSnapshotsTestJSON-1506359695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-17e05982-4099-4058-bfac-0eeea5e43bae {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:37:47 devstack sudo[94678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-17e05982-4099-4058-bfac-0eeea5e43bae
Jul 09 14:37:47 devstack sudo[94678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:37:48 devstack sudo[94678]: pam_unix(sudo:session): session closed for user root
Jul 09 14:37:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-4fc9072f-aa50-4921-8bcf-4cedce2fc13f req-436c3fe1-027a-4209-87ec-d922d74a97b7 tempest-VolumesSnapshotsTestJSON-1506359695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-17e05982-4099-4058-bfac-0eeea5e43bae" returned: 0 in 0.913s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:37:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-4fc9072f-aa50-4921-8bcf-4cedce2fc13f req-436c3fe1-027a-4209-87ec-d922d74a97b7 tempest-VolumesSnapshotsTestJSON-1506359695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-17e05982-4099-4058-bfac-0eeea5e43bae.6dcaa0a6-6ef5-4eab-952e-235a818fcd4c {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:37:48 devstack sudo[94692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-17e05982-4099-4058-bfac-0eeea5e43bae.6dcaa0a6-6ef5-4eab-952e-235a818fcd4c
Jul 09 14:37:48 devstack sudo[94692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:37:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-e1ec404c-eaef-45bc-b1e9-169e454e88a3 req-2583097b-5a76-4d68-9a0b-42cf63565eb9 tempest-ServerActionsTestOtherA-318969881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:37:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-e1ec404c-eaef-45bc-b1e9-169e454e88a3 req-2583097b-5a76-4d68-9a0b-42cf63565eb9 tempest-ServerActionsTestOtherA-318969881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:37:48 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea447ed8-dbd7-4ccb-baed-c35f972a3066]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:37:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-e1ec404c-eaef-45bc-b1e9-169e454e88a3 req-2583097b-5a76-4d68-9a0b-42cf63565eb9 tempest-ServerActionsTestOtherA-318969881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a425af93-c49d-46e6-95cc-6240c1ec5f43 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:37:49 devstack sudo[94695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a425af93-c49d-46e6-95cc-6240c1ec5f43
Jul 09 14:37:49 devstack sudo[94695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:37:49 devstack sudo[94692]: pam_unix(sudo:session): session closed for user root
Jul 09 14:37:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-4fc9072f-aa50-4921-8bcf-4cedce2fc13f req-436c3fe1-027a-4209-87ec-d922d74a97b7 tempest-VolumesSnapshotsTestJSON-1506359695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-17e05982-4099-4058-bfac-0eeea5e43bae.6dcaa0a6-6ef5-4eab-952e-235a818fcd4c" returned: 0 in 1.017s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:37:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-4fc9072f-aa50-4921-8bcf-4cedce2fc13f req-436c3fe1-027a-4209-87ec-d922d74a97b7 tempest-VolumesSnapshotsTestJSON-1506359695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-17e05982-4099-4058-bfac-0eeea5e43bae.6dcaa0a6-6ef5-4eab-952e-235a818fcd4c {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:37:49 devstack sudo[94703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-17e05982-4099-4058-bfac-0eeea5e43bae.6dcaa0a6-6ef5-4eab-952e-235a818fcd4c
Jul 09 14:37:49 devstack sudo[94703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:37:49 devstack sudo[94695]: pam_unix(sudo:session): session closed for user root
Jul 09 14:37:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-e1ec404c-eaef-45bc-b1e9-169e454e88a3 req-2583097b-5a76-4d68-9a0b-42cf63565eb9 tempest-ServerActionsTestOtherA-318969881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a425af93-c49d-46e6-95cc-6240c1ec5f43" returned: 0 in 0.986s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:37:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-e1ec404c-eaef-45bc-b1e9-169e454e88a3 req-2583097b-5a76-4d68-9a0b-42cf63565eb9 tempest-ServerActionsTestOtherA-318969881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.010s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:37:49 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-e1ec404c-eaef-45bc-b1e9-169e454e88a3 req-2583097b-5a76-4d68-9a0b-42cf63565eb9 tempest-ServerActionsTestOtherA-318969881 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653', 'name': 'volume-a425af93-c49d-46e6-95cc-6240c1ec5f43', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c0f972f6-18df-4eca-a6f0-19b0e52a7369', 'enforce_multipath': True} {{(pid=87230) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 09 14:37:50 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-e1ec404c-eaef-45bc-b1e9-169e454e88a3 req-2583097b-5a76-4d68-9a0b-42cf63565eb9 tempest-ServerActionsTestOtherA-318969881 None] attachment_update completed successfully.
Jul 09 14:37:50 devstack sudo[94703]: pam_unix(sudo:session): session closed for user root
Jul 09 14:37:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-4fc9072f-aa50-4921-8bcf-4cedce2fc13f req-436c3fe1-027a-4209-87ec-d922d74a97b7 tempest-VolumesSnapshotsTestJSON-1506359695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-17e05982-4099-4058-bfac-0eeea5e43bae.6dcaa0a6-6ef5-4eab-952e-235a818fcd4c" returned: 0 in 0.843s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:37:50 devstack cinder-volume[87230]: DEBUG cinder.coordination [req-4fc9072f-aa50-4921-8bcf-4cedce2fc13f req-436c3fe1-027a-4209-87ec-d922d74a97b7 tempest-VolumesSnapshotsTestJSON-1506359695 None] Lock "cinder-quobyte-6dcaa0a6-6ef5-4eab-952e-235a818fcd4c" released by "_delete_snapshot" :: held 3.738s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:37:50 devstack cinder-volume[87230]: DEBUG cinder.coordination [req-4fc9072f-aa50-4921-8bcf-4cedce2fc13f req-436c3fe1-027a-4209-87ec-d922d74a97b7 tempest-VolumesSnapshotsTestJSON-1506359695 None] Lock "cinder-quobyte-17e05982-4099-4058-bfac-0eeea5e43bae" released by "delete_snapshot" :: held 3.767s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:37:50 devstack cinder-volume[87230]: DEBUG cinder.quota [req-4fc9072f-aa50-4921-8bcf-4cedce2fc13f req-436c3fe1-027a-4209-87ec-d922d74a97b7 tempest-VolumesSnapshotsTestJSON-1506359695 None] Created reservations ['1e79a67d-b84a-4147-8820-4b69f1f89934', '4b4ab8de-edfa-4556-a975-24298b8fe383', '2f39da6a-c2a4-4529-9247-c73b0f0f088f', 'a141bc9a-716c-47ff-b7ad-946446e516c4'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:37:50 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-4fc9072f-aa50-4921-8bcf-4cedce2fc13f req-436c3fe1-027a-4209-87ec-d922d74a97b7 tempest-VolumesSnapshotsTestJSON-1506359695 None] Delete snapshot completed successfully.
Jul 09 14:37:50 devstack cinder-volume[87230]: DEBUG cinder.coordination [req-4fc9072f-aa50-4921-8bcf-4cedce2fc13f req-436c3fe1-027a-4209-87ec-d922d74a97b7 tempest-VolumesSnapshotsTestJSON-1506359695 None] Lock "cinder-6dcaa0a6-6ef5-4eab-952e-235a818fcd4c-delete_snapshot" released by "delete_snapshot" :: held 3.941s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:37:51 devstack cinder-volume[87230]: DEBUG cinder.coordination [req-a01b7539-9222-487f-8438-cbb882b61fc0 req-1d0986e7-ef3b-41b3-adf1-2ba12eb11562 tempest-VolumesSnapshotsTestJSON-1506359695 None] Acquiring lock "cinder-17e05982-4099-4058-bfac-0eeea5e43bae-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:37:51 devstack cinder-volume[87230]: DEBUG cinder.coordination [req-a01b7539-9222-487f-8438-cbb882b61fc0 req-1d0986e7-ef3b-41b3-adf1-2ba12eb11562 tempest-VolumesSnapshotsTestJSON-1506359695 None] Lock "cinder-17e05982-4099-4058-bfac-0eeea5e43bae-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:37:51 devstack cinder-volume[87230]: DEBUG cinder.coordination [req-a01b7539-9222-487f-8438-cbb882b61fc0 req-1d0986e7-ef3b-41b3-adf1-2ba12eb11562 tempest-VolumesSnapshotsTestJSON-1506359695 None] Acquiring lock "cinder-quobyte-17e05982-4099-4058-bfac-0eeea5e43bae" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:37:51 devstack cinder-volume[87230]: DEBUG cinder.coordination [req-a01b7539-9222-487f-8438-cbb882b61fc0 req-1d0986e7-ef3b-41b3-adf1-2ba12eb11562 tempest-VolumesSnapshotsTestJSON-1506359695 None] Lock "cinder-quobyte-17e05982-4099-4058-bfac-0eeea5e43bae" acquired by "delete_volume" :: waited 0.030s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:37:51 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f9f3136-8eda-47da-9c10-a89e971ba706]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:37:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-a01b7539-9222-487f-8438-cbb882b61fc0 req-1d0986e7-ef3b-41b3-adf1-2ba12eb11562 tempest-VolumesSnapshotsTestJSON-1506359695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-17e05982-4099-4058-bfac-0eeea5e43bae {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:37:51 devstack sudo[95091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-17e05982-4099-4058-bfac-0eeea5e43bae
Jul 09 14:37:51 devstack sudo[95091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:37:52 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 14:37:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:37:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:37:52 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:37:52 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:37:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:37:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:37:52 devstack sudo[95116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:37:52 devstack sudo[95116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:37:52 devstack sudo[95091]: pam_unix(sudo:session): session closed for user root
Jul 09 14:37:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-a01b7539-9222-487f-8438-cbb882b61fc0 req-1d0986e7-ef3b-41b3-adf1-2ba12eb11562 tempest-VolumesSnapshotsTestJSON-1506359695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-17e05982-4099-4058-bfac-0eeea5e43bae" returned: 0 in 1.171s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:37:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-a01b7539-9222-487f-8438-cbb882b61fc0 req-1d0986e7-ef3b-41b3-adf1-2ba12eb11562 tempest-VolumesSnapshotsTestJSON-1506359695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-17e05982-4099-4058-bfac-0eeea5e43bae {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:37:52 devstack sudo[95124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-17e05982-4099-4058-bfac-0eeea5e43bae
Jul 09 14:37:52 devstack sudo[95124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:37:53 devstack sudo[95116]: pam_unix(sudo:session): session closed for user root
Jul 09 14:37:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.801s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:37:53 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:37:53 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Running periodic task VolumeManager._thread_info {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 14:37:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] thread count: 8 {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 09 14:37:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] thread info: [<_MainThread(MainThread, started 125388812103808)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125388713797504)>, <Thread(Thread-3 (stat_writer), started daemon 125388699995392)>, <Thread(Rabbit-heartbeat, started daemon 125388700522560)>, <Thread(Thread-5 (_runner), started daemon 125388698545216)>, <Thread(Thread-7 (_runner), started daemon 125388698611264)>, <Thread(fd_logger, started daemon 125388703020672)>, <Thread(privsep_reader, started daemon 125388696441088)>] {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 09 14:37:53 devstack sudo[95124]: pam_unix(sudo:session): session closed for user root
Jul 09 14:37:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-a01b7539-9222-487f-8438-cbb882b61fc0 req-1d0986e7-ef3b-41b3-adf1-2ba12eb11562 tempest-VolumesSnapshotsTestJSON-1506359695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-17e05982-4099-4058-bfac-0eeea5e43bae" returned: 0 in 0.732s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:37:53 devstack cinder-volume[87230]: DEBUG cinder.coordination [req-a01b7539-9222-487f-8438-cbb882b61fc0 req-1d0986e7-ef3b-41b3-adf1-2ba12eb11562 tempest-VolumesSnapshotsTestJSON-1506359695 None] Lock "cinder-quobyte-17e05982-4099-4058-bfac-0eeea5e43bae" released by "delete_volume" :: held 2.010s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:37:53 devstack cinder-volume[87230]: DEBUG cinder.quota [req-a01b7539-9222-487f-8438-cbb882b61fc0 req-1d0986e7-ef3b-41b3-adf1-2ba12eb11562 tempest-VolumesSnapshotsTestJSON-1506359695 None] Created reservations ['7667237c-3a60-4d95-92c9-f40b39cd537f', 'dba0ff12-6a13-4f1a-85ab-5f00f98ce020', '10a96f35-1c37-4e46-be69-38854dc93422', 'a8037828-2f6e-42ee-8bb7-4af6c48759ed'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:37:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-a01b7539-9222-487f-8438-cbb882b61fc0 req-1d0986e7-ef3b-41b3-adf1-2ba12eb11562 tempest-VolumesSnapshotsTestJSON-1506359695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:37:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-a01b7539-9222-487f-8438-cbb882b61fc0 req-1d0986e7-ef3b-41b3-adf1-2ba12eb11562 tempest-VolumesSnapshotsTestJSON-1506359695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:37:53 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [req-a01b7539-9222-487f-8438-cbb882b61fc0 req-1d0986e7-ef3b-41b3-adf1-2ba12eb11562 tempest-VolumesSnapshotsTestJSON-1506359695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:37:53 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [req-a01b7539-9222-487f-8438-cbb882b61fc0 req-1d0986e7-ef3b-41b3-adf1-2ba12eb11562 tempest-VolumesSnapshotsTestJSON-1506359695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:37:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-a01b7539-9222-487f-8438-cbb882b61fc0 req-1d0986e7-ef3b-41b3-adf1-2ba12eb11562 tempest-VolumesSnapshotsTestJSON-1506359695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:37:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-a01b7539-9222-487f-8438-cbb882b61fc0 req-1d0986e7-ef3b-41b3-adf1-2ba12eb11562 tempest-VolumesSnapshotsTestJSON-1506359695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:37:53 devstack sudo[95128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:37:53 devstack sudo[95128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:37:54 devstack sudo[95128]: pam_unix(sudo:session): session closed for user root
Jul 09 14:37:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-a01b7539-9222-487f-8438-cbb882b61fc0 req-1d0986e7-ef3b-41b3-adf1-2ba12eb11562 tempest-VolumesSnapshotsTestJSON-1506359695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.873s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:37:54 devstack cinder-volume[87230]: DEBUG cinder.manager [req-a01b7539-9222-487f-8438-cbb882b61fc0 req-1d0986e7-ef3b-41b3-adf1-2ba12eb11562 tempest-VolumesSnapshotsTestJSON-1506359695 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:37:54 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-a01b7539-9222-487f-8438-cbb882b61fc0 req-1d0986e7-ef3b-41b3-adf1-2ba12eb11562 tempest-VolumesSnapshotsTestJSON-1506359695 None] Deleted volume successfully.
Jul 09 14:37:54 devstack cinder-volume[87230]: DEBUG cinder.coordination [req-a01b7539-9222-487f-8438-cbb882b61fc0 req-1d0986e7-ef3b-41b3-adf1-2ba12eb11562 tempest-VolumesSnapshotsTestJSON-1506359695 None] Lock "cinder-17e05982-4099-4058-bfac-0eeea5e43bae-delete_volume" released by "delete_volume" :: held 3.177s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:37:55 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-b67b2f80-3929-482a-b06e-b1c091121ba5 tempest-VolumesSnapshotTestJSON-1821027228 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:37:55 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b67b2f80-3929-482a-b06e-b1c091121ba5 tempest-VolumesSnapshotTestJSON-1821027228 None] Flow 'volume_create_manager' (f14a7e18-f81b-41e0-82eb-0f8671d03529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:37:55 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b67b2f80-3929-482a-b06e-b1c091121ba5 tempest-VolumesSnapshotTestJSON-1821027228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f48a458-637d-4f82-877f-d156d44cc448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:37:55 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b67b2f80-3929-482a-b06e-b1c091121ba5 tempest-VolumesSnapshotTestJSON-1821027228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f48a458-637d-4f82-877f-d156d44cc448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:37:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-377640279',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2525802b-76f2-4dec-b821-7edce8151967,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='082e6a77a8814f3c845e798e70c9a807',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:37:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:37:55Z,use_quota=True,user_id='5f6a22de2293401292f13d9e333940ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:37:55 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b67b2f80-3929-482a-b06e-b1c091121ba5 tempest-VolumesSnapshotTestJSON-1821027228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bac4d22b-2973-435b-9e1c-ba4e8083245d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:37:55 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b67b2f80-3929-482a-b06e-b1c091121ba5 tempest-VolumesSnapshotTestJSON-1821027228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bac4d22b-2973-435b-9e1c-ba4e8083245d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:37:55 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b67b2f80-3929-482a-b06e-b1c091121ba5 tempest-VolumesSnapshotTestJSON-1821027228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b17629f-d7b1-419d-b22d-9ac5c737386d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:37:55 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b67b2f80-3929-482a-b06e-b1c091121ba5 tempest-VolumesSnapshotTestJSON-1821027228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b17629f-d7b1-419d-b22d-9ac5c737386d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2525802b-76f2-4dec-b821-7edce8151967', 'volume_name': 'volume-2525802b-76f2-4dec-b821-7edce8151967', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:37:55 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b67b2f80-3929-482a-b06e-b1c091121ba5 tempest-VolumesSnapshotTestJSON-1821027228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc6b0689-8a73-45b8-bccd-a771480b30fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:37:55 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b67b2f80-3929-482a-b06e-b1c091121ba5 tempest-VolumesSnapshotTestJSON-1821027228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc6b0689-8a73-45b8-bccd-a771480b30fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:37:55 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b67b2f80-3929-482a-b06e-b1c091121ba5 tempest-VolumesSnapshotTestJSON-1821027228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da9671d9-4238-45dc-99af-e8b507dd9bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:37:55 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-b67b2f80-3929-482a-b06e-b1c091121ba5 tempest-VolumesSnapshotTestJSON-1821027228 None] Volume 2525802b-76f2-4dec-b821-7edce8151967: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2525802b-76f2-4dec-b821-7edce8151967', 'volume_size': 1}
Jul 09 14:37:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b67b2f80-3929-482a-b06e-b1c091121ba5 tempest-VolumesSnapshotTestJSON-1821027228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:37:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b67b2f80-3929-482a-b06e-b1c091121ba5 tempest-VolumesSnapshotTestJSON-1821027228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:37:55 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b67b2f80-3929-482a-b06e-b1c091121ba5 tempest-VolumesSnapshotTestJSON-1821027228 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:37:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-377640279',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2525802b-76f2-4dec-b821-7edce8151967,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='082e6a77a8814f3c845e798e70c9a807',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:37:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:37:55Z,use_quota=True,user_id='5f6a22de2293401292f13d9e333940ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:37:55 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-b67b2f80-3929-482a-b06e-b1c091121ba5 tempest-VolumesSnapshotTestJSON-1821027228 None] Creating volume 2525802b-76f2-4dec-b821-7edce8151967 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:37:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b67b2f80-3929-482a-b06e-b1c091121ba5 tempest-VolumesSnapshotTestJSON-1821027228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:37:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b67b2f80-3929-482a-b06e-b1c091121ba5 tempest-VolumesSnapshotTestJSON-1821027228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:37:55 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b67b2f80-3929-482a-b06e-b1c091121ba5 tempest-VolumesSnapshotTestJSON-1821027228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:37:55 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b67b2f80-3929-482a-b06e-b1c091121ba5 tempest-VolumesSnapshotTestJSON-1821027228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:37:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b67b2f80-3929-482a-b06e-b1c091121ba5 tempest-VolumesSnapshotTestJSON-1821027228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:37:55 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b67b2f80-3929-482a-b06e-b1c091121ba5 tempest-VolumesSnapshotTestJSON-1821027228 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:37:55 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-b67b2f80-3929-482a-b06e-b1c091121ba5 tempest-VolumesSnapshotTestJSON-1821027228 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:37:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b67b2f80-3929-482a-b06e-b1c091121ba5 tempest-VolumesSnapshotTestJSON-1821027228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2525802b-76f2-4dec-b821-7edce8151967 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:37:55 devstack sudo[95137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2525802b-76f2-4dec-b821-7edce8151967 1073741824
Jul 09 14:37:55 devstack sudo[95137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:37:56 devstack sudo[95137]: pam_unix(sudo:session): session closed for user root
Jul 09 14:37:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b67b2f80-3929-482a-b06e-b1c091121ba5 tempest-VolumesSnapshotTestJSON-1821027228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2525802b-76f2-4dec-b821-7edce8151967 1073741824" returned: 0 in 1.386s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:37:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b67b2f80-3929-482a-b06e-b1c091121ba5 tempest-VolumesSnapshotTestJSON-1821027228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2525802b-76f2-4dec-b821-7edce8151967 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:37:56 devstack sudo[95148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2525802b-76f2-4dec-b821-7edce8151967
Jul 09 14:37:56 devstack sudo[95148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:37:57 devstack sudo[95148]: pam_unix(sudo:session): session closed for user root
Jul 09 14:37:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b67b2f80-3929-482a-b06e-b1c091121ba5 tempest-VolumesSnapshotTestJSON-1821027228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2525802b-76f2-4dec-b821-7edce8151967" returned: 0 in 0.889s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:37:57 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b67b2f80-3929-482a-b06e-b1c091121ba5 tempest-VolumesSnapshotTestJSON-1821027228 None] <== create_volume: return (2351ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:37:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b67b2f80-3929-482a-b06e-b1c091121ba5 tempest-VolumesSnapshotTestJSON-1821027228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.354s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:37:57 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b67b2f80-3929-482a-b06e-b1c091121ba5 tempest-VolumesSnapshotTestJSON-1821027228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da9671d9-4238-45dc-99af-e8b507dd9bc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2525802b-76f2-4dec-b821-7edce8151967', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:37:57 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b67b2f80-3929-482a-b06e-b1c091121ba5 tempest-VolumesSnapshotTestJSON-1821027228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67d815b3-ee05-4936-a433-a472d3ca301e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:37:57 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-b67b2f80-3929-482a-b06e-b1c091121ba5 tempest-VolumesSnapshotTestJSON-1821027228 None] Volume volume-2525802b-76f2-4dec-b821-7edce8151967 (2525802b-76f2-4dec-b821-7edce8151967): created successfully
Jul 09 14:37:57 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b67b2f80-3929-482a-b06e-b1c091121ba5 tempest-VolumesSnapshotTestJSON-1821027228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67d815b3-ee05-4936-a433-a472d3ca301e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:37:57 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b67b2f80-3929-482a-b06e-b1c091121ba5 tempest-VolumesSnapshotTestJSON-1821027228 None] Flow 'volume_create_manager' (f14a7e18-f81b-41e0-82eb-0f8671d03529) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:37:57 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-b67b2f80-3929-482a-b06e-b1c091121ba5 tempest-VolumesSnapshotTestJSON-1821027228 None] Created volume successfully.
Jul 09 14:37:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8c97e76a-3c45-4e59-a0da-952a6cea7548 tempest-VolumesSnapshotTestJSON-1821027228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:37:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8c97e76a-3c45-4e59-a0da-952a6cea7548 tempest-VolumesSnapshotTestJSON-1821027228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:37:58 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-8c97e76a-3c45-4e59-a0da-952a6cea7548 tempest-VolumesSnapshotTestJSON-1821027228 None] Creating offline snapshot 01b8da93-49d7-4ac8-86b9-031ccaec829c of volume 2525802b-76f2-4dec-b821-7edce8151967 {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 14:37:58 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[50427986-7672-4be8-a9b4-e142e888e0fd]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:37:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8c97e76a-3c45-4e59-a0da-952a6cea7548 tempest-VolumesSnapshotTestJSON-1821027228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2525802b-76f2-4dec-b821-7edce8151967 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:37:58 devstack sudo[95175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2525802b-76f2-4dec-b821-7edce8151967
Jul 09 14:37:58 devstack sudo[95175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:37:58 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-23cf5bf8-5a21-4cc3-9c81-bf7da42cc7ce tempest-VolumesTestJSON-1340158169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:37:58 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-23cf5bf8-5a21-4cc3-9c81-bf7da42cc7ce tempest-VolumesTestJSON-1340158169 None] Flow 'volume_create_manager' (35eda074-32af-4ca4-ac12-cff76816a009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:37:58 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-23cf5bf8-5a21-4cc3-9c81-bf7da42cc7ce tempest-VolumesTestJSON-1340158169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4974bb9c-9551-4e26-b525-b5ba076ed527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:37:58 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-23cf5bf8-5a21-4cc3-9c81-bf7da42cc7ce tempest-VolumesTestJSON-1340158169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4974bb9c-9551-4e26-b525-b5ba076ed527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:37:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-828053993',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13d1e96e-d79a-4728-ab25-4ca47964c695,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3c5e2f42096a4a26a899c505651f740f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:37:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:37:59Z,use_quota=True,user_id='aa2e0103e625442388070430a620dde6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:37:58 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-23cf5bf8-5a21-4cc3-9c81-bf7da42cc7ce tempest-VolumesTestJSON-1340158169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc92f0a8-ce8f-44cc-9242-9d8f98b8cdf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:37:58 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-23cf5bf8-5a21-4cc3-9c81-bf7da42cc7ce tempest-VolumesTestJSON-1340158169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc92f0a8-ce8f-44cc-9242-9d8f98b8cdf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:37:58 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-23cf5bf8-5a21-4cc3-9c81-bf7da42cc7ce tempest-VolumesTestJSON-1340158169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e8863da-b8ac-4642-8213-e710b42d3af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:37:58 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-23cf5bf8-5a21-4cc3-9c81-bf7da42cc7ce tempest-VolumesTestJSON-1340158169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e8863da-b8ac-4642-8213-e710b42d3af0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13d1e96e-d79a-4728-ab25-4ca47964c695', 'volume_name': 'volume-13d1e96e-d79a-4728-ab25-4ca47964c695', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:37:58 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-23cf5bf8-5a21-4cc3-9c81-bf7da42cc7ce tempest-VolumesTestJSON-1340158169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18d9684c-427f-420e-a045-0742949259a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:37:59 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-23cf5bf8-5a21-4cc3-9c81-bf7da42cc7ce tempest-VolumesTestJSON-1340158169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18d9684c-427f-420e-a045-0742949259a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:37:59 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-23cf5bf8-5a21-4cc3-9c81-bf7da42cc7ce tempest-VolumesTestJSON-1340158169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a007c225-0d1f-485b-a0fa-b0881833860f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:37:59 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-23cf5bf8-5a21-4cc3-9c81-bf7da42cc7ce tempest-VolumesTestJSON-1340158169 None] Volume 13d1e96e-d79a-4728-ab25-4ca47964c695: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13d1e96e-d79a-4728-ab25-4ca47964c695', 'volume_size': 1}
Jul 09 14:37:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-23cf5bf8-5a21-4cc3-9c81-bf7da42cc7ce tempest-VolumesTestJSON-1340158169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:37:59 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-093eaeab-9a4a-4188-adba-f5d8f7aa4a32 req-f9ad10c1-d508-4d47-a1ca-64f177f24dae tempest-ServerActionsTestOtherA-318969881 None] Terminate volume connection completed successfully.
Jul 09 14:37:59 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-093eaeab-9a4a-4188-adba-f5d8f7aa4a32 req-f9ad10c1-d508-4d47-a1ca-64f177f24dae tempest-ServerActionsTestOtherA-318969881 None] Deleting attachment c0f972f6-18df-4eca-a6f0-19b0e52a7369. {{(pid=87230) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 09 14:37:59 devstack sudo[95175]: pam_unix(sudo:session): session closed for user root
Jul 09 14:37:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8c97e76a-3c45-4e59-a0da-952a6cea7548 tempest-VolumesSnapshotTestJSON-1821027228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2525802b-76f2-4dec-b821-7edce8151967" returned: 0 in 0.918s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:37:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8c97e76a-3c45-4e59-a0da-952a6cea7548 tempest-VolumesSnapshotTestJSON-1821027228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2525802b-76f2-4dec-b821-7edce8151967,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2525802b-76f2-4dec-b821-7edce8151967.01b8da93-49d7-4ac8-86b9-031ccaec829c 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:37:59 devstack sudo[95209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2525802b-76f2-4dec-b821-7edce8151967,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2525802b-76f2-4dec-b821-7edce8151967.01b8da93-49d7-4ac8-86b9-031ccaec829c 1G
Jul 09 14:37:59 devstack sudo[95209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:38:00 devstack sudo[95209]: pam_unix(sudo:session): session closed for user root
Jul 09 14:38:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8c97e76a-3c45-4e59-a0da-952a6cea7548 tempest-VolumesSnapshotTestJSON-1821027228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2525802b-76f2-4dec-b821-7edce8151967,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2525802b-76f2-4dec-b821-7edce8151967.01b8da93-49d7-4ac8-86b9-031ccaec829c 1G" returned: 0 in 1.086s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:38:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8c97e76a-3c45-4e59-a0da-952a6cea7548 tempest-VolumesSnapshotTestJSON-1821027228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2525802b-76f2-4dec-b821-7edce8151967 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2525802b-76f2-4dec-b821-7edce8151967.01b8da93-49d7-4ac8-86b9-031ccaec829c {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:38:00 devstack sudo[95234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2525802b-76f2-4dec-b821-7edce8151967 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2525802b-76f2-4dec-b821-7edce8151967.01b8da93-49d7-4ac8-86b9-031ccaec829c
Jul 09 14:38:00 devstack sudo[95234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:38:01 devstack sudo[95234]: pam_unix(sudo:session): session closed for user root
Jul 09 14:38:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8c97e76a-3c45-4e59-a0da-952a6cea7548 tempest-VolumesSnapshotTestJSON-1821027228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2525802b-76f2-4dec-b821-7edce8151967 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2525802b-76f2-4dec-b821-7edce8151967.01b8da93-49d7-4ac8-86b9-031ccaec829c" returned: 0 in 0.730s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:38:01 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-8c97e76a-3c45-4e59-a0da-952a6cea7548 tempest-VolumesSnapshotTestJSON-1821027228 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2525802b-76f2-4dec-b821-7edce8151967.01b8da93-49d7-4ac8-86b9-031ccaec829c is being set with open permissions: ugo+rw
Jul 09 14:38:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8c97e76a-3c45-4e59-a0da-952a6cea7548 tempest-VolumesSnapshotTestJSON-1821027228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2525802b-76f2-4dec-b821-7edce8151967.01b8da93-49d7-4ac8-86b9-031ccaec829c {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:38:01 devstack sudo[95247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2525802b-76f2-4dec-b821-7edce8151967.01b8da93-49d7-4ac8-86b9-031ccaec829c
Jul 09 14:38:01 devstack sudo[95247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:38:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-093eaeab-9a4a-4188-adba-f5d8f7aa4a32 req-b5d9a23e-8d13-4384-91fd-fa38e6b37e77 tempest-ServerActionsTestOtherA-318969881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:38:02 devstack sudo[95247]: pam_unix(sudo:session): session closed for user root
Jul 09 14:38:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8c97e76a-3c45-4e59-a0da-952a6cea7548 tempest-VolumesSnapshotTestJSON-1821027228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2525802b-76f2-4dec-b821-7edce8151967.01b8da93-49d7-4ac8-86b9-031ccaec829c" returned: 0 in 0.700s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:38:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8c97e76a-3c45-4e59-a0da-952a6cea7548 tempest-VolumesSnapshotTestJSON-1821027228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2525802b-76f2-4dec-b821-7edce8151967.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:38:02 devstack sudo[95251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2525802b-76f2-4dec-b821-7edce8151967.info
Jul 09 14:38:02 devstack sudo[95251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:38:02 devstack sudo[95251]: pam_unix(sudo:session): session closed for user root
Jul 09 14:38:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8c97e76a-3c45-4e59-a0da-952a6cea7548 tempest-VolumesSnapshotTestJSON-1821027228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2525802b-76f2-4dec-b821-7edce8151967.info" returned: 0 in 0.649s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:38:02 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-8c97e76a-3c45-4e59-a0da-952a6cea7548 tempest-VolumesSnapshotTestJSON-1821027228 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2525802b-76f2-4dec-b821-7edce8151967.info is being set with open permissions: ugo+rw
Jul 09 14:38:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8c97e76a-3c45-4e59-a0da-952a6cea7548 tempest-VolumesSnapshotTestJSON-1821027228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2525802b-76f2-4dec-b821-7edce8151967.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:38:02 devstack sudo[95254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2525802b-76f2-4dec-b821-7edce8151967.info
Jul 09 14:38:02 devstack sudo[95254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:38:03 devstack sudo[95254]: pam_unix(sudo:session): session closed for user root
Jul 09 14:38:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8c97e76a-3c45-4e59-a0da-952a6cea7548 tempest-VolumesSnapshotTestJSON-1821027228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2525802b-76f2-4dec-b821-7edce8151967.info" returned: 0 in 0.650s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:38:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8c97e76a-3c45-4e59-a0da-952a6cea7548 tempest-VolumesSnapshotTestJSON-1821027228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.830s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:38:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-23cf5bf8-5a21-4cc3-9c81-bf7da42cc7ce tempest-VolumesTestJSON-1340158169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.407s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:38:03 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-23cf5bf8-5a21-4cc3-9c81-bf7da42cc7ce tempest-VolumesTestJSON-1340158169 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:37:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-828053993',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13d1e96e-d79a-4728-ab25-4ca47964c695,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3c5e2f42096a4a26a899c505651f740f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:37:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:37:59Z,use_quota=True,user_id='aa2e0103e625442388070430a620dde6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:38:03 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-23cf5bf8-5a21-4cc3-9c81-bf7da42cc7ce tempest-VolumesTestJSON-1340158169 None] Creating volume 13d1e96e-d79a-4728-ab25-4ca47964c695 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:38:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-23cf5bf8-5a21-4cc3-9c81-bf7da42cc7ce tempest-VolumesTestJSON-1340158169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:38:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-23cf5bf8-5a21-4cc3-9c81-bf7da42cc7ce tempest-VolumesTestJSON-1340158169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:38:03 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-23cf5bf8-5a21-4cc3-9c81-bf7da42cc7ce tempest-VolumesTestJSON-1340158169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:38:03 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-23cf5bf8-5a21-4cc3-9c81-bf7da42cc7ce tempest-VolumesTestJSON-1340158169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:38:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-23cf5bf8-5a21-4cc3-9c81-bf7da42cc7ce tempest-VolumesTestJSON-1340158169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:38:03 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-23cf5bf8-5a21-4cc3-9c81-bf7da42cc7ce tempest-VolumesTestJSON-1340158169 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:38:03 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-23cf5bf8-5a21-4cc3-9c81-bf7da42cc7ce tempest-VolumesTestJSON-1340158169 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:38:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-23cf5bf8-5a21-4cc3-9c81-bf7da42cc7ce tempest-VolumesTestJSON-1340158169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-13d1e96e-d79a-4728-ab25-4ca47964c695 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:38:03 devstack sudo[95257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-13d1e96e-d79a-4728-ab25-4ca47964c695 1073741824
Jul 09 14:38:03 devstack sudo[95257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:38:03 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-8c97e76a-3c45-4e59-a0da-952a6cea7548 tempest-VolumesSnapshotTestJSON-1821027228 None] Create snapshot completed successfully
Jul 09 14:38:03 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3686e69d-f3ab-42b6-9c6d-08dbc22ffbd8 tempest-VolumesSnapshotTestJSON-1821027228 None] Acquiring lock "cinder-01b8da93-49d7-4ac8-86b9-031ccaec829c-delete_snapshot" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:38:03 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3686e69d-f3ab-42b6-9c6d-08dbc22ffbd8 tempest-VolumesSnapshotTestJSON-1821027228 None] Lock "cinder-01b8da93-49d7-4ac8-86b9-031ccaec829c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:38:04 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3686e69d-f3ab-42b6-9c6d-08dbc22ffbd8 tempest-VolumesSnapshotTestJSON-1821027228 None] Acquiring lock "cinder-quobyte-2525802b-76f2-4dec-b821-7edce8151967" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:38:04 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3686e69d-f3ab-42b6-9c6d-08dbc22ffbd8 tempest-VolumesSnapshotTestJSON-1821027228 None] Lock "cinder-quobyte-2525802b-76f2-4dec-b821-7edce8151967" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:38:04 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3686e69d-f3ab-42b6-9c6d-08dbc22ffbd8 tempest-VolumesSnapshotTestJSON-1821027228 None] Acquiring lock "cinder-quobyte-01b8da93-49d7-4ac8-86b9-031ccaec829c" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:38:04 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3686e69d-f3ab-42b6-9c6d-08dbc22ffbd8 tempest-VolumesSnapshotTestJSON-1821027228 None] Lock "cinder-quobyte-01b8da93-49d7-4ac8-86b9-031ccaec829c" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:38:04 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-3686e69d-f3ab-42b6-9c6d-08dbc22ffbd8 tempest-VolumesSnapshotTestJSON-1821027228 None] Deleting offline snapshot 01b8da93-49d7-4ac8-86b9-031ccaec829c of volume 2525802b-76f2-4dec-b821-7edce8151967 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 14:38:04 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-3686e69d-f3ab-42b6-9c6d-08dbc22ffbd8 tempest-VolumesSnapshotTestJSON-1821027228 None] snapshot_file for this snap is: volume-2525802b-76f2-4dec-b821-7edce8151967.01b8da93-49d7-4ac8-86b9-031ccaec829c {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 14:38:04 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f89529-101e-44c7-bc58-b563154ccfe0]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:38:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3686e69d-f3ab-42b6-9c6d-08dbc22ffbd8 tempest-VolumesSnapshotTestJSON-1821027228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2525802b-76f2-4dec-b821-7edce8151967.01b8da93-49d7-4ac8-86b9-031ccaec829c {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:38:04 devstack sudo[95262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2525802b-76f2-4dec-b821-7edce8151967.01b8da93-49d7-4ac8-86b9-031ccaec829c
Jul 09 14:38:04 devstack sudo[95262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:38:04 devstack sudo[95257]: pam_unix(sudo:session): session closed for user root
Jul 09 14:38:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-23cf5bf8-5a21-4cc3-9c81-bf7da42cc7ce tempest-VolumesTestJSON-1340158169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-13d1e96e-d79a-4728-ab25-4ca47964c695 1073741824" returned: 0 in 0.946s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:38:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-23cf5bf8-5a21-4cc3-9c81-bf7da42cc7ce tempest-VolumesTestJSON-1340158169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-13d1e96e-d79a-4728-ab25-4ca47964c695 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:38:04 devstack sudo[95264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-13d1e96e-d79a-4728-ab25-4ca47964c695
Jul 09 14:38:04 devstack sudo[95264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:38:04 devstack sudo[95262]: pam_unix(sudo:session): session closed for user root
Jul 09 14:38:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3686e69d-f3ab-42b6-9c6d-08dbc22ffbd8 tempest-VolumesSnapshotTestJSON-1821027228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2525802b-76f2-4dec-b821-7edce8151967.01b8da93-49d7-4ac8-86b9-031ccaec829c" returned: 0 in 0.825s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:38:04 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-3686e69d-f3ab-42b6-9c6d-08dbc22ffbd8 tempest-VolumesSnapshotTestJSON-1821027228 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2525802b-76f2-4dec-b821-7edce8151967(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 14:38:04 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1415edc-8418-4c37-ba4b-de51b75e351d]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:38:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3686e69d-f3ab-42b6-9c6d-08dbc22ffbd8 tempest-VolumesSnapshotTestJSON-1821027228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2525802b-76f2-4dec-b821-7edce8151967 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:38:05 devstack sudo[95270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2525802b-76f2-4dec-b821-7edce8151967
Jul 09 14:38:05 devstack sudo[95270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:38:05 devstack sudo[95264]: pam_unix(sudo:session): session closed for user root
Jul 09 14:38:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-23cf5bf8-5a21-4cc3-9c81-bf7da42cc7ce tempest-VolumesTestJSON-1340158169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-13d1e96e-d79a-4728-ab25-4ca47964c695" returned: 0 in 0.763s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:38:05 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-23cf5bf8-5a21-4cc3-9c81-bf7da42cc7ce tempest-VolumesTestJSON-1340158169 None] <== create_volume: return (1761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:38:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-23cf5bf8-5a21-4cc3-9c81-bf7da42cc7ce tempest-VolumesTestJSON-1340158169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.765s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:38:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-093eaeab-9a4a-4188-adba-f5d8f7aa4a32 req-b5d9a23e-8d13-4384-91fd-fa38e6b37e77 tempest-ServerActionsTestOtherA-318969881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.683s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:38:05 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-23cf5bf8-5a21-4cc3-9c81-bf7da42cc7ce tempest-VolumesTestJSON-1340158169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a007c225-0d1f-485b-a0fa-b0881833860f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13d1e96e-d79a-4728-ab25-4ca47964c695', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:38:05 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-23cf5bf8-5a21-4cc3-9c81-bf7da42cc7ce tempest-VolumesTestJSON-1340158169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c35c7b3-65d2-44b7-98a3-f1df59682d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:38:05 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[604eec3f-06d2-4618-8ea3-45e8c40b8e81]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:38:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-093eaeab-9a4a-4188-adba-f5d8f7aa4a32 req-b5d9a23e-8d13-4384-91fd-fa38e6b37e77 tempest-ServerActionsTestOtherA-318969881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a425af93-c49d-46e6-95cc-6240c1ec5f43 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:38:05 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-23cf5bf8-5a21-4cc3-9c81-bf7da42cc7ce tempest-VolumesTestJSON-1340158169 None] Volume volume-13d1e96e-d79a-4728-ab25-4ca47964c695 (13d1e96e-d79a-4728-ab25-4ca47964c695): created successfully
Jul 09 14:38:05 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-23cf5bf8-5a21-4cc3-9c81-bf7da42cc7ce tempest-VolumesTestJSON-1340158169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c35c7b3-65d2-44b7-98a3-f1df59682d8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:38:05 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-23cf5bf8-5a21-4cc3-9c81-bf7da42cc7ce tempest-VolumesTestJSON-1340158169 None] Flow 'volume_create_manager' (35eda074-32af-4ca4-ac12-cff76816a009) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:38:05 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-23cf5bf8-5a21-4cc3-9c81-bf7da42cc7ce tempest-VolumesTestJSON-1340158169 None] Created volume successfully.
Jul 09 14:38:05 devstack sudo[95274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a425af93-c49d-46e6-95cc-6240c1ec5f43
Jul 09 14:38:05 devstack sudo[95274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:38:05 devstack sudo[95270]: pam_unix(sudo:session): session closed for user root
Jul 09 14:38:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3686e69d-f3ab-42b6-9c6d-08dbc22ffbd8 tempest-VolumesSnapshotTestJSON-1821027228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2525802b-76f2-4dec-b821-7edce8151967" returned: 0 in 0.939s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:38:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3686e69d-f3ab-42b6-9c6d-08dbc22ffbd8 tempest-VolumesSnapshotTestJSON-1821027228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2525802b-76f2-4dec-b821-7edce8151967.01b8da93-49d7-4ac8-86b9-031ccaec829c {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:38:05 devstack sudo[95280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2525802b-76f2-4dec-b821-7edce8151967.01b8da93-49d7-4ac8-86b9-031ccaec829c
Jul 09 14:38:05 devstack sudo[95280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:38:06 devstack sudo[95274]: pam_unix(sudo:session): session closed for user root
Jul 09 14:38:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-093eaeab-9a4a-4188-adba-f5d8f7aa4a32 req-b5d9a23e-8d13-4384-91fd-fa38e6b37e77 tempest-ServerActionsTestOtherA-318969881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a425af93-c49d-46e6-95cc-6240c1ec5f43" returned: 0 in 0.891s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:38:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-093eaeab-9a4a-4188-adba-f5d8f7aa4a32 req-b5d9a23e-8d13-4384-91fd-fa38e6b37e77 tempest-ServerActionsTestOtherA-318969881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.945s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:38:06 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-093eaeab-9a4a-4188-adba-f5d8f7aa4a32 req-b5d9a23e-8d13-4384-91fd-fa38e6b37e77 tempest-ServerActionsTestOtherA-318969881 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653', 'name': 'volume-a425af93-c49d-46e6-95cc-6240c1ec5f43', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0b345c64-d4e0-4f6c-a64a-8738a5a277c3', 'enforce_multipath': True} {{(pid=87230) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 09 14:38:06 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-093eaeab-9a4a-4188-adba-f5d8f7aa4a32 req-b5d9a23e-8d13-4384-91fd-fa38e6b37e77 tempest-ServerActionsTestOtherA-318969881 None] attachment_update completed successfully.
Jul 09 14:38:06 devstack sudo[95280]: pam_unix(sudo:session): session closed for user root
Jul 09 14:38:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3686e69d-f3ab-42b6-9c6d-08dbc22ffbd8 tempest-VolumesSnapshotTestJSON-1821027228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2525802b-76f2-4dec-b821-7edce8151967.01b8da93-49d7-4ac8-86b9-031ccaec829c" returned: 0 in 0.898s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:38:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3686e69d-f3ab-42b6-9c6d-08dbc22ffbd8 tempest-VolumesSnapshotTestJSON-1821027228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2525802b-76f2-4dec-b821-7edce8151967.01b8da93-49d7-4ac8-86b9-031ccaec829c {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:38:06 devstack sudo[95289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2525802b-76f2-4dec-b821-7edce8151967.01b8da93-49d7-4ac8-86b9-031ccaec829c
Jul 09 14:38:06 devstack sudo[95289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:38:06 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5fdc788-9af3-48b8-a4ae-3dff18e1cbef tempest-VolumesTestJSON-1340158169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:38:06 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b5fdc788-9af3-48b8-a4ae-3dff18e1cbef tempest-VolumesTestJSON-1340158169 None] Flow 'volume_create_manager' (a1c5bb33-5d7d-44c7-8511-20a787e510b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:38:06 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b5fdc788-9af3-48b8-a4ae-3dff18e1cbef tempest-VolumesTestJSON-1340158169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bce299c9-789e-47d4-a69c-ab555b708e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:38:06 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b5fdc788-9af3-48b8-a4ae-3dff18e1cbef tempest-VolumesTestJSON-1340158169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bce299c9-789e-47d4-a69c-ab555b708e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:38:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-331343941',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac16d823-f435-4f33-a5d4-6d986b928a09,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3c5e2f42096a4a26a899c505651f740f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:38:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:38:07Z,use_quota=True,user_id='aa2e0103e625442388070430a620dde6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:38:06 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b5fdc788-9af3-48b8-a4ae-3dff18e1cbef tempest-VolumesTestJSON-1340158169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd76235c-f99f-46b3-94fe-0566109e1e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:38:06 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b5fdc788-9af3-48b8-a4ae-3dff18e1cbef tempest-VolumesTestJSON-1340158169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd76235c-f99f-46b3-94fe-0566109e1e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:38:06 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b5fdc788-9af3-48b8-a4ae-3dff18e1cbef tempest-VolumesTestJSON-1340158169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac1b1f03-0445-4439-84b4-24a0538c86c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:38:07 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b5fdc788-9af3-48b8-a4ae-3dff18e1cbef tempest-VolumesTestJSON-1340158169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac1b1f03-0445-4439-84b4-24a0538c86c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac16d823-f435-4f33-a5d4-6d986b928a09', 'volume_name': 'volume-ac16d823-f435-4f33-a5d4-6d986b928a09', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:38:07 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b5fdc788-9af3-48b8-a4ae-3dff18e1cbef tempest-VolumesTestJSON-1340158169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4714ffbf-6480-41c4-8613-fcaeef7ff69c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:38:07 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b5fdc788-9af3-48b8-a4ae-3dff18e1cbef tempest-VolumesTestJSON-1340158169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4714ffbf-6480-41c4-8613-fcaeef7ff69c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:38:07 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b5fdc788-9af3-48b8-a4ae-3dff18e1cbef tempest-VolumesTestJSON-1340158169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11b7f9d9-0ed1-40fb-b771-a1708e69c92b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:38:07 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-b5fdc788-9af3-48b8-a4ae-3dff18e1cbef tempest-VolumesTestJSON-1340158169 None] Volume ac16d823-f435-4f33-a5d4-6d986b928a09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac16d823-f435-4f33-a5d4-6d986b928a09', 'volume_size': 1}
Jul 09 14:38:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b5fdc788-9af3-48b8-a4ae-3dff18e1cbef tempest-VolumesTestJSON-1340158169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:38:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b5fdc788-9af3-48b8-a4ae-3dff18e1cbef tempest-VolumesTestJSON-1340158169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:38:07 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b5fdc788-9af3-48b8-a4ae-3dff18e1cbef tempest-VolumesTestJSON-1340158169 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:38:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-331343941',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac16d823-f435-4f33-a5d4-6d986b928a09,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3c5e2f42096a4a26a899c505651f740f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:38:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:38:07Z,use_quota=True,user_id='aa2e0103e625442388070430a620dde6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:38:07 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-b5fdc788-9af3-48b8-a4ae-3dff18e1cbef tempest-VolumesTestJSON-1340158169 None] Creating volume ac16d823-f435-4f33-a5d4-6d986b928a09 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:38:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b5fdc788-9af3-48b8-a4ae-3dff18e1cbef tempest-VolumesTestJSON-1340158169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:38:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b5fdc788-9af3-48b8-a4ae-3dff18e1cbef tempest-VolumesTestJSON-1340158169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:38:07 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b5fdc788-9af3-48b8-a4ae-3dff18e1cbef tempest-VolumesTestJSON-1340158169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:38:07 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b5fdc788-9af3-48b8-a4ae-3dff18e1cbef tempest-VolumesTestJSON-1340158169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:38:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b5fdc788-9af3-48b8-a4ae-3dff18e1cbef tempest-VolumesTestJSON-1340158169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:38:07 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b5fdc788-9af3-48b8-a4ae-3dff18e1cbef tempest-VolumesTestJSON-1340158169 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:38:07 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-b5fdc788-9af3-48b8-a4ae-3dff18e1cbef tempest-VolumesTestJSON-1340158169 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:38:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b5fdc788-9af3-48b8-a4ae-3dff18e1cbef tempest-VolumesTestJSON-1340158169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ac16d823-f435-4f33-a5d4-6d986b928a09 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:38:07 devstack sudo[95291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ac16d823-f435-4f33-a5d4-6d986b928a09 1073741824
Jul 09 14:38:07 devstack sudo[95291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:38:07 devstack sudo[95289]: pam_unix(sudo:session): session closed for user root
Jul 09 14:38:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3686e69d-f3ab-42b6-9c6d-08dbc22ffbd8 tempest-VolumesSnapshotTestJSON-1821027228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2525802b-76f2-4dec-b821-7edce8151967.01b8da93-49d7-4ac8-86b9-031ccaec829c" returned: 0 in 0.798s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:38:07 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3686e69d-f3ab-42b6-9c6d-08dbc22ffbd8 tempest-VolumesSnapshotTestJSON-1821027228 None] Lock "cinder-quobyte-01b8da93-49d7-4ac8-86b9-031ccaec829c" released by "_delete_snapshot" :: held 3.597s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:38:07 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3686e69d-f3ab-42b6-9c6d-08dbc22ffbd8 tempest-VolumesSnapshotTestJSON-1821027228 None] Lock "cinder-quobyte-2525802b-76f2-4dec-b821-7edce8151967" released by "delete_snapshot" :: held 3.629s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:38:07 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-3686e69d-f3ab-42b6-9c6d-08dbc22ffbd8 tempest-VolumesSnapshotTestJSON-1821027228 None] Created reservations ['dcae35db-43d0-427b-a17c-02f3109c4d72', 'cd92fc49-856e-4b62-a09c-3a029c3cc8c8', '6191735f-7809-4939-8040-2c5961ac83ec', '09c7abb7-83ee-4f0c-b62c-6fe2116ea7a0'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:38:07 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-3686e69d-f3ab-42b6-9c6d-08dbc22ffbd8 tempest-VolumesSnapshotTestJSON-1821027228 None] Delete snapshot completed successfully.
Jul 09 14:38:07 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3686e69d-f3ab-42b6-9c6d-08dbc22ffbd8 tempest-VolumesSnapshotTestJSON-1821027228 None] Lock "cinder-01b8da93-49d7-4ac8-86b9-031ccaec829c-delete_snapshot" released by "delete_snapshot" :: held 3.869s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:38:07 devstack sudo[95291]: pam_unix(sudo:session): session closed for user root
Jul 09 14:38:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b5fdc788-9af3-48b8-a4ae-3dff18e1cbef tempest-VolumesTestJSON-1340158169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ac16d823-f435-4f33-a5d4-6d986b928a09 1073741824" returned: 0 in 0.960s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:38:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b5fdc788-9af3-48b8-a4ae-3dff18e1cbef tempest-VolumesTestJSON-1340158169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ac16d823-f435-4f33-a5d4-6d986b928a09 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:38:08 devstack sudo[95301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ac16d823-f435-4f33-a5d4-6d986b928a09
Jul 09 14:38:08 devstack sudo[95301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:38:08 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-109aebcb-95d6-4752-a16d-50bba5561bfb tempest-VolumesSnapshotTestJSON-1821027228 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:38:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-109aebcb-95d6-4752-a16d-50bba5561bfb tempest-VolumesSnapshotTestJSON-1821027228 None] Flow 'volume_create_manager' (73fad0b4-298e-4ae8-b01a-b793f56d9728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:38:08 devstack sudo[95301]: pam_unix(sudo:session): session closed for user root
Jul 09 14:38:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-109aebcb-95d6-4752-a16d-50bba5561bfb tempest-VolumesSnapshotTestJSON-1821027228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba31987c-535a-4836-8f15-96396640f624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:38:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b5fdc788-9af3-48b8-a4ae-3dff18e1cbef tempest-VolumesTestJSON-1340158169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ac16d823-f435-4f33-a5d4-6d986b928a09" returned: 0 in 0.935s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:38:08 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b5fdc788-9af3-48b8-a4ae-3dff18e1cbef tempest-VolumesTestJSON-1340158169 None] <== create_volume: return (1951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:38:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b5fdc788-9af3-48b8-a4ae-3dff18e1cbef tempest-VolumesTestJSON-1340158169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.954s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:38:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-109aebcb-95d6-4752-a16d-50bba5561bfb tempest-VolumesSnapshotTestJSON-1821027228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba31987c-535a-4836-8f15-96396640f624) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:38:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1043341369',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0911541f-6cbc-4e66-9c59-a47599442bad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='082e6a77a8814f3c845e798e70c9a807',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:38:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:38:09Z,use_quota=True,user_id='5f6a22de2293401292f13d9e333940ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:38:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-109aebcb-95d6-4752-a16d-50bba5561bfb tempest-VolumesSnapshotTestJSON-1821027228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee871e76-fe1a-45a5-a83b-c8374b8ebcb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:38:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-109aebcb-95d6-4752-a16d-50bba5561bfb tempest-VolumesSnapshotTestJSON-1821027228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee871e76-fe1a-45a5-a83b-c8374b8ebcb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:38:09 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-109aebcb-95d6-4752-a16d-50bba5561bfb tempest-VolumesSnapshotTestJSON-1821027228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44303ca7-1df1-4e9f-ad29-ac4935fdc527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:38:09 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-109aebcb-95d6-4752-a16d-50bba5561bfb tempest-VolumesSnapshotTestJSON-1821027228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44303ca7-1df1-4e9f-ad29-ac4935fdc527) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0911541f-6cbc-4e66-9c59-a47599442bad', 'volume_name': 'volume-0911541f-6cbc-4e66-9c59-a47599442bad', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:38:09 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-109aebcb-95d6-4752-a16d-50bba5561bfb tempest-VolumesSnapshotTestJSON-1821027228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a821976a-7f28-48ce-8d4b-45e97ec5cf06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:38:09 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-109aebcb-95d6-4752-a16d-50bba5561bfb tempest-VolumesSnapshotTestJSON-1821027228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a821976a-7f28-48ce-8d4b-45e97ec5cf06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:38:09 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-109aebcb-95d6-4752-a16d-50bba5561bfb tempest-VolumesSnapshotTestJSON-1821027228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8826c727-e617-4100-83f7-42a5d62aadd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:38:09 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-109aebcb-95d6-4752-a16d-50bba5561bfb tempest-VolumesSnapshotTestJSON-1821027228 None] Volume 0911541f-6cbc-4e66-9c59-a47599442bad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0911541f-6cbc-4e66-9c59-a47599442bad', 'volume_size': 1}
Jul 09 14:38:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-109aebcb-95d6-4752-a16d-50bba5561bfb tempest-VolumesSnapshotTestJSON-1821027228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:38:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-109aebcb-95d6-4752-a16d-50bba5561bfb tempest-VolumesSnapshotTestJSON-1821027228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:38:09 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-109aebcb-95d6-4752-a16d-50bba5561bfb tempest-VolumesSnapshotTestJSON-1821027228 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:38:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1043341369',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0911541f-6cbc-4e66-9c59-a47599442bad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='082e6a77a8814f3c845e798e70c9a807',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:38:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:38:09Z,use_quota=True,user_id='5f6a22de2293401292f13d9e333940ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:38:09 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-109aebcb-95d6-4752-a16d-50bba5561bfb tempest-VolumesSnapshotTestJSON-1821027228 None] Creating volume 0911541f-6cbc-4e66-9c59-a47599442bad {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:38:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-109aebcb-95d6-4752-a16d-50bba5561bfb tempest-VolumesSnapshotTestJSON-1821027228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:38:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-109aebcb-95d6-4752-a16d-50bba5561bfb tempest-VolumesSnapshotTestJSON-1821027228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:38:09 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-109aebcb-95d6-4752-a16d-50bba5561bfb tempest-VolumesSnapshotTestJSON-1821027228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:38:09 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-109aebcb-95d6-4752-a16d-50bba5561bfb tempest-VolumesSnapshotTestJSON-1821027228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:38:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-109aebcb-95d6-4752-a16d-50bba5561bfb tempest-VolumesSnapshotTestJSON-1821027228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:38:09 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-109aebcb-95d6-4752-a16d-50bba5561bfb tempest-VolumesSnapshotTestJSON-1821027228 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:38:09 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-109aebcb-95d6-4752-a16d-50bba5561bfb tempest-VolumesSnapshotTestJSON-1821027228 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:38:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-109aebcb-95d6-4752-a16d-50bba5561bfb tempest-VolumesSnapshotTestJSON-1821027228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0911541f-6cbc-4e66-9c59-a47599442bad 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:38:09 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b5fdc788-9af3-48b8-a4ae-3dff18e1cbef tempest-VolumesTestJSON-1340158169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11b7f9d9-0ed1-40fb-b771-a1708e69c92b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac16d823-f435-4f33-a5d4-6d986b928a09', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:38:09 devstack sudo[95320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0911541f-6cbc-4e66-9c59-a47599442bad 1073741824
Jul 09 14:38:09 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b5fdc788-9af3-48b8-a4ae-3dff18e1cbef tempest-VolumesTestJSON-1340158169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1d0abc3-0fe5-47af-a6a3-e1c8c4e8da23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:38:09 devstack sudo[95320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:38:09 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-b5fdc788-9af3-48b8-a4ae-3dff18e1cbef tempest-VolumesTestJSON-1340158169 None] Volume volume-ac16d823-f435-4f33-a5d4-6d986b928a09 (ac16d823-f435-4f33-a5d4-6d986b928a09): created successfully
Jul 09 14:38:09 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b5fdc788-9af3-48b8-a4ae-3dff18e1cbef tempest-VolumesTestJSON-1340158169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1d0abc3-0fe5-47af-a6a3-e1c8c4e8da23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:38:09 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b5fdc788-9af3-48b8-a4ae-3dff18e1cbef tempest-VolumesTestJSON-1340158169 None] Flow 'volume_create_manager' (a1c5bb33-5d7d-44c7-8511-20a787e510b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:38:09 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-b5fdc788-9af3-48b8-a4ae-3dff18e1cbef tempest-VolumesTestJSON-1340158169 None] Created volume successfully.
Jul 09 14:38:09 devstack sudo[95320]: pam_unix(sudo:session): session closed for user root
Jul 09 14:38:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-109aebcb-95d6-4752-a16d-50bba5561bfb tempest-VolumesSnapshotTestJSON-1821027228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0911541f-6cbc-4e66-9c59-a47599442bad 1073741824" returned: 0 in 0.928s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:38:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-109aebcb-95d6-4752-a16d-50bba5561bfb tempest-VolumesSnapshotTestJSON-1821027228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0911541f-6cbc-4e66-9c59-a47599442bad {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:38:10 devstack sudo[95394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0911541f-6cbc-4e66-9c59-a47599442bad
Jul 09 14:38:10 devstack sudo[95394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:38:10 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa671895-5e5c-4723-aade-a7bb2ab23be4 tempest-VolumesTestJSON-1340158169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:38:10 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-aa671895-5e5c-4723-aade-a7bb2ab23be4 tempest-VolumesTestJSON-1340158169 None] Flow 'volume_create_manager' (ebc22ecf-aef2-424d-a321-cb2efa41f572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:38:10 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-aa671895-5e5c-4723-aade-a7bb2ab23be4 tempest-VolumesTestJSON-1340158169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c8fe4bd-45df-47bc-8b4b-e5635daff2f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:38:10 devstack sudo[95394]: pam_unix(sudo:session): session closed for user root
Jul 09 14:38:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-109aebcb-95d6-4752-a16d-50bba5561bfb tempest-VolumesSnapshotTestJSON-1821027228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0911541f-6cbc-4e66-9c59-a47599442bad" returned: 0 in 0.886s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:38:10 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-109aebcb-95d6-4752-a16d-50bba5561bfb tempest-VolumesSnapshotTestJSON-1821027228 None] <== create_volume: return (1868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:38:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-109aebcb-95d6-4752-a16d-50bba5561bfb tempest-VolumesSnapshotTestJSON-1821027228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.870s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:38:10 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-aa671895-5e5c-4723-aade-a7bb2ab23be4 tempest-VolumesTestJSON-1340158169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c8fe4bd-45df-47bc-8b4b-e5635daff2f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:38:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-688874288',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50303ae9-9f35-4ebf-a80f-e39c9011d39f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3c5e2f42096a4a26a899c505651f740f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:38:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:38:11Z,use_quota=True,user_id='aa2e0103e625442388070430a620dde6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:38:10 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-aa671895-5e5c-4723-aade-a7bb2ab23be4 tempest-VolumesTestJSON-1340158169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01355eb7-3b3e-428b-93f9-155ad514119c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:38:10 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-aa671895-5e5c-4723-aade-a7bb2ab23be4 tempest-VolumesTestJSON-1340158169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01355eb7-3b3e-428b-93f9-155ad514119c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:38:10 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-aa671895-5e5c-4723-aade-a7bb2ab23be4 tempest-VolumesTestJSON-1340158169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (058082a8-a776-485c-808a-d8e6ec091c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:38:10 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-aa671895-5e5c-4723-aade-a7bb2ab23be4 tempest-VolumesTestJSON-1340158169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (058082a8-a776-485c-808a-d8e6ec091c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50303ae9-9f35-4ebf-a80f-e39c9011d39f', 'volume_name': 'volume-50303ae9-9f35-4ebf-a80f-e39c9011d39f', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:38:10 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-aa671895-5e5c-4723-aade-a7bb2ab23be4 tempest-VolumesTestJSON-1340158169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fdaa5d3-d9ba-4de9-9774-18a1c8d64428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:38:10 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-aa671895-5e5c-4723-aade-a7bb2ab23be4 tempest-VolumesTestJSON-1340158169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fdaa5d3-d9ba-4de9-9774-18a1c8d64428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:38:10 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-aa671895-5e5c-4723-aade-a7bb2ab23be4 tempest-VolumesTestJSON-1340158169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7538eac6-1445-49d4-9e7b-dc2c53ec4e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:38:10 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-aa671895-5e5c-4723-aade-a7bb2ab23be4 tempest-VolumesTestJSON-1340158169 None] Volume 50303ae9-9f35-4ebf-a80f-e39c9011d39f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50303ae9-9f35-4ebf-a80f-e39c9011d39f', 'volume_size': 1}
Jul 09 14:38:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-aa671895-5e5c-4723-aade-a7bb2ab23be4 tempest-VolumesTestJSON-1340158169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:38:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-aa671895-5e5c-4723-aade-a7bb2ab23be4 tempest-VolumesTestJSON-1340158169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:38:10 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-aa671895-5e5c-4723-aade-a7bb2ab23be4 tempest-VolumesTestJSON-1340158169 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:38:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-688874288',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50303ae9-9f35-4ebf-a80f-e39c9011d39f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3c5e2f42096a4a26a899c505651f740f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:38:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:38:11Z,use_quota=True,user_id='aa2e0103e625442388070430a620dde6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:38:10 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-aa671895-5e5c-4723-aade-a7bb2ab23be4 tempest-VolumesTestJSON-1340158169 None] Creating volume 50303ae9-9f35-4ebf-a80f-e39c9011d39f {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:38:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-aa671895-5e5c-4723-aade-a7bb2ab23be4 tempest-VolumesTestJSON-1340158169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:38:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-aa671895-5e5c-4723-aade-a7bb2ab23be4 tempest-VolumesTestJSON-1340158169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:38:10 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-aa671895-5e5c-4723-aade-a7bb2ab23be4 tempest-VolumesTestJSON-1340158169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:38:10 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-aa671895-5e5c-4723-aade-a7bb2ab23be4 tempest-VolumesTestJSON-1340158169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:38:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-aa671895-5e5c-4723-aade-a7bb2ab23be4 tempest-VolumesTestJSON-1340158169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:38:10 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-aa671895-5e5c-4723-aade-a7bb2ab23be4 tempest-VolumesTestJSON-1340158169 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:38:10 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-aa671895-5e5c-4723-aade-a7bb2ab23be4 tempest-VolumesTestJSON-1340158169 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:38:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-aa671895-5e5c-4723-aade-a7bb2ab23be4 tempest-VolumesTestJSON-1340158169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-50303ae9-9f35-4ebf-a80f-e39c9011d39f 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:38:11 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-109aebcb-95d6-4752-a16d-50bba5561bfb tempest-VolumesSnapshotTestJSON-1821027228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8826c727-e617-4100-83f7-42a5d62aadd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0911541f-6cbc-4e66-9c59-a47599442bad', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:38:11 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-109aebcb-95d6-4752-a16d-50bba5561bfb tempest-VolumesSnapshotTestJSON-1821027228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bf3917e-c376-4675-9ff8-50268682f245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:38:11 devstack sudo[95417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-50303ae9-9f35-4ebf-a80f-e39c9011d39f 1073741824
Jul 09 14:38:11 devstack sudo[95417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:38:11 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-109aebcb-95d6-4752-a16d-50bba5561bfb tempest-VolumesSnapshotTestJSON-1821027228 None] Volume volume-0911541f-6cbc-4e66-9c59-a47599442bad (0911541f-6cbc-4e66-9c59-a47599442bad): created successfully
Jul 09 14:38:11 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-109aebcb-95d6-4752-a16d-50bba5561bfb tempest-VolumesSnapshotTestJSON-1821027228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bf3917e-c376-4675-9ff8-50268682f245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:38:11 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-109aebcb-95d6-4752-a16d-50bba5561bfb tempest-VolumesSnapshotTestJSON-1821027228 None] Flow 'volume_create_manager' (73fad0b4-298e-4ae8-b01a-b793f56d9728) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:38:11 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-109aebcb-95d6-4752-a16d-50bba5561bfb tempest-VolumesSnapshotTestJSON-1821027228 None] Created volume successfully.
Jul 09 14:38:11 devstack sudo[95417]: pam_unix(sudo:session): session closed for user root
Jul 09 14:38:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-aa671895-5e5c-4723-aade-a7bb2ab23be4 tempest-VolumesTestJSON-1340158169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-50303ae9-9f35-4ebf-a80f-e39c9011d39f 1073741824" returned: 0 in 0.887s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:38:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-aa671895-5e5c-4723-aade-a7bb2ab23be4 tempest-VolumesTestJSON-1340158169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-50303ae9-9f35-4ebf-a80f-e39c9011d39f {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:38:11 devstack sudo[95424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-50303ae9-9f35-4ebf-a80f-e39c9011d39f
Jul 09 14:38:11 devstack sudo[95424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:38:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-15b106fd-e527-43c0-9241-9ad9fb9a6260 tempest-VolumesSnapshotTestJSON-1821027228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:38:12 devstack sudo[95424]: pam_unix(sudo:session): session closed for user root
Jul 09 14:38:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-aa671895-5e5c-4723-aade-a7bb2ab23be4 tempest-VolumesTestJSON-1340158169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-50303ae9-9f35-4ebf-a80f-e39c9011d39f" returned: 0 in 0.752s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:38:12 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-aa671895-5e5c-4723-aade-a7bb2ab23be4 tempest-VolumesTestJSON-1340158169 None] <== create_volume: return (1675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:38:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-aa671895-5e5c-4723-aade-a7bb2ab23be4 tempest-VolumesTestJSON-1340158169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.678s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:38:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-15b106fd-e527-43c0-9241-9ad9fb9a6260 tempest-VolumesSnapshotTestJSON-1821027228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.376s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:38:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-aa671895-5e5c-4723-aade-a7bb2ab23be4 tempest-VolumesTestJSON-1340158169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7538eac6-1445-49d4-9e7b-dc2c53ec4e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50303ae9-9f35-4ebf-a80f-e39c9011d39f', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:38:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-aa671895-5e5c-4723-aade-a7bb2ab23be4 tempest-VolumesTestJSON-1340158169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5afa4eab-0270-4bea-aae0-17b28e075770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:38:12 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-15b106fd-e527-43c0-9241-9ad9fb9a6260 tempest-VolumesSnapshotTestJSON-1821027228 None] Creating offline snapshot 5d8acfac-38d1-4c8e-9c57-dce9cded6102 of volume 0911541f-6cbc-4e66-9c59-a47599442bad {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 14:38:12 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-aa671895-5e5c-4723-aade-a7bb2ab23be4 tempest-VolumesTestJSON-1340158169 None] Volume volume-50303ae9-9f35-4ebf-a80f-e39c9011d39f (50303ae9-9f35-4ebf-a80f-e39c9011d39f): created successfully
Jul 09 14:38:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-aa671895-5e5c-4723-aade-a7bb2ab23be4 tempest-VolumesTestJSON-1340158169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5afa4eab-0270-4bea-aae0-17b28e075770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:38:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-aa671895-5e5c-4723-aade-a7bb2ab23be4 tempest-VolumesTestJSON-1340158169 None] Flow 'volume_create_manager' (ebc22ecf-aef2-424d-a321-cb2efa41f572) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:38:12 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[56cf7b34-8b79-466a-a4ac-306d7202adfa]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:38:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-15b106fd-e527-43c0-9241-9ad9fb9a6260 tempest-VolumesSnapshotTestJSON-1821027228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0911541f-6cbc-4e66-9c59-a47599442bad {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:38:12 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-aa671895-5e5c-4723-aade-a7bb2ab23be4 tempest-VolumesTestJSON-1340158169 None] Created volume successfully.
Jul 09 14:38:12 devstack sudo[95760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0911541f-6cbc-4e66-9c59-a47599442bad
Jul 09 14:38:12 devstack sudo[95760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:38:13 devstack sudo[95760]: pam_unix(sudo:session): session closed for user root
Jul 09 14:38:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-15b106fd-e527-43c0-9241-9ad9fb9a6260 tempest-VolumesSnapshotTestJSON-1821027228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0911541f-6cbc-4e66-9c59-a47599442bad" returned: 0 in 1.162s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:38:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-15b106fd-e527-43c0-9241-9ad9fb9a6260 tempest-VolumesSnapshotTestJSON-1821027228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0911541f-6cbc-4e66-9c59-a47599442bad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0911541f-6cbc-4e66-9c59-a47599442bad.5d8acfac-38d1-4c8e-9c57-dce9cded6102 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:38:13 devstack sudo[95769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0911541f-6cbc-4e66-9c59-a47599442bad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0911541f-6cbc-4e66-9c59-a47599442bad.5d8acfac-38d1-4c8e-9c57-dce9cded6102 1G
Jul 09 14:38:13 devstack sudo[95769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:38:14 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-2c82b42a-09d8-4146-b9ad-f5c4c762a281 tempest-VolumesTestJSON-1340158169 None] Acquiring lock "cinder-50303ae9-9f35-4ebf-a80f-e39c9011d39f-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:38:14 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-2c82b42a-09d8-4146-b9ad-f5c4c762a281 tempest-VolumesTestJSON-1340158169 None] Lock "cinder-50303ae9-9f35-4ebf-a80f-e39c9011d39f-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:38:14 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-2c82b42a-09d8-4146-b9ad-f5c4c762a281 tempest-VolumesTestJSON-1340158169 None] Acquiring lock "cinder-quobyte-50303ae9-9f35-4ebf-a80f-e39c9011d39f" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:38:14 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-2c82b42a-09d8-4146-b9ad-f5c4c762a281 tempest-VolumesTestJSON-1340158169 None] Lock "cinder-quobyte-50303ae9-9f35-4ebf-a80f-e39c9011d39f" acquired by "delete_volume" :: waited 0.037s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:38:14 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[48392ea5-3ed1-45ab-bf10-a81985fbcac2]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:38:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2c82b42a-09d8-4146-b9ad-f5c4c762a281 tempest-VolumesTestJSON-1340158169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-50303ae9-9f35-4ebf-a80f-e39c9011d39f {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:38:15 devstack sudo[95774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-50303ae9-9f35-4ebf-a80f-e39c9011d39f
Jul 09 14:38:15 devstack sudo[95774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:38:16 devstack sudo[95769]: pam_unix(sudo:session): session closed for user root
Jul 09 14:38:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-15b106fd-e527-43c0-9241-9ad9fb9a6260 tempest-VolumesSnapshotTestJSON-1821027228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0911541f-6cbc-4e66-9c59-a47599442bad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0911541f-6cbc-4e66-9c59-a47599442bad.5d8acfac-38d1-4c8e-9c57-dce9cded6102 1G" returned: 0 in 2.200s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:38:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-15b106fd-e527-43c0-9241-9ad9fb9a6260 tempest-VolumesSnapshotTestJSON-1821027228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0911541f-6cbc-4e66-9c59-a47599442bad -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0911541f-6cbc-4e66-9c59-a47599442bad.5d8acfac-38d1-4c8e-9c57-dce9cded6102 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:38:16 devstack sudo[95795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0911541f-6cbc-4e66-9c59-a47599442bad -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0911541f-6cbc-4e66-9c59-a47599442bad.5d8acfac-38d1-4c8e-9c57-dce9cded6102
Jul 09 14:38:16 devstack sudo[95795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:38:16 devstack sudo[95774]: pam_unix(sudo:session): session closed for user root
Jul 09 14:38:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2c82b42a-09d8-4146-b9ad-f5c4c762a281 tempest-VolumesTestJSON-1340158169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-50303ae9-9f35-4ebf-a80f-e39c9011d39f" returned: 0 in 1.388s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:38:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2c82b42a-09d8-4146-b9ad-f5c4c762a281 tempest-VolumesTestJSON-1340158169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-50303ae9-9f35-4ebf-a80f-e39c9011d39f {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:38:16 devstack sudo[95799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-50303ae9-9f35-4ebf-a80f-e39c9011d39f
Jul 09 14:38:16 devstack sudo[95799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:38:17 devstack sudo[95795]: pam_unix(sudo:session): session closed for user root
Jul 09 14:38:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-15b106fd-e527-43c0-9241-9ad9fb9a6260 tempest-VolumesSnapshotTestJSON-1821027228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0911541f-6cbc-4e66-9c59-a47599442bad -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0911541f-6cbc-4e66-9c59-a47599442bad.5d8acfac-38d1-4c8e-9c57-dce9cded6102" returned: 0 in 0.963s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:38:17 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-15b106fd-e527-43c0-9241-9ad9fb9a6260 tempest-VolumesSnapshotTestJSON-1821027228 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0911541f-6cbc-4e66-9c59-a47599442bad.5d8acfac-38d1-4c8e-9c57-dce9cded6102 is being set with open permissions: ugo+rw
Jul 09 14:38:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-15b106fd-e527-43c0-9241-9ad9fb9a6260 tempest-VolumesSnapshotTestJSON-1821027228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0911541f-6cbc-4e66-9c59-a47599442bad.5d8acfac-38d1-4c8e-9c57-dce9cded6102 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:38:17 devstack sudo[95805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0911541f-6cbc-4e66-9c59-a47599442bad.5d8acfac-38d1-4c8e-9c57-dce9cded6102
Jul 09 14:38:17 devstack sudo[95805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:38:17 devstack sudo[95799]: pam_unix(sudo:session): session closed for user root
Jul 09 14:38:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2c82b42a-09d8-4146-b9ad-f5c4c762a281 tempest-VolumesTestJSON-1340158169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-50303ae9-9f35-4ebf-a80f-e39c9011d39f" returned: 0 in 0.927s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:38:17 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-2c82b42a-09d8-4146-b9ad-f5c4c762a281 tempest-VolumesTestJSON-1340158169 None] Lock "cinder-quobyte-50303ae9-9f35-4ebf-a80f-e39c9011d39f" released by "delete_volume" :: held 2.401s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:38:17 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=80,cinder:INSERT=16,cinder:UPDATE=84,cinder:DELETE=7 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 14:38:17 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=73,cinder:UPDATE=70,cinder:INSERT=20,cinder:DELETE=6 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 14:38:17 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-2c82b42a-09d8-4146-b9ad-f5c4c762a281 tempest-VolumesTestJSON-1340158169 None] Created reservations ['7aa038d5-0916-49a3-ac0e-c2ee182a3284', '5d2f0a89-f6a2-400d-9c00-f2a5ae3b35ed', '2720b903-776b-4e01-9c49-f1906a0ee2bd', 'f43d16ea-30a6-463d-aa61-4118e2214338'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:38:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-2c82b42a-09d8-4146-b9ad-f5c4c762a281 tempest-VolumesTestJSON-1340158169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:38:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-2c82b42a-09d8-4146-b9ad-f5c4c762a281 tempest-VolumesTestJSON-1340158169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:38:17 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-2c82b42a-09d8-4146-b9ad-f5c4c762a281 tempest-VolumesTestJSON-1340158169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:38:17 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-2c82b42a-09d8-4146-b9ad-f5c4c762a281 tempest-VolumesTestJSON-1340158169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:38:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-2c82b42a-09d8-4146-b9ad-f5c4c762a281 tempest-VolumesTestJSON-1340158169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:38:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2c82b42a-09d8-4146-b9ad-f5c4c762a281 tempest-VolumesTestJSON-1340158169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:38:17 devstack sudo[95808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:38:17 devstack sudo[95808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:38:17 devstack sudo[95805]: pam_unix(sudo:session): session closed for user root
Jul 09 14:38:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-15b106fd-e527-43c0-9241-9ad9fb9a6260 tempest-VolumesSnapshotTestJSON-1821027228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0911541f-6cbc-4e66-9c59-a47599442bad.5d8acfac-38d1-4c8e-9c57-dce9cded6102" returned: 0 in 0.829s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:38:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-15b106fd-e527-43c0-9241-9ad9fb9a6260 tempest-VolumesSnapshotTestJSON-1821027228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0911541f-6cbc-4e66-9c59-a47599442bad.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:38:17 devstack sudo[95811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0911541f-6cbc-4e66-9c59-a47599442bad.info
Jul 09 14:38:17 devstack sudo[95811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:38:18 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3d38948a-26bb-45cb-b5ed-fa54a6c0ebb8 tempest-VolumesTestJSON-1340158169 None] Acquiring lock "cinder-ac16d823-f435-4f33-a5d4-6d986b928a09-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:38:18 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3d38948a-26bb-45cb-b5ed-fa54a6c0ebb8 tempest-VolumesTestJSON-1340158169 None] Lock "cinder-ac16d823-f435-4f33-a5d4-6d986b928a09-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:38:18 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3d38948a-26bb-45cb-b5ed-fa54a6c0ebb8 tempest-VolumesTestJSON-1340158169 None] Acquiring lock "cinder-quobyte-ac16d823-f435-4f33-a5d4-6d986b928a09" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:38:18 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3d38948a-26bb-45cb-b5ed-fa54a6c0ebb8 tempest-VolumesTestJSON-1340158169 None] Lock "cinder-quobyte-ac16d823-f435-4f33-a5d4-6d986b928a09" acquired by "delete_volume" :: waited 0.023s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:38:18 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[60fe37e5-432e-4d29-88c9-8089ba949a88]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:38:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3d38948a-26bb-45cb-b5ed-fa54a6c0ebb8 tempest-VolumesTestJSON-1340158169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ac16d823-f435-4f33-a5d4-6d986b928a09 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:38:18 devstack sudo[95808]: pam_unix(sudo:session): session closed for user root
Jul 09 14:38:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2c82b42a-09d8-4146-b9ad-f5c4c762a281 tempest-VolumesTestJSON-1340158169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.902s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:38:18 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-2c82b42a-09d8-4146-b9ad-f5c4c762a281 tempest-VolumesTestJSON-1340158169 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:38:18 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-2c82b42a-09d8-4146-b9ad-f5c4c762a281 tempest-VolumesTestJSON-1340158169 None] Deleted volume successfully.
Jul 09 14:38:18 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-2c82b42a-09d8-4146-b9ad-f5c4c762a281 tempest-VolumesTestJSON-1340158169 None] Lock "cinder-50303ae9-9f35-4ebf-a80f-e39c9011d39f-delete_volume" released by "delete_volume" :: held 3.651s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:38:18 devstack sudo[95814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ac16d823-f435-4f33-a5d4-6d986b928a09
Jul 09 14:38:18 devstack sudo[95814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:38:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-15b106fd-e527-43c0-9241-9ad9fb9a6260 tempest-VolumesSnapshotTestJSON-1821027228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0911541f-6cbc-4e66-9c59-a47599442bad.info" returned: 0 in 0.893s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:38:18 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-15b106fd-e527-43c0-9241-9ad9fb9a6260 tempest-VolumesSnapshotTestJSON-1821027228 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0911541f-6cbc-4e66-9c59-a47599442bad.info is being set with open permissions: ugo+rw
Jul 09 14:38:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-15b106fd-e527-43c0-9241-9ad9fb9a6260 tempest-VolumesSnapshotTestJSON-1821027228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0911541f-6cbc-4e66-9c59-a47599442bad.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:38:18 devstack sudo[95811]: pam_unix(sudo:session): session closed for user root
Jul 09 14:38:18 devstack sudo[95817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0911541f-6cbc-4e66-9c59-a47599442bad.info
Jul 09 14:38:18 devstack sudo[95817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:38:19 devstack sudo[95814]: pam_unix(sudo:session): session closed for user root
Jul 09 14:38:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3d38948a-26bb-45cb-b5ed-fa54a6c0ebb8 tempest-VolumesTestJSON-1340158169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ac16d823-f435-4f33-a5d4-6d986b928a09" returned: 0 in 1.042s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:38:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3d38948a-26bb-45cb-b5ed-fa54a6c0ebb8 tempest-VolumesTestJSON-1340158169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ac16d823-f435-4f33-a5d4-6d986b928a09 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:38:19 devstack sudo[95823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ac16d823-f435-4f33-a5d4-6d986b928a09
Jul 09 14:38:19 devstack sudo[95823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:38:19 devstack sudo[95817]: pam_unix(sudo:session): session closed for user root
Jul 09 14:38:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-15b106fd-e527-43c0-9241-9ad9fb9a6260 tempest-VolumesSnapshotTestJSON-1821027228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0911541f-6cbc-4e66-9c59-a47599442bad.info" returned: 0 in 0.759s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:38:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-15b106fd-e527-43c0-9241-9ad9fb9a6260 tempest-VolumesSnapshotTestJSON-1821027228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.946s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:38:19 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-15b106fd-e527-43c0-9241-9ad9fb9a6260 tempest-VolumesSnapshotTestJSON-1821027228 None] Create snapshot completed successfully
Jul 09 14:38:20 devstack sudo[95823]: pam_unix(sudo:session): session closed for user root
Jul 09 14:38:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3d38948a-26bb-45cb-b5ed-fa54a6c0ebb8 tempest-VolumesTestJSON-1340158169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ac16d823-f435-4f33-a5d4-6d986b928a09" returned: 0 in 0.664s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:38:20 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3d38948a-26bb-45cb-b5ed-fa54a6c0ebb8 tempest-VolumesTestJSON-1340158169 None] Lock "cinder-quobyte-ac16d823-f435-4f33-a5d4-6d986b928a09" released by "delete_volume" :: held 1.756s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:38:20 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-3d38948a-26bb-45cb-b5ed-fa54a6c0ebb8 tempest-VolumesTestJSON-1340158169 None] Created reservations ['fcd051c1-e27c-48ac-a835-e1d73539a19e', '58426a93-0a27-41f4-b668-a7a16dd4e3f7', '02f2c1d1-e0a0-440d-bdc6-cc521811da9a', '6a2a3b24-8000-47b9-b049-44c7b48f3e6a'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:38:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3d38948a-26bb-45cb-b5ed-fa54a6c0ebb8 tempest-VolumesTestJSON-1340158169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:38:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3d38948a-26bb-45cb-b5ed-fa54a6c0ebb8 tempest-VolumesTestJSON-1340158169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:38:20 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3d38948a-26bb-45cb-b5ed-fa54a6c0ebb8 tempest-VolumesTestJSON-1340158169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:38:20 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3d38948a-26bb-45cb-b5ed-fa54a6c0ebb8 tempest-VolumesTestJSON-1340158169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:38:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3d38948a-26bb-45cb-b5ed-fa54a6c0ebb8 tempest-VolumesTestJSON-1340158169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:38:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3d38948a-26bb-45cb-b5ed-fa54a6c0ebb8 tempest-VolumesTestJSON-1340158169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:38:20 devstack sudo[95828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:38:20 devstack sudo[95828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:38:20 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7e89201d-f680-4cb9-b765-50b3d35f9178 tempest-VolumesTestJSON-1340158169 None] Acquiring lock "cinder-13d1e96e-d79a-4728-ab25-4ca47964c695-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:38:20 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7e89201d-f680-4cb9-b765-50b3d35f9178 tempest-VolumesTestJSON-1340158169 None] Lock "cinder-13d1e96e-d79a-4728-ab25-4ca47964c695-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:38:20 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7e89201d-f680-4cb9-b765-50b3d35f9178 tempest-VolumesTestJSON-1340158169 None] Acquiring lock "cinder-quobyte-13d1e96e-d79a-4728-ab25-4ca47964c695" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:38:20 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7e89201d-f680-4cb9-b765-50b3d35f9178 tempest-VolumesTestJSON-1340158169 None] Lock "cinder-quobyte-13d1e96e-d79a-4728-ab25-4ca47964c695" acquired by "delete_volume" :: waited 0.025s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:38:20 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[69aa4d06-e37f-4219-9f5d-b088bcf66bb6]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:38:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7e89201d-f680-4cb9-b765-50b3d35f9178 tempest-VolumesTestJSON-1340158169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-13d1e96e-d79a-4728-ab25-4ca47964c695 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:38:20 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-615b759a-b5c3-4014-82ee-6c9e0caf3d55 tempest-VolumesSnapshotTestJSON-1821027228 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:38:21 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-615b759a-b5c3-4014-82ee-6c9e0caf3d55 tempest-VolumesSnapshotTestJSON-1821027228 None] Flow 'volume_create_manager' (1beef8a2-253d-4589-b3da-ae52ebb77d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:38:21 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-615b759a-b5c3-4014-82ee-6c9e0caf3d55 tempest-VolumesSnapshotTestJSON-1821027228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a58bf978-827e-4efd-b235-26ca2edef84f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:38:21 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-615b759a-b5c3-4014-82ee-6c9e0caf3d55 tempest-VolumesSnapshotTestJSON-1821027228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a58bf978-827e-4efd-b235-26ca2edef84f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:38:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1402824083',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4f58df2-c9d5-4f0a-8aac-c73e8e78ac25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='082e6a77a8814f3c845e798e70c9a807',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:38:21Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=5d8acfac-38d1-4c8e-9c57-dce9cded6102,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:38:21Z,use_quota=True,user_id='5f6a22de2293401292f13d9e333940ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:38:21 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-615b759a-b5c3-4014-82ee-6c9e0caf3d55 tempest-VolumesSnapshotTestJSON-1821027228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c0b854b-29e9-4f9c-808f-532faa534707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:38:21 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-615b759a-b5c3-4014-82ee-6c9e0caf3d55 tempest-VolumesSnapshotTestJSON-1821027228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c0b854b-29e9-4f9c-808f-532faa534707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:38:21 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-615b759a-b5c3-4014-82ee-6c9e0caf3d55 tempest-VolumesSnapshotTestJSON-1821027228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a31f7722-eb24-4c0b-a698-2a89dff00aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:38:21 devstack sudo[95858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-13d1e96e-d79a-4728-ab25-4ca47964c695
Jul 09 14:38:21 devstack sudo[95858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:38:21 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-615b759a-b5c3-4014-82ee-6c9e0caf3d55 tempest-VolumesSnapshotTestJSON-1821027228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a31f7722-eb24-4c0b-a698-2a89dff00aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd4f58df2-c9d5-4f0a-8aac-c73e8e78ac25', 'volume_name': 'volume-d4f58df2-c9d5-4f0a-8aac-c73e8e78ac25', 'volume_size': 2, 'snapshot_id': '5d8acfac-38d1-4c8e-9c57-dce9cded6102'}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:38:21 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-615b759a-b5c3-4014-82ee-6c9e0caf3d55 tempest-VolumesSnapshotTestJSON-1821027228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2f458e3-057e-4608-a428-cbc86f7edde6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:38:21 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-615b759a-b5c3-4014-82ee-6c9e0caf3d55 tempest-VolumesSnapshotTestJSON-1821027228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2f458e3-057e-4608-a428-cbc86f7edde6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:38:21 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-615b759a-b5c3-4014-82ee-6c9e0caf3d55 tempest-VolumesSnapshotTestJSON-1821027228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94a08036-1749-415e-bdb4-c5bbd53dae51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:38:21 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-615b759a-b5c3-4014-82ee-6c9e0caf3d55 tempest-VolumesSnapshotTestJSON-1821027228 None] Volume d4f58df2-c9d5-4f0a-8aac-c73e8e78ac25: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d4f58df2-c9d5-4f0a-8aac-c73e8e78ac25', 'volume_size': 2, 'snapshot_id': '5d8acfac-38d1-4c8e-9c57-dce9cded6102'}
Jul 09 14:38:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-615b759a-b5c3-4014-82ee-6c9e0caf3d55 tempest-VolumesSnapshotTestJSON-1821027228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:38:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-615b759a-b5c3-4014-82ee-6c9e0caf3d55 tempest-VolumesSnapshotTestJSON-1821027228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:38:21 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-615b759a-b5c3-4014-82ee-6c9e0caf3d55 tempest-VolumesSnapshotTestJSON-1821027228 None] Acquiring lock "cinder-quobyte-5d8acfac-38d1-4c8e-9c57-dce9cded6102-d4f58df2-c9d5-4f0a-8aac-c73e8e78ac25" by "_create_volume_from_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:38:21 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-615b759a-b5c3-4014-82ee-6c9e0caf3d55 tempest-VolumesSnapshotTestJSON-1821027228 None] Lock "cinder-quobyte-5d8acfac-38d1-4c8e-9c57-dce9cded6102-d4f58df2-c9d5-4f0a-8aac-c73e8e78ac25" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:38:21 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-615b759a-b5c3-4014-82ee-6c9e0caf3d55 tempest-VolumesSnapshotTestJSON-1821027228 None] Creating volume d4f58df2-c9d5-4f0a-8aac-c73e8e78ac25 from snapshot 5d8acfac-38d1-4c8e-9c57-dce9cded6102 {{(pid=87230) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 09 14:38:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-615b759a-b5c3-4014-82ee-6c9e0caf3d55 tempest-VolumesSnapshotTestJSON-1821027228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:38:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-615b759a-b5c3-4014-82ee-6c9e0caf3d55 tempest-VolumesSnapshotTestJSON-1821027228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:38:21 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-615b759a-b5c3-4014-82ee-6c9e0caf3d55 tempest-VolumesSnapshotTestJSON-1821027228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:38:21 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-615b759a-b5c3-4014-82ee-6c9e0caf3d55 tempest-VolumesSnapshotTestJSON-1821027228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:38:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-615b759a-b5c3-4014-82ee-6c9e0caf3d55 tempest-VolumesSnapshotTestJSON-1821027228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:38:21 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-615b759a-b5c3-4014-82ee-6c9e0caf3d55 tempest-VolumesSnapshotTestJSON-1821027228 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:38:21 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-615b759a-b5c3-4014-82ee-6c9e0caf3d55 tempest-VolumesSnapshotTestJSON-1821027228 None] Acquiring lock "cinder-quobyte-d4f58df2-c9d5-4f0a-8aac-c73e8e78ac25" by "_copy_volume_from_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:38:21 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-615b759a-b5c3-4014-82ee-6c9e0caf3d55 tempest-VolumesSnapshotTestJSON-1821027228 None] Lock "cinder-quobyte-d4f58df2-c9d5-4f0a-8aac-c73e8e78ac25" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:38:21 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-615b759a-b5c3-4014-82ee-6c9e0caf3d55 tempest-VolumesSnapshotTestJSON-1821027228 None] snapshot: 5d8acfac-38d1-4c8e-9c57-dce9cded6102, volume: d4f58df2-c9d5-4f0a-8aac-c73e8e78ac25,  {{(pid=87230) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 09 14:38:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-615b759a-b5c3-4014-82ee-6c9e0caf3d55 tempest-VolumesSnapshotTestJSON-1821027228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:38:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-615b759a-b5c3-4014-82ee-6c9e0caf3d55 tempest-VolumesSnapshotTestJSON-1821027228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:38:21 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-615b759a-b5c3-4014-82ee-6c9e0caf3d55 tempest-VolumesSnapshotTestJSON-1821027228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:38:21 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-615b759a-b5c3-4014-82ee-6c9e0caf3d55 tempest-VolumesSnapshotTestJSON-1821027228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:38:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-615b759a-b5c3-4014-82ee-6c9e0caf3d55 tempest-VolumesSnapshotTestJSON-1821027228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:38:21 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[b082e829-fa7a-467d-b094-29c797831356]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:38:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-615b759a-b5c3-4014-82ee-6c9e0caf3d55 tempest-VolumesSnapshotTestJSON-1821027228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0911541f-6cbc-4e66-9c59-a47599442bad.5d8acfac-38d1-4c8e-9c57-dce9cded6102 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:38:21 devstack sudo[95872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0911541f-6cbc-4e66-9c59-a47599442bad.5d8acfac-38d1-4c8e-9c57-dce9cded6102
Jul 09 14:38:21 devstack sudo[95872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:38:22 devstack sudo[95828]: pam_unix(sudo:session): session closed for user root
Jul 09 14:38:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3d38948a-26bb-45cb-b5ed-fa54a6c0ebb8 tempest-VolumesTestJSON-1340158169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 1.833s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:38:22 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-3d38948a-26bb-45cb-b5ed-fa54a6c0ebb8 tempest-VolumesTestJSON-1340158169 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:38:22 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-3d38948a-26bb-45cb-b5ed-fa54a6c0ebb8 tempest-VolumesTestJSON-1340158169 None] Deleted volume successfully.
Jul 09 14:38:22 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3d38948a-26bb-45cb-b5ed-fa54a6c0ebb8 tempest-VolumesTestJSON-1340158169 None] Lock "cinder-ac16d823-f435-4f33-a5d4-6d986b928a09-delete_volume" released by "delete_volume" :: held 3.930s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:38:22 devstack sudo[95858]: pam_unix(sudo:session): session closed for user root
Jul 09 14:38:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7e89201d-f680-4cb9-b765-50b3d35f9178 tempest-VolumesTestJSON-1340158169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-13d1e96e-d79a-4728-ab25-4ca47964c695" returned: 0 in 1.691s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:38:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7e89201d-f680-4cb9-b765-50b3d35f9178 tempest-VolumesTestJSON-1340158169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-13d1e96e-d79a-4728-ab25-4ca47964c695 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:38:22 devstack sudo[95909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-13d1e96e-d79a-4728-ab25-4ca47964c695
Jul 09 14:38:22 devstack sudo[95909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:38:22 devstack sudo[95872]: pam_unix(sudo:session): session closed for user root
Jul 09 14:38:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-615b759a-b5c3-4014-82ee-6c9e0caf3d55 tempest-VolumesSnapshotTestJSON-1821027228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0911541f-6cbc-4e66-9c59-a47599442bad.5d8acfac-38d1-4c8e-9c57-dce9cded6102" returned: 0 in 1.337s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:38:22 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-615b759a-b5c3-4014-82ee-6c9e0caf3d55 tempest-VolumesSnapshotTestJSON-1821027228 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0911541f-6cbc-4e66-9c59-a47599442bad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 14:38:22 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-615b759a-b5c3-4014-82ee-6c9e0caf3d55 tempest-VolumesSnapshotTestJSON-1821027228 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0911541f-6cbc-4e66-9c59-a47599442bad {{(pid=87230) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 09 14:38:22 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-615b759a-b5c3-4014-82ee-6c9e0caf3d55 tempest-VolumesSnapshotTestJSON-1821027228 None] Creating direct copy from snapshot {{(pid=87230) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 09 14:38:22 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[23fedf47-3d8e-4392-baf7-ff3482972ab1]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:38:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-615b759a-b5c3-4014-82ee-6c9e0caf3d55 tempest-VolumesSnapshotTestJSON-1821027228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0911541f-6cbc-4e66-9c59-a47599442bad {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:38:23 devstack sudo[95915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0911541f-6cbc-4e66-9c59-a47599442bad
Jul 09 14:38:23 devstack sudo[95915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:38:23 devstack sudo[95909]: pam_unix(sudo:session): session closed for user root
Jul 09 14:38:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7e89201d-f680-4cb9-b765-50b3d35f9178 tempest-VolumesTestJSON-1340158169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-13d1e96e-d79a-4728-ab25-4ca47964c695" returned: 0 in 1.040s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:38:23 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7e89201d-f680-4cb9-b765-50b3d35f9178 tempest-VolumesTestJSON-1340158169 None] Lock "cinder-quobyte-13d1e96e-d79a-4728-ab25-4ca47964c695" released by "delete_volume" :: held 2.831s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:38:23 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-7e89201d-f680-4cb9-b765-50b3d35f9178 tempest-VolumesTestJSON-1340158169 None] Created reservations ['a8299540-b914-4067-8163-eeb5055868fd', '4c8fa7c3-350d-4fe2-b843-05a7789223f9', '168367d6-56ef-49be-88e8-77c7ca2d5eec', '1319d6ef-85fc-4c08-bb72-195562a114e2'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:38:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7e89201d-f680-4cb9-b765-50b3d35f9178 tempest-VolumesTestJSON-1340158169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:38:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7e89201d-f680-4cb9-b765-50b3d35f9178 tempest-VolumesTestJSON-1340158169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:38:23 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7e89201d-f680-4cb9-b765-50b3d35f9178 tempest-VolumesTestJSON-1340158169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:38:23 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7e89201d-f680-4cb9-b765-50b3d35f9178 tempest-VolumesTestJSON-1340158169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:38:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7e89201d-f680-4cb9-b765-50b3d35f9178 tempest-VolumesTestJSON-1340158169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:38:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7e89201d-f680-4cb9-b765-50b3d35f9178 tempest-VolumesTestJSON-1340158169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:38:23 devstack sudo[95923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:38:23 devstack sudo[95923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:38:24 devstack sudo[95915]: pam_unix(sudo:session): session closed for user root
Jul 09 14:38:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-615b759a-b5c3-4014-82ee-6c9e0caf3d55 tempest-VolumesSnapshotTestJSON-1821027228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0911541f-6cbc-4e66-9c59-a47599442bad" returned: 0 in 1.312s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:38:24 devstack cinder-volume[87230]: DEBUG cinder.utils [None req-615b759a-b5c3-4014-82ee-6c9e0caf3d55 tempest-VolumesSnapshotTestJSON-1821027228 None] Path /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d4f58df2-c9d5-4f0a-8aac-c73e8e78ac25 not found in is_blk_device check {{(pid=87230) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 09 14:38:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-615b759a-b5c3-4014-82ee-6c9e0caf3d55 tempest-VolumesSnapshotTestJSON-1821027228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0911541f-6cbc-4e66-9c59-a47599442bad /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d4f58df2-c9d5-4f0a-8aac-c73e8e78ac25 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:38:24 devstack sudo[95927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0911541f-6cbc-4e66-9c59-a47599442bad /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d4f58df2-c9d5-4f0a-8aac-c73e8e78ac25
Jul 09 14:38:24 devstack sudo[95927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:38:24 devstack sudo[95923]: pam_unix(sudo:session): session closed for user root
Jul 09 14:38:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7e89201d-f680-4cb9-b765-50b3d35f9178 tempest-VolumesTestJSON-1340158169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.925s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:38:24 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-7e89201d-f680-4cb9-b765-50b3d35f9178 tempest-VolumesTestJSON-1340158169 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:38:24 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-7e89201d-f680-4cb9-b765-50b3d35f9178 tempest-VolumesTestJSON-1340158169 None] Deleted volume successfully.
Jul 09 14:38:24 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7e89201d-f680-4cb9-b765-50b3d35f9178 tempest-VolumesTestJSON-1340158169 None] Lock "cinder-13d1e96e-d79a-4728-ab25-4ca47964c695-delete_volume" released by "delete_volume" :: held 4.092s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:38:32 devstack sudo[95927]: pam_unix(sudo:session): session closed for user root
Jul 09 14:38:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-615b759a-b5c3-4014-82ee-6c9e0caf3d55 tempest-VolumesSnapshotTestJSON-1821027228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0911541f-6cbc-4e66-9c59-a47599442bad /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d4f58df2-c9d5-4f0a-8aac-c73e8e78ac25" returned: 0 in 8.785s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:38:32 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[a384d661-76a5-432f-9b11-6eb15d4160e2]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:38:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-615b759a-b5c3-4014-82ee-6c9e0caf3d55 tempest-VolumesSnapshotTestJSON-1821027228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0911541f-6cbc-4e66-9c59-a47599442bad {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:38:33 devstack sudo[96004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0911541f-6cbc-4e66-9c59-a47599442bad
Jul 09 14:38:33 devstack sudo[96004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:38:33 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=19,cinder:INSERT=10,cinder:UPDATE=24,cinder:DELETE=2 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 14:38:34 devstack sudo[96004]: pam_unix(sudo:session): session closed for user root
Jul 09 14:38:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-615b759a-b5c3-4014-82ee-6c9e0caf3d55 tempest-VolumesSnapshotTestJSON-1821027228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0911541f-6cbc-4e66-9c59-a47599442bad" returned: 0 in 1.134s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:38:34 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-615b759a-b5c3-4014-82ee-6c9e0caf3d55 tempest-VolumesSnapshotTestJSON-1821027228 None] Image conversion details: src /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0911541f-6cbc-4e66-9c59-a47599442bad, size 1024.00 MB, duration 8.79 sec, destination /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d4f58df2-c9d5-4f0a-8aac-c73e8e78ac25 {{(pid=87230) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 09 14:38:34 devstack cinder-volume[87230]: INFO cinder.image.image_utils [None req-615b759a-b5c3-4014-82ee-6c9e0caf3d55 tempest-VolumesSnapshotTestJSON-1821027228 None] Converted 1024.00 MB image at 116.54 MB/s
Jul 09 14:38:34 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-615b759a-b5c3-4014-82ee-6c9e0caf3d55 tempest-VolumesSnapshotTestJSON-1821027228 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d4f58df2-c9d5-4f0a-8aac-c73e8e78ac25 is being set with open permissions: ugo+rw
Jul 09 14:38:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-615b759a-b5c3-4014-82ee-6c9e0caf3d55 tempest-VolumesSnapshotTestJSON-1821027228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d4f58df2-c9d5-4f0a-8aac-c73e8e78ac25 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:38:34 devstack sudo[96009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d4f58df2-c9d5-4f0a-8aac-c73e8e78ac25
Jul 09 14:38:34 devstack sudo[96009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:38:34 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-38f36016-90bd-4d70-aabe-4cb2b03f0449 tempest-GroupSnapshotsV319Test-537745220 None] Group tempest-GroupSnapshotsV319Test-Group-196582700: creating
Jul 09 14:38:34 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-38f36016-90bd-4d70-aabe-4cb2b03f0449 tempest-GroupSnapshotsV319Test-537745220 None] Group tempest-GroupSnapshotsV319Test-Group-196582700: created successfully
Jul 09 14:38:34 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-38f36016-90bd-4d70-aabe-4cb2b03f0449 tempest-GroupSnapshotsV319Test-537745220 None] Create group completed successfully.
Jul 09 14:38:34 devstack sudo[96009]: pam_unix(sudo:session): session closed for user root
Jul 09 14:38:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-615b759a-b5c3-4014-82ee-6c9e0caf3d55 tempest-VolumesSnapshotTestJSON-1821027228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d4f58df2-c9d5-4f0a-8aac-c73e8e78ac25" returned: 0 in 0.671s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:38:34 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-615b759a-b5c3-4014-82ee-6c9e0caf3d55 tempest-VolumesSnapshotTestJSON-1821027228 None] Lock "cinder-quobyte-d4f58df2-c9d5-4f0a-8aac-c73e8e78ac25" released by "_copy_volume_from_snapshot" :: held 13.464s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:38:34 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-615b759a-b5c3-4014-82ee-6c9e0caf3d55 tempest-VolumesSnapshotTestJSON-1821027228 None] Lock "cinder-quobyte-5d8acfac-38d1-4c8e-9c57-dce9cded6102-d4f58df2-c9d5-4f0a-8aac-c73e8e78ac25" released by "_create_volume_from_snapshot" :: held 13.523s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:38:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-615b759a-b5c3-4014-82ee-6c9e0caf3d55 tempest-VolumesSnapshotTestJSON-1821027228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.544s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:38:34 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-615b759a-b5c3-4014-82ee-6c9e0caf3d55 tempest-VolumesSnapshotTestJSON-1821027228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94a08036-1749-415e-bdb4-c5bbd53dae51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4f58df2-c9d5-4f0a-8aac-c73e8e78ac25', 'volume_size': 2, 'snapshot_id': '5d8acfac-38d1-4c8e-9c57-dce9cded6102'}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:38:34 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-615b759a-b5c3-4014-82ee-6c9e0caf3d55 tempest-VolumesSnapshotTestJSON-1821027228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (382607cc-e58c-4654-8777-5d4583d0802f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:38:34 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-615b759a-b5c3-4014-82ee-6c9e0caf3d55 tempest-VolumesSnapshotTestJSON-1821027228 None] Volume volume-d4f58df2-c9d5-4f0a-8aac-c73e8e78ac25 (d4f58df2-c9d5-4f0a-8aac-c73e8e78ac25): created successfully
Jul 09 14:38:34 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-615b759a-b5c3-4014-82ee-6c9e0caf3d55 tempest-VolumesSnapshotTestJSON-1821027228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (382607cc-e58c-4654-8777-5d4583d0802f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:38:34 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-615b759a-b5c3-4014-82ee-6c9e0caf3d55 tempest-VolumesSnapshotTestJSON-1821027228 None] Flow 'volume_create_manager' (1beef8a2-253d-4589-b3da-ae52ebb77d93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:38:34 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-615b759a-b5c3-4014-82ee-6c9e0caf3d55 tempest-VolumesSnapshotTestJSON-1821027228 None] Created volume successfully.
Jul 09 14:38:35 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-ab5b72ef-fe78-4fae-a706-a82dbddf710a tempest-VolumesSnapshotTestJSON-1821027228 None] Acquiring lock "cinder-d4f58df2-c9d5-4f0a-8aac-c73e8e78ac25-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:38:35 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-ab5b72ef-fe78-4fae-a706-a82dbddf710a tempest-VolumesSnapshotTestJSON-1821027228 None] Lock "cinder-d4f58df2-c9d5-4f0a-8aac-c73e8e78ac25-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:38:35 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-ab5b72ef-fe78-4fae-a706-a82dbddf710a tempest-VolumesSnapshotTestJSON-1821027228 None] Acquiring lock "cinder-quobyte-d4f58df2-c9d5-4f0a-8aac-c73e8e78ac25" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:38:35 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-ab5b72ef-fe78-4fae-a706-a82dbddf710a tempest-VolumesSnapshotTestJSON-1821027228 None] Lock "cinder-quobyte-d4f58df2-c9d5-4f0a-8aac-c73e8e78ac25" acquired by "delete_volume" :: waited 0.014s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:38:35 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f9f343-41c9-4d1b-a32e-8e85a830e725]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:38:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ab5b72ef-fe78-4fae-a706-a82dbddf710a tempest-VolumesSnapshotTestJSON-1821027228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d4f58df2-c9d5-4f0a-8aac-c73e8e78ac25 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:38:35 devstack sudo[96012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d4f58df2-c9d5-4f0a-8aac-c73e8e78ac25
Jul 09 14:38:35 devstack sudo[96012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:38:36 devstack sudo[96012]: pam_unix(sudo:session): session closed for user root
Jul 09 14:38:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ab5b72ef-fe78-4fae-a706-a82dbddf710a tempest-VolumesSnapshotTestJSON-1821027228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d4f58df2-c9d5-4f0a-8aac-c73e8e78ac25" returned: 0 in 1.089s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:38:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ab5b72ef-fe78-4fae-a706-a82dbddf710a tempest-VolumesSnapshotTestJSON-1821027228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d4f58df2-c9d5-4f0a-8aac-c73e8e78ac25 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:38:36 devstack sudo[96017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d4f58df2-c9d5-4f0a-8aac-c73e8e78ac25
Jul 09 14:38:36 devstack sudo[96017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:38:36 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc78a822-05b8-45a8-b6e7-aa022fd64d57 tempest-GroupSnapshotsV319Test-537745220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:38:36 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-fc78a822-05b8-45a8-b6e7-aa022fd64d57 tempest-GroupSnapshotsV319Test-537745220 None] Flow 'volume_create_manager' (50037aba-3fa8-4113-9fda-8e6496c1220d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:38:36 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-fc78a822-05b8-45a8-b6e7-aa022fd64d57 tempest-GroupSnapshotsV319Test-537745220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4217e713-d06f-4c77-b34b-289444a1d56f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:38:36 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-fc78a822-05b8-45a8-b6e7-aa022fd64d57 tempest-GroupSnapshotsV319Test-537745220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4217e713-d06f-4c77-b34b-289444a1d56f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:38:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-116848245',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d982225f-288b-43d7-bb2a-209897e8d84f,host='devstack@QuobyteHD#QuobyteHD',id=b06ecd08-5146-488b-8981-9b1be61aa8ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4927e4fc02f24f1592c99ce4a931e027',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:38:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:38:36Z,use_quota=True,user_id='0f6ab12513e9409b932a93b80be2e2de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c08be0b3-6b68-40c7-955c-4752c2be3401),volume_type_id=c08be0b3-6b68-40c7-955c-4752c2be3401)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:38:36 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-fc78a822-05b8-45a8-b6e7-aa022fd64d57 tempest-GroupSnapshotsV319Test-537745220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edbfc192-7574-4e16-883c-5dee2162ae67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:38:36 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-fc78a822-05b8-45a8-b6e7-aa022fd64d57 tempest-GroupSnapshotsV319Test-537745220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edbfc192-7574-4e16-883c-5dee2162ae67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:38:36 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-fc78a822-05b8-45a8-b6e7-aa022fd64d57 tempest-GroupSnapshotsV319Test-537745220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2092ef7b-58b9-48eb-87f9-5788a2bf5233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:38:36 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-fc78a822-05b8-45a8-b6e7-aa022fd64d57 tempest-GroupSnapshotsV319Test-537745220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2092ef7b-58b9-48eb-87f9-5788a2bf5233) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b06ecd08-5146-488b-8981-9b1be61aa8ff', 'volume_name': 'volume-b06ecd08-5146-488b-8981-9b1be61aa8ff', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:38:36 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-fc78a822-05b8-45a8-b6e7-aa022fd64d57 tempest-GroupSnapshotsV319Test-537745220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bd8ec26-4fd0-4071-bf53-8b78a094c6aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:38:36 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-fc78a822-05b8-45a8-b6e7-aa022fd64d57 tempest-GroupSnapshotsV319Test-537745220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bd8ec26-4fd0-4071-bf53-8b78a094c6aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:38:36 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-fc78a822-05b8-45a8-b6e7-aa022fd64d57 tempest-GroupSnapshotsV319Test-537745220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5717504c-d40f-4048-bafa-a06888099ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:38:36 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-fc78a822-05b8-45a8-b6e7-aa022fd64d57 tempest-GroupSnapshotsV319Test-537745220 None] Volume b06ecd08-5146-488b-8981-9b1be61aa8ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b06ecd08-5146-488b-8981-9b1be61aa8ff', 'volume_size': 1}
Jul 09 14:38:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-fc78a822-05b8-45a8-b6e7-aa022fd64d57 tempest-GroupSnapshotsV319Test-537745220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:38:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-fc78a822-05b8-45a8-b6e7-aa022fd64d57 tempest-GroupSnapshotsV319Test-537745220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:38:36 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-fc78a822-05b8-45a8-b6e7-aa022fd64d57 tempest-GroupSnapshotsV319Test-537745220 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=d982225f-288b-43d7-bb2a-209897e8d84f,created_at=2026-07-09T12:38:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-116848245',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d982225f-288b-43d7-bb2a-209897e8d84f,host='devstack@QuobyteHD#QuobyteHD',id=b06ecd08-5146-488b-8981-9b1be61aa8ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4927e4fc02f24f1592c99ce4a931e027',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:38:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:38:36Z,use_quota=True,user_id='0f6ab12513e9409b932a93b80be2e2de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c08be0b3-6b68-40c7-955c-4752c2be3401),volume_type_id=c08be0b3-6b68-40c7-955c-4752c2be3401)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:38:36 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-fc78a822-05b8-45a8-b6e7-aa022fd64d57 tempest-GroupSnapshotsV319Test-537745220 None] Creating volume b06ecd08-5146-488b-8981-9b1be61aa8ff {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:38:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-fc78a822-05b8-45a8-b6e7-aa022fd64d57 tempest-GroupSnapshotsV319Test-537745220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:38:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-fc78a822-05b8-45a8-b6e7-aa022fd64d57 tempest-GroupSnapshotsV319Test-537745220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:38:36 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-fc78a822-05b8-45a8-b6e7-aa022fd64d57 tempest-GroupSnapshotsV319Test-537745220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:38:36 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-fc78a822-05b8-45a8-b6e7-aa022fd64d57 tempest-GroupSnapshotsV319Test-537745220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:38:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-fc78a822-05b8-45a8-b6e7-aa022fd64d57 tempest-GroupSnapshotsV319Test-537745220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:38:36 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-fc78a822-05b8-45a8-b6e7-aa022fd64d57 tempest-GroupSnapshotsV319Test-537745220 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:38:36 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-fc78a822-05b8-45a8-b6e7-aa022fd64d57 tempest-GroupSnapshotsV319Test-537745220 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:38:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fc78a822-05b8-45a8-b6e7-aa022fd64d57 tempest-GroupSnapshotsV319Test-537745220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b06ecd08-5146-488b-8981-9b1be61aa8ff 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:38:36 devstack sudo[96019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b06ecd08-5146-488b-8981-9b1be61aa8ff 1073741824
Jul 09 14:38:36 devstack sudo[96019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:38:37 devstack sudo[96017]: pam_unix(sudo:session): session closed for user root
Jul 09 14:38:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ab5b72ef-fe78-4fae-a706-a82dbddf710a tempest-VolumesSnapshotTestJSON-1821027228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d4f58df2-c9d5-4f0a-8aac-c73e8e78ac25" returned: 0 in 0.783s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:38:37 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-ab5b72ef-fe78-4fae-a706-a82dbddf710a tempest-VolumesSnapshotTestJSON-1821027228 None] Lock "cinder-quobyte-d4f58df2-c9d5-4f0a-8aac-c73e8e78ac25" released by "delete_volume" :: held 1.934s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:38:37 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-ab5b72ef-fe78-4fae-a706-a82dbddf710a tempest-VolumesSnapshotTestJSON-1821027228 None] Created reservations ['4fbd9ea0-8018-4d51-b53b-5bb05a3d9e7c', '865d10bc-c225-4a9a-8c1a-ab77f4ef8556', 'fff56276-ef39-4779-88e2-63b69d3f176e', 'e5fa688f-cf07-4445-9bbb-ba57b45b1231'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:38:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-ab5b72ef-fe78-4fae-a706-a82dbddf710a tempest-VolumesSnapshotTestJSON-1821027228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:38:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-ab5b72ef-fe78-4fae-a706-a82dbddf710a tempest-VolumesSnapshotTestJSON-1821027228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:38:37 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-ab5b72ef-fe78-4fae-a706-a82dbddf710a tempest-VolumesSnapshotTestJSON-1821027228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:38:37 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-ab5b72ef-fe78-4fae-a706-a82dbddf710a tempest-VolumesSnapshotTestJSON-1821027228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:38:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-ab5b72ef-fe78-4fae-a706-a82dbddf710a tempest-VolumesSnapshotTestJSON-1821027228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:38:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ab5b72ef-fe78-4fae-a706-a82dbddf710a tempest-VolumesSnapshotTestJSON-1821027228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:38:37 devstack sudo[96043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:38:37 devstack sudo[96043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:38:37 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-bea440e6-d502-42a7-bcff-781a081c53a7 tempest-VolumesSnapshotTestJSON-1821027228 None] Acquiring lock "cinder-5d8acfac-38d1-4c8e-9c57-dce9cded6102-delete_snapshot" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:38:37 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-bea440e6-d502-42a7-bcff-781a081c53a7 tempest-VolumesSnapshotTestJSON-1821027228 None] Lock "cinder-5d8acfac-38d1-4c8e-9c57-dce9cded6102-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:38:37 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-bea440e6-d502-42a7-bcff-781a081c53a7 tempest-VolumesSnapshotTestJSON-1821027228 None] Acquiring lock "cinder-quobyte-0911541f-6cbc-4e66-9c59-a47599442bad" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:38:37 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-bea440e6-d502-42a7-bcff-781a081c53a7 tempest-VolumesSnapshotTestJSON-1821027228 None] Lock "cinder-quobyte-0911541f-6cbc-4e66-9c59-a47599442bad" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:38:37 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-bea440e6-d502-42a7-bcff-781a081c53a7 tempest-VolumesSnapshotTestJSON-1821027228 None] Acquiring lock "cinder-quobyte-5d8acfac-38d1-4c8e-9c57-dce9cded6102" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:38:37 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-bea440e6-d502-42a7-bcff-781a081c53a7 tempest-VolumesSnapshotTestJSON-1821027228 None] Lock "cinder-quobyte-5d8acfac-38d1-4c8e-9c57-dce9cded6102" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:38:37 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-bea440e6-d502-42a7-bcff-781a081c53a7 tempest-VolumesSnapshotTestJSON-1821027228 None] Deleting offline snapshot 5d8acfac-38d1-4c8e-9c57-dce9cded6102 of volume 0911541f-6cbc-4e66-9c59-a47599442bad {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 14:38:37 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-bea440e6-d502-42a7-bcff-781a081c53a7 tempest-VolumesSnapshotTestJSON-1821027228 None] snapshot_file for this snap is: volume-0911541f-6cbc-4e66-9c59-a47599442bad.5d8acfac-38d1-4c8e-9c57-dce9cded6102 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 14:38:37 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[892cd1b4-b19f-417d-bd22-8ed4627ce170]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:38:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-bea440e6-d502-42a7-bcff-781a081c53a7 tempest-VolumesSnapshotTestJSON-1821027228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0911541f-6cbc-4e66-9c59-a47599442bad.5d8acfac-38d1-4c8e-9c57-dce9cded6102 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:38:37 devstack sudo[96019]: pam_unix(sudo:session): session closed for user root
Jul 09 14:38:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fc78a822-05b8-45a8-b6e7-aa022fd64d57 tempest-GroupSnapshotsV319Test-537745220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b06ecd08-5146-488b-8981-9b1be61aa8ff 1073741824" returned: 0 in 1.221s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:38:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fc78a822-05b8-45a8-b6e7-aa022fd64d57 tempest-GroupSnapshotsV319Test-537745220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b06ecd08-5146-488b-8981-9b1be61aa8ff {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:38:37 devstack sudo[96047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0911541f-6cbc-4e66-9c59-a47599442bad.5d8acfac-38d1-4c8e-9c57-dce9cded6102
Jul 09 14:38:37 devstack sudo[96047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:38:37 devstack sudo[96048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b06ecd08-5146-488b-8981-9b1be61aa8ff
Jul 09 14:38:37 devstack sudo[96048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:38:38 devstack sudo[96043]: pam_unix(sudo:session): session closed for user root
Jul 09 14:38:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ab5b72ef-fe78-4fae-a706-a82dbddf710a tempest-VolumesSnapshotTestJSON-1821027228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.952s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:38:38 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-ab5b72ef-fe78-4fae-a706-a82dbddf710a tempest-VolumesSnapshotTestJSON-1821027228 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:38:38 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-ab5b72ef-fe78-4fae-a706-a82dbddf710a tempest-VolumesSnapshotTestJSON-1821027228 None] Deleted volume successfully.
Jul 09 14:38:38 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-ab5b72ef-fe78-4fae-a706-a82dbddf710a tempest-VolumesSnapshotTestJSON-1821027228 None] Lock "cinder-d4f58df2-c9d5-4f0a-8aac-c73e8e78ac25-delete_volume" released by "delete_volume" :: held 3.158s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:38:38 devstack sudo[96048]: pam_unix(sudo:session): session closed for user root
Jul 09 14:38:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fc78a822-05b8-45a8-b6e7-aa022fd64d57 tempest-GroupSnapshotsV319Test-537745220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b06ecd08-5146-488b-8981-9b1be61aa8ff" returned: 0 in 0.810s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:38:38 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-fc78a822-05b8-45a8-b6e7-aa022fd64d57 tempest-GroupSnapshotsV319Test-537745220 None] <== create_volume: return (2106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:38:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-fc78a822-05b8-45a8-b6e7-aa022fd64d57 tempest-GroupSnapshotsV319Test-537745220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.109s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:38:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-fc78a822-05b8-45a8-b6e7-aa022fd64d57 tempest-GroupSnapshotsV319Test-537745220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5717504c-d40f-4048-bafa-a06888099ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b06ecd08-5146-488b-8981-9b1be61aa8ff', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:38:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-fc78a822-05b8-45a8-b6e7-aa022fd64d57 tempest-GroupSnapshotsV319Test-537745220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (366c3bfb-4d71-4f57-b70a-f08822af05bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:38:38 devstack sudo[96047]: pam_unix(sudo:session): session closed for user root
Jul 09 14:38:38 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-fc78a822-05b8-45a8-b6e7-aa022fd64d57 tempest-GroupSnapshotsV319Test-537745220 None] Volume volume-b06ecd08-5146-488b-8981-9b1be61aa8ff (b06ecd08-5146-488b-8981-9b1be61aa8ff): created successfully
Jul 09 14:38:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-fc78a822-05b8-45a8-b6e7-aa022fd64d57 tempest-GroupSnapshotsV319Test-537745220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (366c3bfb-4d71-4f57-b70a-f08822af05bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:38:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-fc78a822-05b8-45a8-b6e7-aa022fd64d57 tempest-GroupSnapshotsV319Test-537745220 None] Flow 'volume_create_manager' (50037aba-3fa8-4113-9fda-8e6496c1220d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:38:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-bea440e6-d502-42a7-bcff-781a081c53a7 tempest-VolumesSnapshotTestJSON-1821027228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0911541f-6cbc-4e66-9c59-a47599442bad.5d8acfac-38d1-4c8e-9c57-dce9cded6102" returned: 0 in 1.056s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:38:38 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-bea440e6-d502-42a7-bcff-781a081c53a7 tempest-VolumesSnapshotTestJSON-1821027228 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0911541f-6cbc-4e66-9c59-a47599442bad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 14:38:38 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-fc78a822-05b8-45a8-b6e7-aa022fd64d57 tempest-GroupSnapshotsV319Test-537745220 None] Created volume successfully.
Jul 09 14:38:38 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[eea84cef-597d-40c6-83c5-ab0db06bb670]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:38:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-bea440e6-d502-42a7-bcff-781a081c53a7 tempest-VolumesSnapshotTestJSON-1821027228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0911541f-6cbc-4e66-9c59-a47599442bad {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:38:38 devstack sudo[96094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0911541f-6cbc-4e66-9c59-a47599442bad
Jul 09 14:38:38 devstack sudo[96094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:38:39 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-c89c8a0a-75d3-4f46-aea5-bc3d61434a2b tempest-GroupSnapshotsV319Test-537745220 None] GroupSnapshot 96d4d655-b1da-4ab5-9c8f-3d1b8306b527: creating.
Jul 09 14:38:39 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c89c8a0a-75d3-4f46-aea5-bc3d61434a2b tempest-GroupSnapshotsV319Test-537745220 None] Group snapshot 96d4d655-b1da-4ab5-9c8f-3d1b8306b527: creating. {{(pid=87230) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jul 09 14:38:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c89c8a0a-75d3-4f46-aea5-bc3d61434a2b tempest-GroupSnapshotsV319Test-537745220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:38:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c89c8a0a-75d3-4f46-aea5-bc3d61434a2b tempest-GroupSnapshotsV319Test-537745220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:38:39 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-c89c8a0a-75d3-4f46-aea5-bc3d61434a2b tempest-GroupSnapshotsV319Test-537745220 None] Creating offline snapshot 27c6957e-fc95-4cb5-af56-0218e595b92e of volume b06ecd08-5146-488b-8981-9b1be61aa8ff {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 14:38:39 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[f139da42-80c3-4b1f-b7e6-ad9dc678f330]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:38:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c89c8a0a-75d3-4f46-aea5-bc3d61434a2b tempest-GroupSnapshotsV319Test-537745220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b06ecd08-5146-488b-8981-9b1be61aa8ff {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:38:39 devstack sudo[96097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b06ecd08-5146-488b-8981-9b1be61aa8ff
Jul 09 14:38:39 devstack sudo[96097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:38:39 devstack sudo[96094]: pam_unix(sudo:session): session closed for user root
Jul 09 14:38:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-bea440e6-d502-42a7-bcff-781a081c53a7 tempest-VolumesSnapshotTestJSON-1821027228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0911541f-6cbc-4e66-9c59-a47599442bad" returned: 0 in 0.804s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:38:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-bea440e6-d502-42a7-bcff-781a081c53a7 tempest-VolumesSnapshotTestJSON-1821027228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0911541f-6cbc-4e66-9c59-a47599442bad.5d8acfac-38d1-4c8e-9c57-dce9cded6102 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:38:39 devstack sudo[96102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0911541f-6cbc-4e66-9c59-a47599442bad.5d8acfac-38d1-4c8e-9c57-dce9cded6102
Jul 09 14:38:39 devstack sudo[96102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:38:40 devstack sudo[96097]: pam_unix(sudo:session): session closed for user root
Jul 09 14:38:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c89c8a0a-75d3-4f46-aea5-bc3d61434a2b tempest-GroupSnapshotsV319Test-537745220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b06ecd08-5146-488b-8981-9b1be61aa8ff" returned: 0 in 0.819s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:38:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c89c8a0a-75d3-4f46-aea5-bc3d61434a2b tempest-GroupSnapshotsV319Test-537745220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b06ecd08-5146-488b-8981-9b1be61aa8ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b06ecd08-5146-488b-8981-9b1be61aa8ff.27c6957e-fc95-4cb5-af56-0218e595b92e 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:38:40 devstack sudo[96108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b06ecd08-5146-488b-8981-9b1be61aa8ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b06ecd08-5146-488b-8981-9b1be61aa8ff.27c6957e-fc95-4cb5-af56-0218e595b92e 1G
Jul 09 14:38:40 devstack sudo[96108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:38:40 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-93357771-52be-457f-ad5d-9de668b3ab29 req-afb5411e-4722-4cfc-ad9b-0d34a30444b5 tempest-ServerActionsTestOtherA-318969881 None] Terminate volume connection completed successfully.
Jul 09 14:38:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-93357771-52be-457f-ad5d-9de668b3ab29 req-afb5411e-4722-4cfc-ad9b-0d34a30444b5 tempest-ServerActionsTestOtherA-318969881 None] Deleting attachment 0b345c64-d4e0-4f6c-a64a-8738a5a277c3. {{(pid=87230) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 09 14:38:40 devstack sudo[96102]: pam_unix(sudo:session): session closed for user root
Jul 09 14:38:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-bea440e6-d502-42a7-bcff-781a081c53a7 tempest-VolumesSnapshotTestJSON-1821027228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0911541f-6cbc-4e66-9c59-a47599442bad.5d8acfac-38d1-4c8e-9c57-dce9cded6102" returned: 0 in 0.879s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:38:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-bea440e6-d502-42a7-bcff-781a081c53a7 tempest-VolumesSnapshotTestJSON-1821027228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0911541f-6cbc-4e66-9c59-a47599442bad.5d8acfac-38d1-4c8e-9c57-dce9cded6102 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:38:40 devstack sudo[96116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0911541f-6cbc-4e66-9c59-a47599442bad.5d8acfac-38d1-4c8e-9c57-dce9cded6102
Jul 09 14:38:40 devstack sudo[96116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:38:40 devstack sudo[96108]: pam_unix(sudo:session): session closed for user root
Jul 09 14:38:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c89c8a0a-75d3-4f46-aea5-bc3d61434a2b tempest-GroupSnapshotsV319Test-537745220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b06ecd08-5146-488b-8981-9b1be61aa8ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b06ecd08-5146-488b-8981-9b1be61aa8ff.27c6957e-fc95-4cb5-af56-0218e595b92e 1G" returned: 0 in 0.882s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:38:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c89c8a0a-75d3-4f46-aea5-bc3d61434a2b tempest-GroupSnapshotsV319Test-537745220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b06ecd08-5146-488b-8981-9b1be61aa8ff -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b06ecd08-5146-488b-8981-9b1be61aa8ff.27c6957e-fc95-4cb5-af56-0218e595b92e {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:38:41 devstack sudo[96121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b06ecd08-5146-488b-8981-9b1be61aa8ff -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b06ecd08-5146-488b-8981-9b1be61aa8ff.27c6957e-fc95-4cb5-af56-0218e595b92e
Jul 09 14:38:41 devstack sudo[96121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:38:41 devstack sudo[96116]: pam_unix(sudo:session): session closed for user root
Jul 09 14:38:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-bea440e6-d502-42a7-bcff-781a081c53a7 tempest-VolumesSnapshotTestJSON-1821027228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0911541f-6cbc-4e66-9c59-a47599442bad.5d8acfac-38d1-4c8e-9c57-dce9cded6102" returned: 0 in 0.697s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:38:41 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-bea440e6-d502-42a7-bcff-781a081c53a7 tempest-VolumesSnapshotTestJSON-1821027228 None] Lock "cinder-quobyte-5d8acfac-38d1-4c8e-9c57-dce9cded6102" released by "_delete_snapshot" :: held 3.573s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:38:41 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-bea440e6-d502-42a7-bcff-781a081c53a7 tempest-VolumesSnapshotTestJSON-1821027228 None] Lock "cinder-quobyte-0911541f-6cbc-4e66-9c59-a47599442bad" released by "delete_snapshot" :: held 3.624s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:38:41 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-bea440e6-d502-42a7-bcff-781a081c53a7 tempest-VolumesSnapshotTestJSON-1821027228 None] Created reservations ['efd1c4cb-cfcc-49c1-8357-cd1a66ac984f', '1e5ff260-7dd2-467b-a9d6-9cfd2e59dc4b', '3f84e63c-fb26-4831-92c1-a214b93d123f', 'ee325142-e0ce-4a03-9ae7-74654c35cb1a'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:38:41 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-bea440e6-d502-42a7-bcff-781a081c53a7 tempest-VolumesSnapshotTestJSON-1821027228 None] Delete snapshot completed successfully.
Jul 09 14:38:41 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-bea440e6-d502-42a7-bcff-781a081c53a7 tempest-VolumesSnapshotTestJSON-1821027228 None] Lock "cinder-5d8acfac-38d1-4c8e-9c57-dce9cded6102-delete_snapshot" released by "delete_snapshot" :: held 3.789s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:38:41 devstack sudo[96121]: pam_unix(sudo:session): session closed for user root
Jul 09 14:38:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c89c8a0a-75d3-4f46-aea5-bc3d61434a2b tempest-GroupSnapshotsV319Test-537745220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b06ecd08-5146-488b-8981-9b1be61aa8ff -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b06ecd08-5146-488b-8981-9b1be61aa8ff.27c6957e-fc95-4cb5-af56-0218e595b92e" returned: 0 in 0.713s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:38:41 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-c89c8a0a-75d3-4f46-aea5-bc3d61434a2b tempest-GroupSnapshotsV319Test-537745220 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b06ecd08-5146-488b-8981-9b1be61aa8ff.27c6957e-fc95-4cb5-af56-0218e595b92e is being set with open permissions: ugo+rw: NotImplementedError
Jul 09 14:38:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c89c8a0a-75d3-4f46-aea5-bc3d61434a2b tempest-GroupSnapshotsV319Test-537745220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b06ecd08-5146-488b-8981-9b1be61aa8ff.27c6957e-fc95-4cb5-af56-0218e595b92e {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:38:41 devstack sudo[96128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b06ecd08-5146-488b-8981-9b1be61aa8ff.27c6957e-fc95-4cb5-af56-0218e595b92e
Jul 09 14:38:41 devstack sudo[96128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:38:41 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b0ef3653-c9d9-4b30-9597-94704ae316a3 tempest-VolumesSnapshotTestJSON-1821027228 None] Acquiring lock "cinder-0911541f-6cbc-4e66-9c59-a47599442bad-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:38:41 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b0ef3653-c9d9-4b30-9597-94704ae316a3 tempest-VolumesSnapshotTestJSON-1821027228 None] Lock "cinder-0911541f-6cbc-4e66-9c59-a47599442bad-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:38:41 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b0ef3653-c9d9-4b30-9597-94704ae316a3 tempest-VolumesSnapshotTestJSON-1821027228 None] Acquiring lock "cinder-quobyte-0911541f-6cbc-4e66-9c59-a47599442bad" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:38:41 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b0ef3653-c9d9-4b30-9597-94704ae316a3 tempest-VolumesSnapshotTestJSON-1821027228 None] Lock "cinder-quobyte-0911541f-6cbc-4e66-9c59-a47599442bad" acquired by "delete_volume" :: waited 0.015s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:38:41 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f8ec4f9-dd56-43e6-a640-241b722d8809]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:38:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b0ef3653-c9d9-4b30-9597-94704ae316a3 tempest-VolumesSnapshotTestJSON-1821027228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0911541f-6cbc-4e66-9c59-a47599442bad {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:38:42 devstack sudo[96130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0911541f-6cbc-4e66-9c59-a47599442bad
Jul 09 14:38:42 devstack sudo[96130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:38:42 devstack sudo[96128]: pam_unix(sudo:session): session closed for user root
Jul 09 14:38:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c89c8a0a-75d3-4f46-aea5-bc3d61434a2b tempest-GroupSnapshotsV319Test-537745220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b06ecd08-5146-488b-8981-9b1be61aa8ff.27c6957e-fc95-4cb5-af56-0218e595b92e" returned: 0 in 0.783s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:38:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c89c8a0a-75d3-4f46-aea5-bc3d61434a2b tempest-GroupSnapshotsV319Test-537745220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b06ecd08-5146-488b-8981-9b1be61aa8ff.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:38:42 devstack sudo[96134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b06ecd08-5146-488b-8981-9b1be61aa8ff.info
Jul 09 14:38:42 devstack sudo[96134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:38:42 devstack sudo[96130]: pam_unix(sudo:session): session closed for user root
Jul 09 14:38:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b0ef3653-c9d9-4b30-9597-94704ae316a3 tempest-VolumesSnapshotTestJSON-1821027228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0911541f-6cbc-4e66-9c59-a47599442bad" returned: 0 in 0.841s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:38:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b0ef3653-c9d9-4b30-9597-94704ae316a3 tempest-VolumesSnapshotTestJSON-1821027228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0911541f-6cbc-4e66-9c59-a47599442bad {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:38:42 devstack sudo[96139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0911541f-6cbc-4e66-9c59-a47599442bad
Jul 09 14:38:42 devstack sudo[96139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:38:43 devstack sudo[96134]: pam_unix(sudo:session): session closed for user root
Jul 09 14:38:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c89c8a0a-75d3-4f46-aea5-bc3d61434a2b tempest-GroupSnapshotsV319Test-537745220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b06ecd08-5146-488b-8981-9b1be61aa8ff.info" returned: 0 in 0.675s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:38:43 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-c89c8a0a-75d3-4f46-aea5-bc3d61434a2b tempest-GroupSnapshotsV319Test-537745220 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b06ecd08-5146-488b-8981-9b1be61aa8ff.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 09 14:38:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c89c8a0a-75d3-4f46-aea5-bc3d61434a2b tempest-GroupSnapshotsV319Test-537745220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b06ecd08-5146-488b-8981-9b1be61aa8ff.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:38:43 devstack sudo[96142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b06ecd08-5146-488b-8981-9b1be61aa8ff.info
Jul 09 14:38:43 devstack sudo[96142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:38:43 devstack sudo[96139]: pam_unix(sudo:session): session closed for user root
Jul 09 14:38:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b0ef3653-c9d9-4b30-9597-94704ae316a3 tempest-VolumesSnapshotTestJSON-1821027228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0911541f-6cbc-4e66-9c59-a47599442bad" returned: 0 in 0.721s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:38:43 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b0ef3653-c9d9-4b30-9597-94704ae316a3 tempest-VolumesSnapshotTestJSON-1821027228 None] Lock "cinder-quobyte-0911541f-6cbc-4e66-9c59-a47599442bad" released by "delete_volume" :: held 1.626s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:38:43 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-b0ef3653-c9d9-4b30-9597-94704ae316a3 tempest-VolumesSnapshotTestJSON-1821027228 None] Created reservations ['7f2ee109-d30c-47d4-b85b-9a8832481fb8', 'c2fb338c-aed6-4b27-baaf-80778310f58f', '8b571b57-7fb7-432a-8f47-1c51d257a78e', '8d0cf190-66e0-4c17-8cc3-e7e37117c9c7'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:38:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b0ef3653-c9d9-4b30-9597-94704ae316a3 tempest-VolumesSnapshotTestJSON-1821027228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:38:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b0ef3653-c9d9-4b30-9597-94704ae316a3 tempest-VolumesSnapshotTestJSON-1821027228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:38:43 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b0ef3653-c9d9-4b30-9597-94704ae316a3 tempest-VolumesSnapshotTestJSON-1821027228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:38:43 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b0ef3653-c9d9-4b30-9597-94704ae316a3 tempest-VolumesSnapshotTestJSON-1821027228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:38:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b0ef3653-c9d9-4b30-9597-94704ae316a3 tempest-VolumesSnapshotTestJSON-1821027228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:38:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b0ef3653-c9d9-4b30-9597-94704ae316a3 tempest-VolumesSnapshotTestJSON-1821027228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:38:43 devstack sudo[96150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:38:43 devstack sudo[96150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:38:43 devstack sudo[96142]: pam_unix(sudo:session): session closed for user root
Jul 09 14:38:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c89c8a0a-75d3-4f46-aea5-bc3d61434a2b tempest-GroupSnapshotsV319Test-537745220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b06ecd08-5146-488b-8981-9b1be61aa8ff.info" returned: 0 in 0.778s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:38:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c89c8a0a-75d3-4f46-aea5-bc3d61434a2b tempest-GroupSnapshotsV319Test-537745220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.752s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:38:44 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-c89c8a0a-75d3-4f46-aea5-bc3d61434a2b tempest-GroupSnapshotsV319Test-537745220 None] group_snapshot 96d4d655-b1da-4ab5-9c8f-3d1b8306b527: created successfully
Jul 09 14:38:44 devstack sudo[96150]: pam_unix(sudo:session): session closed for user root
Jul 09 14:38:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b0ef3653-c9d9-4b30-9597-94704ae316a3 tempest-VolumesSnapshotTestJSON-1821027228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.827s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:38:44 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-b0ef3653-c9d9-4b30-9597-94704ae316a3 tempest-VolumesSnapshotTestJSON-1821027228 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:38:44 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-b0ef3653-c9d9-4b30-9597-94704ae316a3 tempest-VolumesSnapshotTestJSON-1821027228 None] Deleted volume successfully.
Jul 09 14:38:44 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b0ef3653-c9d9-4b30-9597-94704ae316a3 tempest-VolumesSnapshotTestJSON-1821027228 None] Lock "cinder-0911541f-6cbc-4e66-9c59-a47599442bad-delete_volume" released by "delete_volume" :: held 2.674s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:38:45 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1b2829a-af3e-4abb-b32c-2f9fbc1ffb97 tempest-VolumesSnapshotTestJSON-1821027228 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:38:45 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a1b2829a-af3e-4abb-b32c-2f9fbc1ffb97 tempest-VolumesSnapshotTestJSON-1821027228 None] Flow 'volume_create_manager' (6b35fbdc-dfb0-4aa6-be42-dcf8c683c2cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:38:45 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a1b2829a-af3e-4abb-b32c-2f9fbc1ffb97 tempest-VolumesSnapshotTestJSON-1821027228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8595fbb7-5788-4745-8ccc-aecebe5aa454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:38:45 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a1b2829a-af3e-4abb-b32c-2f9fbc1ffb97 tempest-VolumesSnapshotTestJSON-1821027228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8595fbb7-5788-4745-8ccc-aecebe5aa454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:38:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-759071791',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7494f569-aff5-4c6a-a3fb-5838e96343ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='082e6a77a8814f3c845e798e70c9a807',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:38:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:38:45Z,use_quota=True,user_id='5f6a22de2293401292f13d9e333940ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:38:45 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a1b2829a-af3e-4abb-b32c-2f9fbc1ffb97 tempest-VolumesSnapshotTestJSON-1821027228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11191ce5-af43-4018-89b8-f5764ec9ebc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:38:45 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a1b2829a-af3e-4abb-b32c-2f9fbc1ffb97 tempest-VolumesSnapshotTestJSON-1821027228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11191ce5-af43-4018-89b8-f5764ec9ebc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:38:45 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a1b2829a-af3e-4abb-b32c-2f9fbc1ffb97 tempest-VolumesSnapshotTestJSON-1821027228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f36db81-e232-4c85-998c-4b155fbb4c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:38:45 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a1b2829a-af3e-4abb-b32c-2f9fbc1ffb97 tempest-VolumesSnapshotTestJSON-1821027228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f36db81-e232-4c85-998c-4b155fbb4c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7494f569-aff5-4c6a-a3fb-5838e96343ff', 'volume_name': 'volume-7494f569-aff5-4c6a-a3fb-5838e96343ff', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:38:45 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a1b2829a-af3e-4abb-b32c-2f9fbc1ffb97 tempest-VolumesSnapshotTestJSON-1821027228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2abd9991-0d6e-4a3c-a26f-6a9c11cf283a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:38:45 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a1b2829a-af3e-4abb-b32c-2f9fbc1ffb97 tempest-VolumesSnapshotTestJSON-1821027228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2abd9991-0d6e-4a3c-a26f-6a9c11cf283a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:38:45 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a1b2829a-af3e-4abb-b32c-2f9fbc1ffb97 tempest-VolumesSnapshotTestJSON-1821027228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af0724d6-bc02-46bd-84b2-8440d9732822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:38:45 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-a1b2829a-af3e-4abb-b32c-2f9fbc1ffb97 tempest-VolumesSnapshotTestJSON-1821027228 None] Volume 7494f569-aff5-4c6a-a3fb-5838e96343ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7494f569-aff5-4c6a-a3fb-5838e96343ff', 'volume_size': 1}
Jul 09 14:38:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a1b2829a-af3e-4abb-b32c-2f9fbc1ffb97 tempest-VolumesSnapshotTestJSON-1821027228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:38:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a1b2829a-af3e-4abb-b32c-2f9fbc1ffb97 tempest-VolumesSnapshotTestJSON-1821027228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:38:45 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a1b2829a-af3e-4abb-b32c-2f9fbc1ffb97 tempest-VolumesSnapshotTestJSON-1821027228 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:38:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-759071791',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7494f569-aff5-4c6a-a3fb-5838e96343ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='082e6a77a8814f3c845e798e70c9a807',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:38:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:38:45Z,use_quota=True,user_id='5f6a22de2293401292f13d9e333940ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:38:45 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-a1b2829a-af3e-4abb-b32c-2f9fbc1ffb97 tempest-VolumesSnapshotTestJSON-1821027228 None] Creating volume 7494f569-aff5-4c6a-a3fb-5838e96343ff {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:38:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a1b2829a-af3e-4abb-b32c-2f9fbc1ffb97 tempest-VolumesSnapshotTestJSON-1821027228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:38:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a1b2829a-af3e-4abb-b32c-2f9fbc1ffb97 tempest-VolumesSnapshotTestJSON-1821027228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:38:45 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a1b2829a-af3e-4abb-b32c-2f9fbc1ffb97 tempest-VolumesSnapshotTestJSON-1821027228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:38:45 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a1b2829a-af3e-4abb-b32c-2f9fbc1ffb97 tempest-VolumesSnapshotTestJSON-1821027228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:38:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a1b2829a-af3e-4abb-b32c-2f9fbc1ffb97 tempest-VolumesSnapshotTestJSON-1821027228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:38:45 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a1b2829a-af3e-4abb-b32c-2f9fbc1ffb97 tempest-VolumesSnapshotTestJSON-1821027228 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:38:45 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-a1b2829a-af3e-4abb-b32c-2f9fbc1ffb97 tempest-VolumesSnapshotTestJSON-1821027228 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:38:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a1b2829a-af3e-4abb-b32c-2f9fbc1ffb97 tempest-VolumesSnapshotTestJSON-1821027228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7494f569-aff5-4c6a-a3fb-5838e96343ff 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:38:45 devstack sudo[96173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7494f569-aff5-4c6a-a3fb-5838e96343ff 1073741824
Jul 09 14:38:45 devstack sudo[96173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:38:45 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-6a1fe9ac-db15-46db-a557-aa4a804d0024 tempest-GroupSnapshotsV319Test-537745220 None] group_snapshot 96d4d655-b1da-4ab5-9c8f-3d1b8306b527: deleting
Jul 09 14:38:45 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6a1fe9ac-db15-46db-a557-aa4a804d0024 tempest-GroupSnapshotsV319Test-537745220 None] group_snapshot 96d4d655-b1da-4ab5-9c8f-3d1b8306b527: deleting {{(pid=87230) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jul 09 14:38:45 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-6a1fe9ac-db15-46db-a557-aa4a804d0024 tempest-GroupSnapshotsV319Test-537745220 None] Acquiring lock "cinder-quobyte-b06ecd08-5146-488b-8981-9b1be61aa8ff" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:38:45 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-6a1fe9ac-db15-46db-a557-aa4a804d0024 tempest-GroupSnapshotsV319Test-537745220 None] Lock "cinder-quobyte-b06ecd08-5146-488b-8981-9b1be61aa8ff" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:38:45 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-6a1fe9ac-db15-46db-a557-aa4a804d0024 tempest-GroupSnapshotsV319Test-537745220 None] Acquiring lock "cinder-quobyte-27c6957e-fc95-4cb5-af56-0218e595b92e" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:38:45 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-6a1fe9ac-db15-46db-a557-aa4a804d0024 tempest-GroupSnapshotsV319Test-537745220 None] Lock "cinder-quobyte-27c6957e-fc95-4cb5-af56-0218e595b92e" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:38:45 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-6a1fe9ac-db15-46db-a557-aa4a804d0024 tempest-GroupSnapshotsV319Test-537745220 None] Deleting offline snapshot 27c6957e-fc95-4cb5-af56-0218e595b92e of volume b06ecd08-5146-488b-8981-9b1be61aa8ff {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 14:38:45 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-6a1fe9ac-db15-46db-a557-aa4a804d0024 tempest-GroupSnapshotsV319Test-537745220 None] snapshot_file for this snap is: volume-b06ecd08-5146-488b-8981-9b1be61aa8ff.27c6957e-fc95-4cb5-af56-0218e595b92e {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 14:38:45 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac5a1a8-97fb-4bd0-a1b9-74e2d3a56037]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:38:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6a1fe9ac-db15-46db-a557-aa4a804d0024 tempest-GroupSnapshotsV319Test-537745220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b06ecd08-5146-488b-8981-9b1be61aa8ff.27c6957e-fc95-4cb5-af56-0218e595b92e {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:38:45 devstack sudo[96175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b06ecd08-5146-488b-8981-9b1be61aa8ff.27c6957e-fc95-4cb5-af56-0218e595b92e
Jul 09 14:38:45 devstack sudo[96175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:38:46 devstack sudo[96175]: pam_unix(sudo:session): session closed for user root
Jul 09 14:38:46 devstack sudo[96173]: pam_unix(sudo:session): session closed for user root
Jul 09 14:38:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6a1fe9ac-db15-46db-a557-aa4a804d0024 tempest-GroupSnapshotsV319Test-537745220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b06ecd08-5146-488b-8981-9b1be61aa8ff.27c6957e-fc95-4cb5-af56-0218e595b92e" returned: 0 in 1.010s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:38:46 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-6a1fe9ac-db15-46db-a557-aa4a804d0024 tempest-GroupSnapshotsV319Test-537745220 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b06ecd08-5146-488b-8981-9b1be61aa8ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 14:38:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a1b2829a-af3e-4abb-b32c-2f9fbc1ffb97 tempest-VolumesSnapshotTestJSON-1821027228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7494f569-aff5-4c6a-a3fb-5838e96343ff 1073741824" returned: 0 in 1.421s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:38:46 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b17178b-9cc3-40e7-9805-212d8e6420da]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:38:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6a1fe9ac-db15-46db-a557-aa4a804d0024 tempest-GroupSnapshotsV319Test-537745220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b06ecd08-5146-488b-8981-9b1be61aa8ff {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:38:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a1b2829a-af3e-4abb-b32c-2f9fbc1ffb97 tempest-VolumesSnapshotTestJSON-1821027228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7494f569-aff5-4c6a-a3fb-5838e96343ff {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:38:46 devstack sudo[96188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7494f569-aff5-4c6a-a3fb-5838e96343ff
Jul 09 14:38:46 devstack sudo[96188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:38:46 devstack sudo[96187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b06ecd08-5146-488b-8981-9b1be61aa8ff
Jul 09 14:38:46 devstack sudo[96187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:38:47 devstack sudo[96188]: pam_unix(sudo:session): session closed for user root
Jul 09 14:38:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a1b2829a-af3e-4abb-b32c-2f9fbc1ffb97 tempest-VolumesSnapshotTestJSON-1821027228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7494f569-aff5-4c6a-a3fb-5838e96343ff" returned: 0 in 0.687s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:38:47 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a1b2829a-af3e-4abb-b32c-2f9fbc1ffb97 tempest-VolumesSnapshotTestJSON-1821027228 None] <== create_volume: return (2177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:38:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a1b2829a-af3e-4abb-b32c-2f9fbc1ffb97 tempest-VolumesSnapshotTestJSON-1821027228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.180s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:38:47 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a1b2829a-af3e-4abb-b32c-2f9fbc1ffb97 tempest-VolumesSnapshotTestJSON-1821027228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af0724d6-bc02-46bd-84b2-8440d9732822) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7494f569-aff5-4c6a-a3fb-5838e96343ff', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:38:47 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a1b2829a-af3e-4abb-b32c-2f9fbc1ffb97 tempest-VolumesSnapshotTestJSON-1821027228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b58fe484-68f1-42a7-be1c-5dc5d05528a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:38:47 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-a1b2829a-af3e-4abb-b32c-2f9fbc1ffb97 tempest-VolumesSnapshotTestJSON-1821027228 None] Volume volume-7494f569-aff5-4c6a-a3fb-5838e96343ff (7494f569-aff5-4c6a-a3fb-5838e96343ff): created successfully
Jul 09 14:38:47 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a1b2829a-af3e-4abb-b32c-2f9fbc1ffb97 tempest-VolumesSnapshotTestJSON-1821027228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b58fe484-68f1-42a7-be1c-5dc5d05528a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:38:47 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a1b2829a-af3e-4abb-b32c-2f9fbc1ffb97 tempest-VolumesSnapshotTestJSON-1821027228 None] Flow 'volume_create_manager' (6b35fbdc-dfb0-4aa6-be42-dcf8c683c2cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:38:47 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-a1b2829a-af3e-4abb-b32c-2f9fbc1ffb97 tempest-VolumesSnapshotTestJSON-1821027228 None] Created volume successfully.
Jul 09 14:38:47 devstack sudo[96187]: pam_unix(sudo:session): session closed for user root
Jul 09 14:38:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6a1fe9ac-db15-46db-a557-aa4a804d0024 tempest-GroupSnapshotsV319Test-537745220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b06ecd08-5146-488b-8981-9b1be61aa8ff" returned: 0 in 0.794s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:38:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6a1fe9ac-db15-46db-a557-aa4a804d0024 tempest-GroupSnapshotsV319Test-537745220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b06ecd08-5146-488b-8981-9b1be61aa8ff.27c6957e-fc95-4cb5-af56-0218e595b92e {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:38:47 devstack sudo[96195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b06ecd08-5146-488b-8981-9b1be61aa8ff.27c6957e-fc95-4cb5-af56-0218e595b92e
Jul 09 14:38:47 devstack sudo[96195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:38:48 devstack sudo[96195]: pam_unix(sudo:session): session closed for user root
Jul 09 14:38:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6a1fe9ac-db15-46db-a557-aa4a804d0024 tempest-GroupSnapshotsV319Test-537745220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b06ecd08-5146-488b-8981-9b1be61aa8ff.27c6957e-fc95-4cb5-af56-0218e595b92e" returned: 0 in 0.810s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:38:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6a1fe9ac-db15-46db-a557-aa4a804d0024 tempest-GroupSnapshotsV319Test-537745220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b06ecd08-5146-488b-8981-9b1be61aa8ff.27c6957e-fc95-4cb5-af56-0218e595b92e {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:38:48 devstack sudo[96201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b06ecd08-5146-488b-8981-9b1be61aa8ff.27c6957e-fc95-4cb5-af56-0218e595b92e
Jul 09 14:38:48 devstack sudo[96201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:38:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-2044bc43-46a9-476a-b6ca-fc812e0491d2 tempest-VolumesSnapshotTestJSON-1821027228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:38:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-2044bc43-46a9-476a-b6ca-fc812e0491d2 tempest-VolumesSnapshotTestJSON-1821027228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:38:48 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-2044bc43-46a9-476a-b6ca-fc812e0491d2 tempest-VolumesSnapshotTestJSON-1821027228 None] Creating offline snapshot 2ebdc78b-1dcc-4014-bbf5-535ce43e1b29 of volume 7494f569-aff5-4c6a-a3fb-5838e96343ff {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 14:38:48 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[335975ac-e7a8-4fc7-a216-8ff092a656c2]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:38:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2044bc43-46a9-476a-b6ca-fc812e0491d2 tempest-VolumesSnapshotTestJSON-1821027228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7494f569-aff5-4c6a-a3fb-5838e96343ff {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:38:48 devstack sudo[96203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7494f569-aff5-4c6a-a3fb-5838e96343ff
Jul 09 14:38:48 devstack sudo[96203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:38:48 devstack sudo[96201]: pam_unix(sudo:session): session closed for user root
Jul 09 14:38:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6a1fe9ac-db15-46db-a557-aa4a804d0024 tempest-GroupSnapshotsV319Test-537745220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b06ecd08-5146-488b-8981-9b1be61aa8ff.27c6957e-fc95-4cb5-af56-0218e595b92e" returned: 0 in 0.665s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:38:49 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-6a1fe9ac-db15-46db-a557-aa4a804d0024 tempest-GroupSnapshotsV319Test-537745220 None] Lock "cinder-quobyte-27c6957e-fc95-4cb5-af56-0218e595b92e" released by "_delete_snapshot" :: held 3.419s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:38:49 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-6a1fe9ac-db15-46db-a557-aa4a804d0024 tempest-GroupSnapshotsV319Test-537745220 None] Lock "cinder-quobyte-b06ecd08-5146-488b-8981-9b1be61aa8ff" released by "delete_snapshot" :: held 3.465s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:38:49 devstack cinder-volume[87230]: WARNING cinder.quota [None req-6a1fe9ac-db15-46db-a557-aa4a804d0024 tempest-GroupSnapshotsV319Test-537745220 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1487416604 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1487416604, it is now deprecated. Please use the default quota class for default quota.
Jul 09 14:38:49 devstack cinder-volume[87230]: WARNING cinder.quota [None req-6a1fe9ac-db15-46db-a557-aa4a804d0024 tempest-GroupSnapshotsV319Test-537745220 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1487416604 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1487416604, it is now deprecated. Please use the default quota class for default quota.
Jul 09 14:38:49 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-6a1fe9ac-db15-46db-a557-aa4a804d0024 tempest-GroupSnapshotsV319Test-537745220 None] Created reservations ['deea4372-9606-4212-b798-b45ff6739610', '5459d612-cab5-4c67-b23d-320e148b289e', '432dbd22-6005-41ae-a563-f238ce80c28d', 'ba7b2d00-096d-43ec-8d1e-ed5361f16206'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:38:49 devstack sudo[96203]: pam_unix(sudo:session): session closed for user root
Jul 09 14:38:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2044bc43-46a9-476a-b6ca-fc812e0491d2 tempest-VolumesSnapshotTestJSON-1821027228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7494f569-aff5-4c6a-a3fb-5838e96343ff" returned: 0 in 0.761s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:38:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2044bc43-46a9-476a-b6ca-fc812e0491d2 tempest-VolumesSnapshotTestJSON-1821027228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7494f569-aff5-4c6a-a3fb-5838e96343ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7494f569-aff5-4c6a-a3fb-5838e96343ff.2ebdc78b-1dcc-4014-bbf5-535ce43e1b29 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:38:49 devstack sudo[96209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7494f569-aff5-4c6a-a3fb-5838e96343ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7494f569-aff5-4c6a-a3fb-5838e96343ff.2ebdc78b-1dcc-4014-bbf5-535ce43e1b29 1G
Jul 09 14:38:49 devstack sudo[96209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:38:49 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-6a1fe9ac-db15-46db-a557-aa4a804d0024 tempest-GroupSnapshotsV319Test-537745220 None] group_snapshot 96d4d655-b1da-4ab5-9c8f-3d1b8306b527: deleted successfully
Jul 09 14:38:49 devstack sudo[96209]: pam_unix(sudo:session): session closed for user root
Jul 09 14:38:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2044bc43-46a9-476a-b6ca-fc812e0491d2 tempest-VolumesSnapshotTestJSON-1821027228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7494f569-aff5-4c6a-a3fb-5838e96343ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7494f569-aff5-4c6a-a3fb-5838e96343ff.2ebdc78b-1dcc-4014-bbf5-535ce43e1b29 1G" returned: 0 in 0.839s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:38:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2044bc43-46a9-476a-b6ca-fc812e0491d2 tempest-VolumesSnapshotTestJSON-1821027228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7494f569-aff5-4c6a-a3fb-5838e96343ff -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7494f569-aff5-4c6a-a3fb-5838e96343ff.2ebdc78b-1dcc-4014-bbf5-535ce43e1b29 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:38:50 devstack sudo[96215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7494f569-aff5-4c6a-a3fb-5838e96343ff -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7494f569-aff5-4c6a-a3fb-5838e96343ff.2ebdc78b-1dcc-4014-bbf5-535ce43e1b29
Jul 09 14:38:50 devstack sudo[96215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:38:50 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-bee0ea6c-cc06-4fb3-9a49-e1bf61ccb7a7 tempest-GroupSnapshotsV319Test-537745220 None] Acquiring lock "cinder-quobyte-b06ecd08-5146-488b-8981-9b1be61aa8ff" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:38:50 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-bee0ea6c-cc06-4fb3-9a49-e1bf61ccb7a7 tempest-GroupSnapshotsV319Test-537745220 None] Lock "cinder-quobyte-b06ecd08-5146-488b-8981-9b1be61aa8ff" acquired by "delete_volume" :: waited 0.027s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:38:50 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[f908e9cf-5a93-411f-8c1b-eac84f30f47d]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:38:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-bee0ea6c-cc06-4fb3-9a49-e1bf61ccb7a7 tempest-GroupSnapshotsV319Test-537745220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b06ecd08-5146-488b-8981-9b1be61aa8ff {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:38:50 devstack sudo[96219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b06ecd08-5146-488b-8981-9b1be61aa8ff
Jul 09 14:38:50 devstack sudo[96219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:38:50 devstack sudo[96215]: pam_unix(sudo:session): session closed for user root
Jul 09 14:38:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2044bc43-46a9-476a-b6ca-fc812e0491d2 tempest-VolumesSnapshotTestJSON-1821027228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7494f569-aff5-4c6a-a3fb-5838e96343ff -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7494f569-aff5-4c6a-a3fb-5838e96343ff.2ebdc78b-1dcc-4014-bbf5-535ce43e1b29" returned: 0 in 0.819s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:38:50 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-2044bc43-46a9-476a-b6ca-fc812e0491d2 tempest-VolumesSnapshotTestJSON-1821027228 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7494f569-aff5-4c6a-a3fb-5838e96343ff.2ebdc78b-1dcc-4014-bbf5-535ce43e1b29 is being set with open permissions: ugo+rw
Jul 09 14:38:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2044bc43-46a9-476a-b6ca-fc812e0491d2 tempest-VolumesSnapshotTestJSON-1821027228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7494f569-aff5-4c6a-a3fb-5838e96343ff.2ebdc78b-1dcc-4014-bbf5-535ce43e1b29 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:38:50 devstack sudo[96224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7494f569-aff5-4c6a-a3fb-5838e96343ff.2ebdc78b-1dcc-4014-bbf5-535ce43e1b29
Jul 09 14:38:50 devstack sudo[96224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:38:51 devstack sudo[96219]: pam_unix(sudo:session): session closed for user root
Jul 09 14:38:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-bee0ea6c-cc06-4fb3-9a49-e1bf61ccb7a7 tempest-GroupSnapshotsV319Test-537745220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b06ecd08-5146-488b-8981-9b1be61aa8ff" returned: 0 in 0.893s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:38:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-bee0ea6c-cc06-4fb3-9a49-e1bf61ccb7a7 tempest-GroupSnapshotsV319Test-537745220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b06ecd08-5146-488b-8981-9b1be61aa8ff {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:38:51 devstack sudo[96229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b06ecd08-5146-488b-8981-9b1be61aa8ff
Jul 09 14:38:51 devstack sudo[96229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:38:51 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-cb21623f-7280-4ec6-975b-1ef3c87c1a54 tempest-ServerActionsTestOtherA-318969881 None] Acquiring lock "cinder-a425af93-c49d-46e6-95cc-6240c1ec5f43-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:38:51 devstack sudo[96224]: pam_unix(sudo:session): session closed for user root
Jul 09 14:38:51 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-cb21623f-7280-4ec6-975b-1ef3c87c1a54 tempest-ServerActionsTestOtherA-318969881 None] Lock "cinder-a425af93-c49d-46e6-95cc-6240c1ec5f43-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:38:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2044bc43-46a9-476a-b6ca-fc812e0491d2 tempest-VolumesSnapshotTestJSON-1821027228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7494f569-aff5-4c6a-a3fb-5838e96343ff.2ebdc78b-1dcc-4014-bbf5-535ce43e1b29" returned: 0 in 0.788s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:38:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2044bc43-46a9-476a-b6ca-fc812e0491d2 tempest-VolumesSnapshotTestJSON-1821027228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7494f569-aff5-4c6a-a3fb-5838e96343ff.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:38:51 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-cb21623f-7280-4ec6-975b-1ef3c87c1a54 tempest-ServerActionsTestOtherA-318969881 None] Acquiring lock "cinder-quobyte-a425af93-c49d-46e6-95cc-6240c1ec5f43" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:38:51 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-cb21623f-7280-4ec6-975b-1ef3c87c1a54 tempest-ServerActionsTestOtherA-318969881 None] Lock "cinder-quobyte-a425af93-c49d-46e6-95cc-6240c1ec5f43" acquired by "delete_volume" :: waited 0.018s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:38:51 devstack sudo[96241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7494f569-aff5-4c6a-a3fb-5838e96343ff.info
Jul 09 14:38:51 devstack sudo[96241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:38:51 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[36e209d5-f02f-4b24-be8e-fd63c114ab22]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:38:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-cb21623f-7280-4ec6-975b-1ef3c87c1a54 tempest-ServerActionsTestOtherA-318969881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a425af93-c49d-46e6-95cc-6240c1ec5f43 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:38:51 devstack sudo[96243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a425af93-c49d-46e6-95cc-6240c1ec5f43
Jul 09 14:38:51 devstack sudo[96243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:38:52 devstack sudo[96229]: pam_unix(sudo:session): session closed for user root
Jul 09 14:38:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-bee0ea6c-cc06-4fb3-9a49-e1bf61ccb7a7 tempest-GroupSnapshotsV319Test-537745220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b06ecd08-5146-488b-8981-9b1be61aa8ff" returned: 0 in 0.902s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:38:52 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-bee0ea6c-cc06-4fb3-9a49-e1bf61ccb7a7 tempest-GroupSnapshotsV319Test-537745220 None] Lock "cinder-quobyte-b06ecd08-5146-488b-8981-9b1be61aa8ff" released by "delete_volume" :: held 1.891s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:38:52 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-bee0ea6c-cc06-4fb3-9a49-e1bf61ccb7a7 tempest-GroupSnapshotsV319Test-537745220 None] Created reservations ['9dfc0518-7bad-4db8-bd7d-9ce530c48f03'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:38:52 devstack cinder-volume[87230]: WARNING cinder.quota [None req-bee0ea6c-cc06-4fb3-9a49-e1bf61ccb7a7 tempest-GroupSnapshotsV319Test-537745220 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1487416604 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1487416604, it is now deprecated. Please use the default quota class for default quota.
Jul 09 14:38:52 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-bee0ea6c-cc06-4fb3-9a49-e1bf61ccb7a7 tempest-GroupSnapshotsV319Test-537745220 None] Created reservations ['ee9967de-0404-4a22-84cc-fdc621b1d404', 'fa202825-7ff8-4a41-90b0-76fc45bb50ad', '43cd1830-c90c-417f-9bbd-8d9726a9453f', '4d6e8f4e-e910-479f-ae9d-729875b8ae72'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:38:52 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Running periodic task VolumeManager._thread_info {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 14:38:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] thread count: 8 {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 09 14:38:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] thread info: [<_MainThread(MainThread, started 125388812103808)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125388713797504)>, <Thread(Thread-3 (stat_writer), started daemon 125388699995392)>, <Thread(Rabbit-heartbeat, started daemon 125388700522560)>, <Thread(Thread-5 (_runner), started daemon 125388698545216)>, <Thread(Thread-7 (_runner), started daemon 125388698611264)>, <Thread(fd_logger, started daemon 125388703020672)>, <Thread(privsep_reader, started daemon 125388696441088)>] {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 09 14:38:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-bee0ea6c-cc06-4fb3-9a49-e1bf61ccb7a7 tempest-GroupSnapshotsV319Test-537745220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:38:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-bee0ea6c-cc06-4fb3-9a49-e1bf61ccb7a7 tempest-GroupSnapshotsV319Test-537745220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:38:52 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-bee0ea6c-cc06-4fb3-9a49-e1bf61ccb7a7 tempest-GroupSnapshotsV319Test-537745220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:38:52 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-bee0ea6c-cc06-4fb3-9a49-e1bf61ccb7a7 tempest-GroupSnapshotsV319Test-537745220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:38:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-bee0ea6c-cc06-4fb3-9a49-e1bf61ccb7a7 tempest-GroupSnapshotsV319Test-537745220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:38:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-bee0ea6c-cc06-4fb3-9a49-e1bf61ccb7a7 tempest-GroupSnapshotsV319Test-537745220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:38:52 devstack sudo[96241]: pam_unix(sudo:session): session closed for user root
Jul 09 14:38:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2044bc43-46a9-476a-b6ca-fc812e0491d2 tempest-VolumesSnapshotTestJSON-1821027228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7494f569-aff5-4c6a-a3fb-5838e96343ff.info" returned: 0 in 0.865s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:38:52 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-2044bc43-46a9-476a-b6ca-fc812e0491d2 tempest-VolumesSnapshotTestJSON-1821027228 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7494f569-aff5-4c6a-a3fb-5838e96343ff.info is being set with open permissions: ugo+rw
Jul 09 14:38:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2044bc43-46a9-476a-b6ca-fc812e0491d2 tempest-VolumesSnapshotTestJSON-1821027228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7494f569-aff5-4c6a-a3fb-5838e96343ff.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:38:52 devstack sudo[96257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:38:52 devstack sudo[96257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:38:52 devstack sudo[96259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7494f569-aff5-4c6a-a3fb-5838e96343ff.info
Jul 09 14:38:52 devstack sudo[96259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:38:52 devstack sudo[96243]: pam_unix(sudo:session): session closed for user root
Jul 09 14:38:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-cb21623f-7280-4ec6-975b-1ef3c87c1a54 tempest-ServerActionsTestOtherA-318969881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a425af93-c49d-46e6-95cc-6240c1ec5f43" returned: 0 in 1.040s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:38:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-cb21623f-7280-4ec6-975b-1ef3c87c1a54 tempest-ServerActionsTestOtherA-318969881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a425af93-c49d-46e6-95cc-6240c1ec5f43 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:38:52 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-76b3a447-3fba-48f1-a420-123fa97870b1 tempest-AttachVolumeTestJSON-1021532728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:38:52 devstack sudo[96263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a425af93-c49d-46e6-95cc-6240c1ec5f43
Jul 09 14:38:52 devstack sudo[96263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:38:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-76b3a447-3fba-48f1-a420-123fa97870b1 tempest-AttachVolumeTestJSON-1021532728 None] Flow 'volume_create_manager' (d7b09cbf-f459-41b7-9462-4932a6f82f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:38:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-76b3a447-3fba-48f1-a420-123fa97870b1 tempest-AttachVolumeTestJSON-1021532728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0fc137d-e236-4f89-9169-2ac6483fab9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:38:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-76b3a447-3fba-48f1-a420-123fa97870b1 tempest-AttachVolumeTestJSON-1021532728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0fc137d-e236-4f89-9169-2ac6483fab9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:38:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-562554508',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1133595f-7c70-4572-9dc7-c4954a7c4448,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b915bfaa50d440baa3438aa2107e537d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:38:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:38:53Z,use_quota=True,user_id='c37e6e905ebe4532a515ec945d11fb0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:38:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-76b3a447-3fba-48f1-a420-123fa97870b1 tempest-AttachVolumeTestJSON-1021532728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac17edbd-7a69-41b0-8a29-a050be334332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:38:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-76b3a447-3fba-48f1-a420-123fa97870b1 tempest-AttachVolumeTestJSON-1021532728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac17edbd-7a69-41b0-8a29-a050be334332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:38:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-76b3a447-3fba-48f1-a420-123fa97870b1 tempest-AttachVolumeTestJSON-1021532728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbaca383-124c-420e-b8a7-478519fefdbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:38:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-76b3a447-3fba-48f1-a420-123fa97870b1 tempest-AttachVolumeTestJSON-1021532728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbaca383-124c-420e-b8a7-478519fefdbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1133595f-7c70-4572-9dc7-c4954a7c4448', 'volume_name': 'volume-1133595f-7c70-4572-9dc7-c4954a7c4448', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:38:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-76b3a447-3fba-48f1-a420-123fa97870b1 tempest-AttachVolumeTestJSON-1021532728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cae7ab01-6cb2-447b-91e8-46e3e867cab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:38:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-76b3a447-3fba-48f1-a420-123fa97870b1 tempest-AttachVolumeTestJSON-1021532728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cae7ab01-6cb2-447b-91e8-46e3e867cab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:38:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-76b3a447-3fba-48f1-a420-123fa97870b1 tempest-AttachVolumeTestJSON-1021532728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ddbd92f-52ce-4dc6-b73f-c25df6785788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:38:52 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-76b3a447-3fba-48f1-a420-123fa97870b1 tempest-AttachVolumeTestJSON-1021532728 None] Volume 1133595f-7c70-4572-9dc7-c4954a7c4448: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1133595f-7c70-4572-9dc7-c4954a7c4448', 'volume_size': 1}
Jul 09 14:38:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-76b3a447-3fba-48f1-a420-123fa97870b1 tempest-AttachVolumeTestJSON-1021532728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:38:53 devstack sudo[96259]: pam_unix(sudo:session): session closed for user root
Jul 09 14:38:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2044bc43-46a9-476a-b6ca-fc812e0491d2 tempest-VolumesSnapshotTestJSON-1821027228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7494f569-aff5-4c6a-a3fb-5838e96343ff.info" returned: 0 in 0.852s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:38:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-2044bc43-46a9-476a-b6ca-fc812e0491d2 tempest-VolumesSnapshotTestJSON-1821027228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.072s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:38:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-76b3a447-3fba-48f1-a420-123fa97870b1 tempest-AttachVolumeTestJSON-1021532728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.431s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:38:53 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-76b3a447-3fba-48f1-a420-123fa97870b1 tempest-AttachVolumeTestJSON-1021532728 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:38:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-562554508',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1133595f-7c70-4572-9dc7-c4954a7c4448,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b915bfaa50d440baa3438aa2107e537d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:38:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:38:53Z,use_quota=True,user_id='c37e6e905ebe4532a515ec945d11fb0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:38:53 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-76b3a447-3fba-48f1-a420-123fa97870b1 tempest-AttachVolumeTestJSON-1021532728 None] Creating volume 1133595f-7c70-4572-9dc7-c4954a7c4448 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:38:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-76b3a447-3fba-48f1-a420-123fa97870b1 tempest-AttachVolumeTestJSON-1021532728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:38:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-76b3a447-3fba-48f1-a420-123fa97870b1 tempest-AttachVolumeTestJSON-1021532728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:38:53 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-76b3a447-3fba-48f1-a420-123fa97870b1 tempest-AttachVolumeTestJSON-1021532728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:38:53 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-76b3a447-3fba-48f1-a420-123fa97870b1 tempest-AttachVolumeTestJSON-1021532728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:38:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-76b3a447-3fba-48f1-a420-123fa97870b1 tempest-AttachVolumeTestJSON-1021532728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:38:53 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-76b3a447-3fba-48f1-a420-123fa97870b1 tempest-AttachVolumeTestJSON-1021532728 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:38:53 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-76b3a447-3fba-48f1-a420-123fa97870b1 tempest-AttachVolumeTestJSON-1021532728 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:38:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-76b3a447-3fba-48f1-a420-123fa97870b1 tempest-AttachVolumeTestJSON-1021532728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1133595f-7c70-4572-9dc7-c4954a7c4448 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:38:53 devstack sudo[96257]: pam_unix(sudo:session): session closed for user root
Jul 09 14:38:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-bee0ea6c-cc06-4fb3-9a49-e1bf61ccb7a7 tempest-GroupSnapshotsV319Test-537745220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.969s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:38:53 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-bee0ea6c-cc06-4fb3-9a49-e1bf61ccb7a7 tempest-GroupSnapshotsV319Test-537745220 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:38:53 devstack sudo[96267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1133595f-7c70-4572-9dc7-c4954a7c4448 1073741824
Jul 09 14:38:53 devstack sudo[96267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:38:53 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-bee0ea6c-cc06-4fb3-9a49-e1bf61ccb7a7 tempest-GroupSnapshotsV319Test-537745220 None] Delete group completed successfully.
Jul 09 14:38:53 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-2044bc43-46a9-476a-b6ca-fc812e0491d2 tempest-VolumesSnapshotTestJSON-1821027228 None] Create snapshot completed successfully
Jul 09 14:38:53 devstack sudo[96263]: pam_unix(sudo:session): session closed for user root
Jul 09 14:38:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-cb21623f-7280-4ec6-975b-1ef3c87c1a54 tempest-ServerActionsTestOtherA-318969881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a425af93-c49d-46e6-95cc-6240c1ec5f43" returned: 0 in 1.005s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:38:53 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-cb21623f-7280-4ec6-975b-1ef3c87c1a54 tempest-ServerActionsTestOtherA-318969881 None] Lock "cinder-quobyte-a425af93-c49d-46e6-95cc-6240c1ec5f43" released by "delete_volume" :: held 2.108s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:38:53 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-cb21623f-7280-4ec6-975b-1ef3c87c1a54 tempest-ServerActionsTestOtherA-318969881 None] Created reservations ['a1dc5404-a57b-4bb4-b446-fd5feae1a2c5', '971107bc-3d64-432b-80a4-311b4a775833', 'ccc35941-efd9-49d3-980b-057efb54e504', 'cefaaea0-7b7b-46d7-b5ae-ba5197635eff'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:38:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-cb21623f-7280-4ec6-975b-1ef3c87c1a54 tempest-ServerActionsTestOtherA-318969881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:38:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-cb21623f-7280-4ec6-975b-1ef3c87c1a54 tempest-ServerActionsTestOtherA-318969881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:38:53 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-cb21623f-7280-4ec6-975b-1ef3c87c1a54 tempest-ServerActionsTestOtherA-318969881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:38:53 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-cb21623f-7280-4ec6-975b-1ef3c87c1a54 tempest-ServerActionsTestOtherA-318969881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:38:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-cb21623f-7280-4ec6-975b-1ef3c87c1a54 tempest-ServerActionsTestOtherA-318969881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:38:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-cb21623f-7280-4ec6-975b-1ef3c87c1a54 tempest-ServerActionsTestOtherA-318969881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:38:54 devstack sudo[96270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:38:54 devstack sudo[96270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:38:54 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-158a6dcf-6322-4bb5-95bd-d36ddea6c021 tempest-VolumesSnapshotTestJSON-1821027228 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:38:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-158a6dcf-6322-4bb5-95bd-d36ddea6c021 tempest-VolumesSnapshotTestJSON-1821027228 None] Flow 'volume_create_manager' (bdb22a3d-2ac1-43e4-bb20-040f81bcee60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:38:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-158a6dcf-6322-4bb5-95bd-d36ddea6c021 tempest-VolumesSnapshotTestJSON-1821027228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b3ca26b-53ef-4e9f-8d8f-eb53e9863359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:38:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-158a6dcf-6322-4bb5-95bd-d36ddea6c021 tempest-VolumesSnapshotTestJSON-1821027228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b3ca26b-53ef-4e9f-8d8f-eb53e9863359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:38:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1524201765',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e89cd9de-13fa-4df8-9ef8-bd6a551a201c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='082e6a77a8814f3c845e798e70c9a807',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:38:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2ebdc78b-1dcc-4014-bbf5-535ce43e1b29,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:38:54Z,use_quota=True,user_id='5f6a22de2293401292f13d9e333940ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:38:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-158a6dcf-6322-4bb5-95bd-d36ddea6c021 tempest-VolumesSnapshotTestJSON-1821027228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0c5c892-7c4a-43b7-95e0-7c4c7a7ade97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:38:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-158a6dcf-6322-4bb5-95bd-d36ddea6c021 tempest-VolumesSnapshotTestJSON-1821027228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0c5c892-7c4a-43b7-95e0-7c4c7a7ade97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:38:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-158a6dcf-6322-4bb5-95bd-d36ddea6c021 tempest-VolumesSnapshotTestJSON-1821027228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ef5e336-d751-4157-99fd-ac51d6416161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:38:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-158a6dcf-6322-4bb5-95bd-d36ddea6c021 tempest-VolumesSnapshotTestJSON-1821027228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ef5e336-d751-4157-99fd-ac51d6416161) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e89cd9de-13fa-4df8-9ef8-bd6a551a201c', 'volume_name': 'volume-e89cd9de-13fa-4df8-9ef8-bd6a551a201c', 'volume_size': 1, 'snapshot_id': '2ebdc78b-1dcc-4014-bbf5-535ce43e1b29'}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:38:54 devstack sudo[96267]: pam_unix(sudo:session): session closed for user root
Jul 09 14:38:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-158a6dcf-6322-4bb5-95bd-d36ddea6c021 tempest-VolumesSnapshotTestJSON-1821027228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5596cc4-11fc-4bd3-8b0e-bd51d025d9c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:38:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-158a6dcf-6322-4bb5-95bd-d36ddea6c021 tempest-VolumesSnapshotTestJSON-1821027228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5596cc4-11fc-4bd3-8b0e-bd51d025d9c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:38:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-158a6dcf-6322-4bb5-95bd-d36ddea6c021 tempest-VolumesSnapshotTestJSON-1821027228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (621f27cb-d359-405e-8c57-8d10b65bf7ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:38:54 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-158a6dcf-6322-4bb5-95bd-d36ddea6c021 tempest-VolumesSnapshotTestJSON-1821027228 None] Volume e89cd9de-13fa-4df8-9ef8-bd6a551a201c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e89cd9de-13fa-4df8-9ef8-bd6a551a201c', 'volume_size': 1, 'snapshot_id': '2ebdc78b-1dcc-4014-bbf5-535ce43e1b29'}
Jul 09 14:38:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-76b3a447-3fba-48f1-a420-123fa97870b1 tempest-AttachVolumeTestJSON-1021532728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1133595f-7c70-4572-9dc7-c4954a7c4448 1073741824" returned: 0 in 1.108s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:38:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-158a6dcf-6322-4bb5-95bd-d36ddea6c021 tempest-VolumesSnapshotTestJSON-1821027228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:38:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-76b3a447-3fba-48f1-a420-123fa97870b1 tempest-AttachVolumeTestJSON-1021532728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1133595f-7c70-4572-9dc7-c4954a7c4448 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:38:54 devstack sudo[96279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1133595f-7c70-4572-9dc7-c4954a7c4448
Jul 09 14:38:54 devstack sudo[96279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:38:54 devstack sudo[96270]: pam_unix(sudo:session): session closed for user root
Jul 09 14:38:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-cb21623f-7280-4ec6-975b-1ef3c87c1a54 tempest-ServerActionsTestOtherA-318969881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.856s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:38:54 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-cb21623f-7280-4ec6-975b-1ef3c87c1a54 tempest-ServerActionsTestOtherA-318969881 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:38:54 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-cb21623f-7280-4ec6-975b-1ef3c87c1a54 tempest-ServerActionsTestOtherA-318969881 None] Deleted volume successfully.
Jul 09 14:38:54 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-cb21623f-7280-4ec6-975b-1ef3c87c1a54 tempest-ServerActionsTestOtherA-318969881 None] Lock "cinder-a425af93-c49d-46e6-95cc-6240c1ec5f43-delete_volume" released by "delete_volume" :: held 3.320s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:38:55 devstack sudo[96279]: pam_unix(sudo:session): session closed for user root
Jul 09 14:38:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-76b3a447-3fba-48f1-a420-123fa97870b1 tempest-AttachVolumeTestJSON-1021532728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1133595f-7c70-4572-9dc7-c4954a7c4448" returned: 0 in 0.797s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:38:55 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-76b3a447-3fba-48f1-a420-123fa97870b1 tempest-AttachVolumeTestJSON-1021532728 None] <== create_volume: return (1977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:38:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-76b3a447-3fba-48f1-a420-123fa97870b1 tempest-AttachVolumeTestJSON-1021532728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.981s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:38:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-158a6dcf-6322-4bb5-95bd-d36ddea6c021 tempest-VolumesSnapshotTestJSON-1821027228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.830s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:38:55 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-158a6dcf-6322-4bb5-95bd-d36ddea6c021 tempest-VolumesSnapshotTestJSON-1821027228 None] Acquiring lock "cinder-quobyte-2ebdc78b-1dcc-4014-bbf5-535ce43e1b29-e89cd9de-13fa-4df8-9ef8-bd6a551a201c" by "_create_volume_from_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:38:55 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-158a6dcf-6322-4bb5-95bd-d36ddea6c021 tempest-VolumesSnapshotTestJSON-1821027228 None] Lock "cinder-quobyte-2ebdc78b-1dcc-4014-bbf5-535ce43e1b29-e89cd9de-13fa-4df8-9ef8-bd6a551a201c" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:38:55 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-158a6dcf-6322-4bb5-95bd-d36ddea6c021 tempest-VolumesSnapshotTestJSON-1821027228 None] Creating volume e89cd9de-13fa-4df8-9ef8-bd6a551a201c from snapshot 2ebdc78b-1dcc-4014-bbf5-535ce43e1b29 {{(pid=87230) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 09 14:38:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-158a6dcf-6322-4bb5-95bd-d36ddea6c021 tempest-VolumesSnapshotTestJSON-1821027228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:38:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-158a6dcf-6322-4bb5-95bd-d36ddea6c021 tempest-VolumesSnapshotTestJSON-1821027228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:38:55 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-158a6dcf-6322-4bb5-95bd-d36ddea6c021 tempest-VolumesSnapshotTestJSON-1821027228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:38:55 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-158a6dcf-6322-4bb5-95bd-d36ddea6c021 tempest-VolumesSnapshotTestJSON-1821027228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:38:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-158a6dcf-6322-4bb5-95bd-d36ddea6c021 tempest-VolumesSnapshotTestJSON-1821027228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:38:55 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-158a6dcf-6322-4bb5-95bd-d36ddea6c021 tempest-VolumesSnapshotTestJSON-1821027228 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:38:55 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-158a6dcf-6322-4bb5-95bd-d36ddea6c021 tempest-VolumesSnapshotTestJSON-1821027228 None] Acquiring lock "cinder-quobyte-e89cd9de-13fa-4df8-9ef8-bd6a551a201c" by "_copy_volume_from_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:38:55 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-76b3a447-3fba-48f1-a420-123fa97870b1 tempest-AttachVolumeTestJSON-1021532728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ddbd92f-52ce-4dc6-b73f-c25df6785788) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1133595f-7c70-4572-9dc7-c4954a7c4448', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:38:55 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-76b3a447-3fba-48f1-a420-123fa97870b1 tempest-AttachVolumeTestJSON-1021532728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fa707bb-5ffe-448d-a400-00f07944be16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:38:55 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-158a6dcf-6322-4bb5-95bd-d36ddea6c021 tempest-VolumesSnapshotTestJSON-1821027228 None] Lock "cinder-quobyte-e89cd9de-13fa-4df8-9ef8-bd6a551a201c" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:38:55 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-158a6dcf-6322-4bb5-95bd-d36ddea6c021 tempest-VolumesSnapshotTestJSON-1821027228 None] snapshot: 2ebdc78b-1dcc-4014-bbf5-535ce43e1b29, volume: e89cd9de-13fa-4df8-9ef8-bd6a551a201c,  {{(pid=87230) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 09 14:38:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-158a6dcf-6322-4bb5-95bd-d36ddea6c021 tempest-VolumesSnapshotTestJSON-1821027228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:38:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-158a6dcf-6322-4bb5-95bd-d36ddea6c021 tempest-VolumesSnapshotTestJSON-1821027228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:38:55 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-158a6dcf-6322-4bb5-95bd-d36ddea6c021 tempest-VolumesSnapshotTestJSON-1821027228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:38:55 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-158a6dcf-6322-4bb5-95bd-d36ddea6c021 tempest-VolumesSnapshotTestJSON-1821027228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:38:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-158a6dcf-6322-4bb5-95bd-d36ddea6c021 tempest-VolumesSnapshotTestJSON-1821027228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:38:55 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-76b3a447-3fba-48f1-a420-123fa97870b1 tempest-AttachVolumeTestJSON-1021532728 None] Volume volume-1133595f-7c70-4572-9dc7-c4954a7c4448 (1133595f-7c70-4572-9dc7-c4954a7c4448): created successfully
Jul 09 14:38:55 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-76b3a447-3fba-48f1-a420-123fa97870b1 tempest-AttachVolumeTestJSON-1021532728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fa707bb-5ffe-448d-a400-00f07944be16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:38:55 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-76b3a447-3fba-48f1-a420-123fa97870b1 tempest-AttachVolumeTestJSON-1021532728 None] Flow 'volume_create_manager' (d7b09cbf-f459-41b7-9462-4932a6f82f09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:38:55 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec193f0-19bf-4529-b9c0-fd8fd7c3a685]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:38:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-158a6dcf-6322-4bb5-95bd-d36ddea6c021 tempest-VolumesSnapshotTestJSON-1821027228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7494f569-aff5-4c6a-a3fb-5838e96343ff.2ebdc78b-1dcc-4014-bbf5-535ce43e1b29 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:38:55 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-76b3a447-3fba-48f1-a420-123fa97870b1 tempest-AttachVolumeTestJSON-1021532728 None] Created volume successfully.
Jul 09 14:38:55 devstack sudo[96286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7494f569-aff5-4c6a-a3fb-5838e96343ff.2ebdc78b-1dcc-4014-bbf5-535ce43e1b29
Jul 09 14:38:55 devstack sudo[96286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:38:56 devstack sudo[96286]: pam_unix(sudo:session): session closed for user root
Jul 09 14:38:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-158a6dcf-6322-4bb5-95bd-d36ddea6c021 tempest-VolumesSnapshotTestJSON-1821027228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7494f569-aff5-4c6a-a3fb-5838e96343ff.2ebdc78b-1dcc-4014-bbf5-535ce43e1b29" returned: 0 in 0.858s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:38:56 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-158a6dcf-6322-4bb5-95bd-d36ddea6c021 tempest-VolumesSnapshotTestJSON-1821027228 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7494f569-aff5-4c6a-a3fb-5838e96343ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 14:38:56 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-158a6dcf-6322-4bb5-95bd-d36ddea6c021 tempest-VolumesSnapshotTestJSON-1821027228 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7494f569-aff5-4c6a-a3fb-5838e96343ff {{(pid=87230) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 09 14:38:56 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-158a6dcf-6322-4bb5-95bd-d36ddea6c021 tempest-VolumesSnapshotTestJSON-1821027228 None] Creating direct copy from snapshot {{(pid=87230) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 09 14:38:56 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[94006e75-2e5c-43f7-a9ee-4a377df9a498]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:38:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-158a6dcf-6322-4bb5-95bd-d36ddea6c021 tempest-VolumesSnapshotTestJSON-1821027228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7494f569-aff5-4c6a-a3fb-5838e96343ff {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:38:56 devstack sudo[96300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7494f569-aff5-4c6a-a3fb-5838e96343ff
Jul 09 14:38:56 devstack sudo[96300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:38:57 devstack sudo[96300]: pam_unix(sudo:session): session closed for user root
Jul 09 14:38:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-158a6dcf-6322-4bb5-95bd-d36ddea6c021 tempest-VolumesSnapshotTestJSON-1821027228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7494f569-aff5-4c6a-a3fb-5838e96343ff" returned: 0 in 1.034s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:38:57 devstack cinder-volume[87230]: DEBUG cinder.utils [None req-158a6dcf-6322-4bb5-95bd-d36ddea6c021 tempest-VolumesSnapshotTestJSON-1821027228 None] Path /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e89cd9de-13fa-4df8-9ef8-bd6a551a201c not found in is_blk_device check {{(pid=87230) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 09 14:38:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-158a6dcf-6322-4bb5-95bd-d36ddea6c021 tempest-VolumesSnapshotTestJSON-1821027228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7494f569-aff5-4c6a-a3fb-5838e96343ff /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e89cd9de-13fa-4df8-9ef8-bd6a551a201c {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:38:57 devstack sudo[96320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7494f569-aff5-4c6a-a3fb-5838e96343ff /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e89cd9de-13fa-4df8-9ef8-bd6a551a201c
Jul 09 14:38:57 devstack sudo[96320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:38:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-35c38788-7e6d-41b7-8ea6-1c72803d8160 req-1a0390da-7197-46fa-9524-6ad0ef1d1254 tempest-AttachVolumeTestJSON-1021532728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:39:00 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-5185dad6-be00-466b-b85a-453f4f4e0230 tempest-GroupsTest-854722394 None] Group tempest-Group1-199294121: creating
Jul 09 14:39:00 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-5185dad6-be00-466b-b85a-453f4f4e0230 tempest-GroupsTest-854722394 None] Group tempest-Group1-199294121: created successfully
Jul 09 14:39:00 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-5185dad6-be00-466b-b85a-453f4f4e0230 tempest-GroupsTest-854722394 None] Create group completed successfully.
Jul 09 14:39:01 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-a7980611-e657-4031-a651-fb9f4fbaaee8 tempest-GroupsTest-854722394 None] Group tempest-Group2-1103645959: creating
Jul 09 14:39:01 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-a7980611-e657-4031-a651-fb9f4fbaaee8 tempest-GroupsTest-854722394 None] Group tempest-Group2-1103645959: created successfully
Jul 09 14:39:01 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-a7980611-e657-4031-a651-fb9f4fbaaee8 tempest-GroupsTest-854722394 None] Create group completed successfully.
Jul 09 14:39:03 devstack sudo[96320]: pam_unix(sudo:session): session closed for user root
Jul 09 14:39:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-158a6dcf-6322-4bb5-95bd-d36ddea6c021 tempest-VolumesSnapshotTestJSON-1821027228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7494f569-aff5-4c6a-a3fb-5838e96343ff /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e89cd9de-13fa-4df8-9ef8-bd6a551a201c" returned: 0 in 5.858s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:39:03 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[db39186e-faa1-4cd6-83c2-04781eadba72]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:39:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-158a6dcf-6322-4bb5-95bd-d36ddea6c021 tempest-VolumesSnapshotTestJSON-1821027228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7494f569-aff5-4c6a-a3fb-5838e96343ff {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:39:03 devstack sudo[96346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7494f569-aff5-4c6a-a3fb-5838e96343ff
Jul 09 14:39:03 devstack sudo[96346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:39:03 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-8047adc7-ffda-4130-b47e-a357b5fdd6e5 tempest-GroupsTest-854722394 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:39:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8047adc7-ffda-4130-b47e-a357b5fdd6e5 tempest-GroupsTest-854722394 None] Flow 'volume_create_manager' (d509e3d8-0c72-44fd-a7e2-588bc246e9d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:39:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8047adc7-ffda-4130-b47e-a357b5fdd6e5 tempest-GroupsTest-854722394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f5b243b-a216-4d80-90e8-6a6420098332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:39:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8047adc7-ffda-4130-b47e-a357b5fdd6e5 tempest-GroupsTest-854722394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f5b243b-a216-4d80-90e8-6a6420098332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:39:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-809699659',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=eefa8312-48ff-466e-b206-067de1f389da,host='devstack@QuobyteHD#QuobyteHD',id=8240833f-a6d3-478d-827f-bb95ee48149f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bf301d005dd46db8b5252a25d908e4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:39:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:39:03Z,use_quota=True,user_id='1766ba551cfb4f7ba9d779568a0c6935',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab7c3e59-c67a-4dc2-87c9-a211e1b28195),volume_type_id=ab7c3e59-c67a-4dc2-87c9-a211e1b28195)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:39:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8047adc7-ffda-4130-b47e-a357b5fdd6e5 tempest-GroupsTest-854722394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92e693bc-a009-4045-9144-f6a44e52e68a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:39:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8047adc7-ffda-4130-b47e-a357b5fdd6e5 tempest-GroupsTest-854722394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92e693bc-a009-4045-9144-f6a44e52e68a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:39:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8047adc7-ffda-4130-b47e-a357b5fdd6e5 tempest-GroupsTest-854722394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a4392df-bffe-424d-a05f-74f2d2841196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:39:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8047adc7-ffda-4130-b47e-a357b5fdd6e5 tempest-GroupsTest-854722394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a4392df-bffe-424d-a05f-74f2d2841196) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8240833f-a6d3-478d-827f-bb95ee48149f', 'volume_name': 'volume-8240833f-a6d3-478d-827f-bb95ee48149f', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:39:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8047adc7-ffda-4130-b47e-a357b5fdd6e5 tempest-GroupsTest-854722394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2be28cbe-2b62-4f2d-91a2-3fcfb03e333f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:39:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8047adc7-ffda-4130-b47e-a357b5fdd6e5 tempest-GroupsTest-854722394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2be28cbe-2b62-4f2d-91a2-3fcfb03e333f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:39:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8047adc7-ffda-4130-b47e-a357b5fdd6e5 tempest-GroupsTest-854722394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2159013-ecdf-4ad0-9419-09a446ff5b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:39:03 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-8047adc7-ffda-4130-b47e-a357b5fdd6e5 tempest-GroupsTest-854722394 None] Volume 8240833f-a6d3-478d-827f-bb95ee48149f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8240833f-a6d3-478d-827f-bb95ee48149f', 'volume_size': 1}
Jul 09 14:39:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8047adc7-ffda-4130-b47e-a357b5fdd6e5 tempest-GroupsTest-854722394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:39:04 devstack sudo[96346]: pam_unix(sudo:session): session closed for user root
Jul 09 14:39:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-158a6dcf-6322-4bb5-95bd-d36ddea6c021 tempest-VolumesSnapshotTestJSON-1821027228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7494f569-aff5-4c6a-a3fb-5838e96343ff" returned: 0 in 0.981s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:39:04 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-158a6dcf-6322-4bb5-95bd-d36ddea6c021 tempest-VolumesSnapshotTestJSON-1821027228 None] Image conversion details: src /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7494f569-aff5-4c6a-a3fb-5838e96343ff, size 1024.00 MB, duration 5.86 sec, destination /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e89cd9de-13fa-4df8-9ef8-bd6a551a201c {{(pid=87230) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 09 14:39:04 devstack cinder-volume[87230]: INFO cinder.image.image_utils [None req-158a6dcf-6322-4bb5-95bd-d36ddea6c021 tempest-VolumesSnapshotTestJSON-1821027228 None] Converted 1024.00 MB image at 174.78 MB/s
Jul 09 14:39:04 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-158a6dcf-6322-4bb5-95bd-d36ddea6c021 tempest-VolumesSnapshotTestJSON-1821027228 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e89cd9de-13fa-4df8-9ef8-bd6a551a201c is being set with open permissions: ugo+rw
Jul 09 14:39:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-158a6dcf-6322-4bb5-95bd-d36ddea6c021 tempest-VolumesSnapshotTestJSON-1821027228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e89cd9de-13fa-4df8-9ef8-bd6a551a201c {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:39:04 devstack sudo[96351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e89cd9de-13fa-4df8-9ef8-bd6a551a201c
Jul 09 14:39:04 devstack sudo[96351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:39:04 devstack sudo[96351]: pam_unix(sudo:session): session closed for user root
Jul 09 14:39:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-158a6dcf-6322-4bb5-95bd-d36ddea6c021 tempest-VolumesSnapshotTestJSON-1821027228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e89cd9de-13fa-4df8-9ef8-bd6a551a201c" returned: 0 in 0.658s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:39:04 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-158a6dcf-6322-4bb5-95bd-d36ddea6c021 tempest-VolumesSnapshotTestJSON-1821027228 None] Lock "cinder-quobyte-e89cd9de-13fa-4df8-9ef8-bd6a551a201c" released by "_copy_volume_from_snapshot" :: held 9.499s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:39:04 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-158a6dcf-6322-4bb5-95bd-d36ddea6c021 tempest-VolumesSnapshotTestJSON-1821027228 None] Lock "cinder-quobyte-2ebdc78b-1dcc-4014-bbf5-535ce43e1b29-e89cd9de-13fa-4df8-9ef8-bd6a551a201c" released by "_create_volume_from_snapshot" :: held 9.547s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:39:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-158a6dcf-6322-4bb5-95bd-d36ddea6c021 tempest-VolumesSnapshotTestJSON-1821027228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.568s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:39:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-35c38788-7e6d-41b7-8ea6-1c72803d8160 req-1a0390da-7197-46fa-9524-6ad0ef1d1254 tempest-AttachVolumeTestJSON-1021532728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 5.507s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:39:05 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c16c0e-2ced-40de-9fb5-35cdac20b62c]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:39:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-35c38788-7e6d-41b7-8ea6-1c72803d8160 req-1a0390da-7197-46fa-9524-6ad0ef1d1254 tempest-AttachVolumeTestJSON-1021532728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1133595f-7c70-4572-9dc7-c4954a7c4448 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:39:05 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-158a6dcf-6322-4bb5-95bd-d36ddea6c021 tempest-VolumesSnapshotTestJSON-1821027228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (621f27cb-d359-405e-8c57-8d10b65bf7ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e89cd9de-13fa-4df8-9ef8-bd6a551a201c', 'volume_size': 1, 'snapshot_id': '2ebdc78b-1dcc-4014-bbf5-535ce43e1b29'}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:39:05 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-158a6dcf-6322-4bb5-95bd-d36ddea6c021 tempest-VolumesSnapshotTestJSON-1821027228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b863a4a-35e3-46a8-8b16-dd77c9996c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:39:05 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-158a6dcf-6322-4bb5-95bd-d36ddea6c021 tempest-VolumesSnapshotTestJSON-1821027228 None] Volume volume-e89cd9de-13fa-4df8-9ef8-bd6a551a201c (e89cd9de-13fa-4df8-9ef8-bd6a551a201c): created successfully
Jul 09 14:39:05 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-158a6dcf-6322-4bb5-95bd-d36ddea6c021 tempest-VolumesSnapshotTestJSON-1821027228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b863a4a-35e3-46a8-8b16-dd77c9996c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:39:05 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-158a6dcf-6322-4bb5-95bd-d36ddea6c021 tempest-VolumesSnapshotTestJSON-1821027228 None] Flow 'volume_create_manager' (bdb22a3d-2ac1-43e4-bb20-040f81bcee60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:39:05 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-158a6dcf-6322-4bb5-95bd-d36ddea6c021 tempest-VolumesSnapshotTestJSON-1821027228 None] Created volume successfully.
Jul 09 14:39:05 devstack sudo[96354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1133595f-7c70-4572-9dc7-c4954a7c4448
Jul 09 14:39:05 devstack sudo[96354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:39:05 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-efe00b41-4833-49f0-bdff-c0c30782ec9e tempest-VolumesSnapshotTestJSON-1821027228 None] Acquiring lock "cinder-e89cd9de-13fa-4df8-9ef8-bd6a551a201c-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:39:05 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-efe00b41-4833-49f0-bdff-c0c30782ec9e tempest-VolumesSnapshotTestJSON-1821027228 None] Lock "cinder-e89cd9de-13fa-4df8-9ef8-bd6a551a201c-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:39:05 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-efe00b41-4833-49f0-bdff-c0c30782ec9e tempest-VolumesSnapshotTestJSON-1821027228 None] Acquiring lock "cinder-quobyte-e89cd9de-13fa-4df8-9ef8-bd6a551a201c" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:39:05 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-efe00b41-4833-49f0-bdff-c0c30782ec9e tempest-VolumesSnapshotTestJSON-1821027228 None] Lock "cinder-quobyte-e89cd9de-13fa-4df8-9ef8-bd6a551a201c" acquired by "delete_volume" :: waited 0.026s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:39:05 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d7563f1-9e6c-4274-ae90-812c2763ac74]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:39:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-efe00b41-4833-49f0-bdff-c0c30782ec9e tempest-VolumesSnapshotTestJSON-1821027228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e89cd9de-13fa-4df8-9ef8-bd6a551a201c {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:39:05 devstack sudo[96354]: pam_unix(sudo:session): session closed for user root
Jul 09 14:39:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-35c38788-7e6d-41b7-8ea6-1c72803d8160 req-1a0390da-7197-46fa-9524-6ad0ef1d1254 tempest-AttachVolumeTestJSON-1021532728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1133595f-7c70-4572-9dc7-c4954a7c4448" returned: 0 in 0.930s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:39:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-35c38788-7e6d-41b7-8ea6-1c72803d8160 req-1a0390da-7197-46fa-9524-6ad0ef1d1254 tempest-AttachVolumeTestJSON-1021532728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.957s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:39:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8047adc7-ffda-4130-b47e-a357b5fdd6e5 tempest-GroupsTest-854722394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.378s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:39:05 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-8047adc7-ffda-4130-b47e-a357b5fdd6e5 tempest-GroupsTest-854722394 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=eefa8312-48ff-466e-b206-067de1f389da,created_at=2026-07-09T12:39:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-809699659',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=eefa8312-48ff-466e-b206-067de1f389da,host='devstack@QuobyteHD#QuobyteHD',id=8240833f-a6d3-478d-827f-bb95ee48149f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bf301d005dd46db8b5252a25d908e4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:39:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:39:03Z,use_quota=True,user_id='1766ba551cfb4f7ba9d779568a0c6935',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab7c3e59-c67a-4dc2-87c9-a211e1b28195),volume_type_id=ab7c3e59-c67a-4dc2-87c9-a211e1b28195)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:39:05 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-8047adc7-ffda-4130-b47e-a357b5fdd6e5 tempest-GroupsTest-854722394 None] Creating volume 8240833f-a6d3-478d-827f-bb95ee48149f {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:39:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8047adc7-ffda-4130-b47e-a357b5fdd6e5 tempest-GroupsTest-854722394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:39:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8047adc7-ffda-4130-b47e-a357b5fdd6e5 tempest-GroupsTest-854722394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:39:05 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-8047adc7-ffda-4130-b47e-a357b5fdd6e5 tempest-GroupsTest-854722394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:39:05 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-8047adc7-ffda-4130-b47e-a357b5fdd6e5 tempest-GroupsTest-854722394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:39:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8047adc7-ffda-4130-b47e-a357b5fdd6e5 tempest-GroupsTest-854722394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:39:05 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-8047adc7-ffda-4130-b47e-a357b5fdd6e5 tempest-GroupsTest-854722394 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:39:05 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-8047adc7-ffda-4130-b47e-a357b5fdd6e5 tempest-GroupsTest-854722394 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:39:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8047adc7-ffda-4130-b47e-a357b5fdd6e5 tempest-GroupsTest-854722394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8240833f-a6d3-478d-827f-bb95ee48149f 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:39:06 devstack sudo[96361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8240833f-a6d3-478d-827f-bb95ee48149f 1073741824
Jul 09 14:39:06 devstack sudo[96361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:39:06 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-35c38788-7e6d-41b7-8ea6-1c72803d8160 req-1a0390da-7197-46fa-9524-6ad0ef1d1254 tempest-AttachVolumeTestJSON-1021532728 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653', 'name': 'volume-1133595f-7c70-4572-9dc7-c4954a7c4448', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '61567400-3edc-4d54-a044-a884938035a6', 'enforce_multipath': True} {{(pid=87230) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 09 14:39:06 devstack sudo[96360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e89cd9de-13fa-4df8-9ef8-bd6a551a201c
Jul 09 14:39:06 devstack sudo[96360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:39:06 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-35c38788-7e6d-41b7-8ea6-1c72803d8160 req-1a0390da-7197-46fa-9524-6ad0ef1d1254 tempest-AttachVolumeTestJSON-1021532728 None] attachment_update completed successfully.
Jul 09 14:39:06 devstack sudo[96360]: pam_unix(sudo:session): session closed for user root
Jul 09 14:39:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-efe00b41-4833-49f0-bdff-c0c30782ec9e tempest-VolumesSnapshotTestJSON-1821027228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e89cd9de-13fa-4df8-9ef8-bd6a551a201c" returned: 0 in 0.983s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:39:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-efe00b41-4833-49f0-bdff-c0c30782ec9e tempest-VolumesSnapshotTestJSON-1821027228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e89cd9de-13fa-4df8-9ef8-bd6a551a201c {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:39:06 devstack sudo[96438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e89cd9de-13fa-4df8-9ef8-bd6a551a201c
Jul 09 14:39:06 devstack sudo[96438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:39:07 devstack sudo[96361]: pam_unix(sudo:session): session closed for user root
Jul 09 14:39:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8047adc7-ffda-4130-b47e-a357b5fdd6e5 tempest-GroupsTest-854722394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8240833f-a6d3-478d-827f-bb95ee48149f 1073741824" returned: 0 in 1.087s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:39:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8047adc7-ffda-4130-b47e-a357b5fdd6e5 tempest-GroupsTest-854722394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8240833f-a6d3-478d-827f-bb95ee48149f {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:39:07 devstack sudo[96440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8240833f-a6d3-478d-827f-bb95ee48149f
Jul 09 14:39:07 devstack sudo[96440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:39:07 devstack sudo[96438]: pam_unix(sudo:session): session closed for user root
Jul 09 14:39:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-efe00b41-4833-49f0-bdff-c0c30782ec9e tempest-VolumesSnapshotTestJSON-1821027228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e89cd9de-13fa-4df8-9ef8-bd6a551a201c" returned: 0 in 0.812s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:39:07 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-efe00b41-4833-49f0-bdff-c0c30782ec9e tempest-VolumesSnapshotTestJSON-1821027228 None] Lock "cinder-quobyte-e89cd9de-13fa-4df8-9ef8-bd6a551a201c" released by "delete_volume" :: held 1.857s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:39:07 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-efe00b41-4833-49f0-bdff-c0c30782ec9e tempest-VolumesSnapshotTestJSON-1821027228 None] Created reservations ['38c0502b-48dd-4540-9624-7138e143e87f', '8955f509-d40c-4e31-a4fe-9ab95b26ff09', '1c63918c-3463-4239-8e58-da053bb4c5a7', '506c3f8b-6cc4-4d06-8a49-f0f306ab96d8'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:39:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-efe00b41-4833-49f0-bdff-c0c30782ec9e tempest-VolumesSnapshotTestJSON-1821027228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:39:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-efe00b41-4833-49f0-bdff-c0c30782ec9e tempest-VolumesSnapshotTestJSON-1821027228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:39:07 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-efe00b41-4833-49f0-bdff-c0c30782ec9e tempest-VolumesSnapshotTestJSON-1821027228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:39:07 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-efe00b41-4833-49f0-bdff-c0c30782ec9e tempest-VolumesSnapshotTestJSON-1821027228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:39:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-efe00b41-4833-49f0-bdff-c0c30782ec9e tempest-VolumesSnapshotTestJSON-1821027228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:39:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-efe00b41-4833-49f0-bdff-c0c30782ec9e tempest-VolumesSnapshotTestJSON-1821027228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:39:07 devstack sudo[96440]: pam_unix(sudo:session): session closed for user root
Jul 09 14:39:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8047adc7-ffda-4130-b47e-a357b5fdd6e5 tempest-GroupsTest-854722394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8240833f-a6d3-478d-827f-bb95ee48149f" returned: 0 in 0.789s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:39:07 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-8047adc7-ffda-4130-b47e-a357b5fdd6e5 tempest-GroupsTest-854722394 None] <== create_volume: return (1949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:39:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8047adc7-ffda-4130-b47e-a357b5fdd6e5 tempest-GroupsTest-854722394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.953s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:39:07 devstack sudo[96759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:39:07 devstack sudo[96759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:39:07 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8047adc7-ffda-4130-b47e-a357b5fdd6e5 tempest-GroupsTest-854722394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2159013-ecdf-4ad0-9419-09a446ff5b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8240833f-a6d3-478d-827f-bb95ee48149f', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:39:07 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8047adc7-ffda-4130-b47e-a357b5fdd6e5 tempest-GroupsTest-854722394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d3222b9-7955-4f72-b303-4878ac4db212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:39:07 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-8047adc7-ffda-4130-b47e-a357b5fdd6e5 tempest-GroupsTest-854722394 None] Volume volume-8240833f-a6d3-478d-827f-bb95ee48149f (8240833f-a6d3-478d-827f-bb95ee48149f): created successfully
Jul 09 14:39:07 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8047adc7-ffda-4130-b47e-a357b5fdd6e5 tempest-GroupsTest-854722394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d3222b9-7955-4f72-b303-4878ac4db212) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:39:07 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8047adc7-ffda-4130-b47e-a357b5fdd6e5 tempest-GroupsTest-854722394 None] Flow 'volume_create_manager' (d509e3d8-0c72-44fd-a7e2-588bc246e9d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:39:07 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-8047adc7-ffda-4130-b47e-a357b5fdd6e5 tempest-GroupsTest-854722394 None] Created volume successfully.
Jul 09 14:39:08 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-5e64a0a0-aed0-45ff-8674-d7c75eac6044 tempest-VolumesSnapshotTestJSON-1821027228 None] Acquiring lock "cinder-2ebdc78b-1dcc-4014-bbf5-535ce43e1b29-delete_snapshot" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:39:08 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-5e64a0a0-aed0-45ff-8674-d7c75eac6044 tempest-VolumesSnapshotTestJSON-1821027228 None] Lock "cinder-2ebdc78b-1dcc-4014-bbf5-535ce43e1b29-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:39:08 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-5e64a0a0-aed0-45ff-8674-d7c75eac6044 tempest-VolumesSnapshotTestJSON-1821027228 None] Acquiring lock "cinder-quobyte-7494f569-aff5-4c6a-a3fb-5838e96343ff" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:39:08 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-5e64a0a0-aed0-45ff-8674-d7c75eac6044 tempest-VolumesSnapshotTestJSON-1821027228 None] Lock "cinder-quobyte-7494f569-aff5-4c6a-a3fb-5838e96343ff" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:39:08 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-5e64a0a0-aed0-45ff-8674-d7c75eac6044 tempest-VolumesSnapshotTestJSON-1821027228 None] Acquiring lock "cinder-quobyte-2ebdc78b-1dcc-4014-bbf5-535ce43e1b29" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:39:08 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-5e64a0a0-aed0-45ff-8674-d7c75eac6044 tempest-VolumesSnapshotTestJSON-1821027228 None] Lock "cinder-quobyte-2ebdc78b-1dcc-4014-bbf5-535ce43e1b29" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:39:08 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-5e64a0a0-aed0-45ff-8674-d7c75eac6044 tempest-VolumesSnapshotTestJSON-1821027228 None] Deleting offline snapshot 2ebdc78b-1dcc-4014-bbf5-535ce43e1b29 of volume 7494f569-aff5-4c6a-a3fb-5838e96343ff {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 14:39:08 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-5e64a0a0-aed0-45ff-8674-d7c75eac6044 tempest-VolumesSnapshotTestJSON-1821027228 None] snapshot_file for this snap is: volume-7494f569-aff5-4c6a-a3fb-5838e96343ff.2ebdc78b-1dcc-4014-bbf5-535ce43e1b29 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 14:39:08 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e9e422-d1c6-47d6-bf85-091a52918b8e]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:39:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5e64a0a0-aed0-45ff-8674-d7c75eac6044 tempest-VolumesSnapshotTestJSON-1821027228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7494f569-aff5-4c6a-a3fb-5838e96343ff.2ebdc78b-1dcc-4014-bbf5-535ce43e1b29 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:39:08 devstack sudo[96762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7494f569-aff5-4c6a-a3fb-5838e96343ff.2ebdc78b-1dcc-4014-bbf5-535ce43e1b29
Jul 09 14:39:08 devstack sudo[96762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:39:08 devstack sudo[96759]: pam_unix(sudo:session): session closed for user root
Jul 09 14:39:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-efe00b41-4833-49f0-bdff-c0c30782ec9e tempest-VolumesSnapshotTestJSON-1821027228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.909s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:39:08 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-efe00b41-4833-49f0-bdff-c0c30782ec9e tempest-VolumesSnapshotTestJSON-1821027228 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:39:08 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-efe00b41-4833-49f0-bdff-c0c30782ec9e tempest-VolumesSnapshotTestJSON-1821027228 None] Deleted volume successfully.
Jul 09 14:39:08 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-efe00b41-4833-49f0-bdff-c0c30782ec9e tempest-VolumesSnapshotTestJSON-1821027228 None] Lock "cinder-e89cd9de-13fa-4df8-9ef8-bd6a551a201c-delete_volume" released by "delete_volume" :: held 3.056s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:39:09 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-87464968-b24b-45d1-af2b-786e9eb6e5c2 tempest-GroupsTest-854722394 None] Acquiring lock "cinder-quobyte-8240833f-a6d3-478d-827f-bb95ee48149f" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:39:09 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-87464968-b24b-45d1-af2b-786e9eb6e5c2 tempest-GroupsTest-854722394 None] Lock "cinder-quobyte-8240833f-a6d3-478d-827f-bb95ee48149f" acquired by "delete_volume" :: waited 0.022s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:39:09 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3df0b00-348b-43b5-8c80-3452cb7c7e01]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:39:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-87464968-b24b-45d1-af2b-786e9eb6e5c2 tempest-GroupsTest-854722394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8240833f-a6d3-478d-827f-bb95ee48149f {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:39:09 devstack sudo[96771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8240833f-a6d3-478d-827f-bb95ee48149f
Jul 09 14:39:09 devstack sudo[96771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:39:09 devstack sudo[96762]: pam_unix(sudo:session): session closed for user root
Jul 09 14:39:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5e64a0a0-aed0-45ff-8674-d7c75eac6044 tempest-VolumesSnapshotTestJSON-1821027228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7494f569-aff5-4c6a-a3fb-5838e96343ff.2ebdc78b-1dcc-4014-bbf5-535ce43e1b29" returned: 0 in 1.045s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:39:09 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-5e64a0a0-aed0-45ff-8674-d7c75eac6044 tempest-VolumesSnapshotTestJSON-1821027228 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7494f569-aff5-4c6a-a3fb-5838e96343ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 14:39:09 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc8df35-c634-4f34-ba39-eb9e11f6a4c7]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:39:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5e64a0a0-aed0-45ff-8674-d7c75eac6044 tempest-VolumesSnapshotTestJSON-1821027228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7494f569-aff5-4c6a-a3fb-5838e96343ff {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:39:09 devstack sudo[96773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7494f569-aff5-4c6a-a3fb-5838e96343ff
Jul 09 14:39:09 devstack sudo[96773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:39:10 devstack sudo[96771]: pam_unix(sudo:session): session closed for user root
Jul 09 14:39:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-87464968-b24b-45d1-af2b-786e9eb6e5c2 tempest-GroupsTest-854722394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8240833f-a6d3-478d-827f-bb95ee48149f" returned: 0 in 0.866s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:39:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-87464968-b24b-45d1-af2b-786e9eb6e5c2 tempest-GroupsTest-854722394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8240833f-a6d3-478d-827f-bb95ee48149f {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:39:10 devstack sudo[96781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8240833f-a6d3-478d-827f-bb95ee48149f
Jul 09 14:39:10 devstack sudo[96781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:39:10 devstack sudo[96773]: pam_unix(sudo:session): session closed for user root
Jul 09 14:39:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5e64a0a0-aed0-45ff-8674-d7c75eac6044 tempest-VolumesSnapshotTestJSON-1821027228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7494f569-aff5-4c6a-a3fb-5838e96343ff" returned: 0 in 0.869s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:39:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5e64a0a0-aed0-45ff-8674-d7c75eac6044 tempest-VolumesSnapshotTestJSON-1821027228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7494f569-aff5-4c6a-a3fb-5838e96343ff.2ebdc78b-1dcc-4014-bbf5-535ce43e1b29 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:39:10 devstack sudo[96784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7494f569-aff5-4c6a-a3fb-5838e96343ff.2ebdc78b-1dcc-4014-bbf5-535ce43e1b29
Jul 09 14:39:10 devstack sudo[96784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:39:10 devstack sudo[96781]: pam_unix(sudo:session): session closed for user root
Jul 09 14:39:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-87464968-b24b-45d1-af2b-786e9eb6e5c2 tempest-GroupsTest-854722394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8240833f-a6d3-478d-827f-bb95ee48149f" returned: 0 in 0.723s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:39:10 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-87464968-b24b-45d1-af2b-786e9eb6e5c2 tempest-GroupsTest-854722394 None] Lock "cinder-quobyte-8240833f-a6d3-478d-827f-bb95ee48149f" released by "delete_volume" :: held 1.641s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:39:10 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-87464968-b24b-45d1-af2b-786e9eb6e5c2 tempest-GroupsTest-854722394 None] Created reservations ['11c01138-edc2-4c08-a3bb-392e3672336c'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:39:10 devstack cinder-volume[87230]: WARNING cinder.quota [None req-87464968-b24b-45d1-af2b-786e9eb6e5c2 tempest-GroupsTest-854722394 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-608134887 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-608134887, it is now deprecated. Please use the default quota class for default quota.
Jul 09 14:39:10 devstack cinder-volume[87230]: WARNING cinder.quota [None req-87464968-b24b-45d1-af2b-786e9eb6e5c2 tempest-GroupsTest-854722394 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-608134887 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-608134887, it is now deprecated. Please use the default quota class for default quota.
Jul 09 14:39:10 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-87464968-b24b-45d1-af2b-786e9eb6e5c2 tempest-GroupsTest-854722394 None] Created reservations ['7187edac-924d-49ef-98ab-f42f01ef05c1', 'd334c25b-e5c6-480d-bd45-e507440ed823', '1a2216c9-4afe-4ca1-99ed-d57367a67661', 'a23b8591-ce0e-4a9d-be1e-31eb1585e1e6'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:39:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-87464968-b24b-45d1-af2b-786e9eb6e5c2 tempest-GroupsTest-854722394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:39:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-87464968-b24b-45d1-af2b-786e9eb6e5c2 tempest-GroupsTest-854722394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:39:11 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-87464968-b24b-45d1-af2b-786e9eb6e5c2 tempest-GroupsTest-854722394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:39:11 devstack sudo[96784]: pam_unix(sudo:session): session closed for user root
Jul 09 14:39:11 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-87464968-b24b-45d1-af2b-786e9eb6e5c2 tempest-GroupsTest-854722394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:39:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-87464968-b24b-45d1-af2b-786e9eb6e5c2 tempest-GroupsTest-854722394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:39:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-87464968-b24b-45d1-af2b-786e9eb6e5c2 tempest-GroupsTest-854722394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:39:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5e64a0a0-aed0-45ff-8674-d7c75eac6044 tempest-VolumesSnapshotTestJSON-1821027228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7494f569-aff5-4c6a-a3fb-5838e96343ff.2ebdc78b-1dcc-4014-bbf5-535ce43e1b29" returned: 0 in 0.870s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:39:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5e64a0a0-aed0-45ff-8674-d7c75eac6044 tempest-VolumesSnapshotTestJSON-1821027228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7494f569-aff5-4c6a-a3fb-5838e96343ff.2ebdc78b-1dcc-4014-bbf5-535ce43e1b29 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:39:11 devstack sudo[96791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:39:11 devstack sudo[96791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:39:11 devstack sudo[96792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7494f569-aff5-4c6a-a3fb-5838e96343ff.2ebdc78b-1dcc-4014-bbf5-535ce43e1b29
Jul 09 14:39:11 devstack sudo[96792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:39:11 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-f5aacfb3-e3b8-44db-a67c-28ca9fd4bde8 tempest-GroupsTest-854722394 None] Created reservations ['6df3156f-7499-4e38-b706-f9eeeb615445'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:39:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f5aacfb3-e3b8-44db-a67c-28ca9fd4bde8 tempest-GroupsTest-854722394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:39:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f5aacfb3-e3b8-44db-a67c-28ca9fd4bde8 tempest-GroupsTest-854722394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:39:11 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f5aacfb3-e3b8-44db-a67c-28ca9fd4bde8 tempest-GroupsTest-854722394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:39:11 devstack sudo[96792]: pam_unix(sudo:session): session closed for user root
Jul 09 14:39:11 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f5aacfb3-e3b8-44db-a67c-28ca9fd4bde8 tempest-GroupsTest-854722394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:39:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f5aacfb3-e3b8-44db-a67c-28ca9fd4bde8 tempest-GroupsTest-854722394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:39:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f5aacfb3-e3b8-44db-a67c-28ca9fd4bde8 tempest-GroupsTest-854722394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:39:11 devstack sudo[96791]: pam_unix(sudo:session): session closed for user root
Jul 09 14:39:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5e64a0a0-aed0-45ff-8674-d7c75eac6044 tempest-VolumesSnapshotTestJSON-1821027228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7494f569-aff5-4c6a-a3fb-5838e96343ff.2ebdc78b-1dcc-4014-bbf5-535ce43e1b29" returned: 0 in 0.810s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:39:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-87464968-b24b-45d1-af2b-786e9eb6e5c2 tempest-GroupsTest-854722394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.836s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:39:11 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-87464968-b24b-45d1-af2b-786e9eb6e5c2 tempest-GroupsTest-854722394 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:39:11 devstack sudo[96797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:39:11 devstack sudo[96797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:39:11 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-87464968-b24b-45d1-af2b-786e9eb6e5c2 tempest-GroupsTest-854722394 None] Delete group completed successfully.
Jul 09 14:39:11 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-5e64a0a0-aed0-45ff-8674-d7c75eac6044 tempest-VolumesSnapshotTestJSON-1821027228 None] Lock "cinder-quobyte-2ebdc78b-1dcc-4014-bbf5-535ce43e1b29" released by "_delete_snapshot" :: held 3.743s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:39:12 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-5e64a0a0-aed0-45ff-8674-d7c75eac6044 tempest-VolumesSnapshotTestJSON-1821027228 None] Lock "cinder-quobyte-7494f569-aff5-4c6a-a3fb-5838e96343ff" released by "delete_snapshot" :: held 3.782s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:39:12 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-5e64a0a0-aed0-45ff-8674-d7c75eac6044 tempest-VolumesSnapshotTestJSON-1821027228 None] Created reservations ['fc2e4a8b-3460-497f-b85b-ac66d80f25b3', '9e32452f-125c-4a1e-9775-9d46de5092d8', 'd662b5ca-ea78-4d62-a4ce-cb74cf7ee4c4', 'eabef2d1-d87d-457f-80ee-474a72a757e3'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:39:12 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-5e64a0a0-aed0-45ff-8674-d7c75eac6044 tempest-VolumesSnapshotTestJSON-1821027228 None] Delete snapshot completed successfully.
Jul 09 14:39:12 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-5e64a0a0-aed0-45ff-8674-d7c75eac6044 tempest-VolumesSnapshotTestJSON-1821027228 None] Lock "cinder-2ebdc78b-1dcc-4014-bbf5-535ce43e1b29-delete_snapshot" released by "delete_snapshot" :: held 4.052s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:39:12 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb4e7c93-d854-461d-807e-4e4e093de121 tempest-AttachVolumeTestJSON-1021532728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:39:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-cb4e7c93-d854-461d-807e-4e4e093de121 tempest-AttachVolumeTestJSON-1021532728 None] Flow 'volume_create_manager' (f339bd60-3d62-437a-ba04-8048c539c892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:39:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-cb4e7c93-d854-461d-807e-4e4e093de121 tempest-AttachVolumeTestJSON-1021532728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61cc3d0a-4a9c-4d68-9560-cf18e20aa09c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:39:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-cb4e7c93-d854-461d-807e-4e4e093de121 tempest-AttachVolumeTestJSON-1021532728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61cc3d0a-4a9c-4d68-9560-cf18e20aa09c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:39:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1205706213',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b18e5cfa-10ed-457b-8480-2744c415d925,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b915bfaa50d440baa3438aa2107e537d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:39:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:39:12Z,use_quota=True,user_id='c37e6e905ebe4532a515ec945d11fb0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:39:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-cb4e7c93-d854-461d-807e-4e4e093de121 tempest-AttachVolumeTestJSON-1021532728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8675cffa-a059-4cc9-92f4-e738c795241f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:39:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-cb4e7c93-d854-461d-807e-4e4e093de121 tempest-AttachVolumeTestJSON-1021532728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8675cffa-a059-4cc9-92f4-e738c795241f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:39:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-cb4e7c93-d854-461d-807e-4e4e093de121 tempest-AttachVolumeTestJSON-1021532728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (304a1494-0961-4866-bc0c-411b083700e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:39:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-cb4e7c93-d854-461d-807e-4e4e093de121 tempest-AttachVolumeTestJSON-1021532728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (304a1494-0961-4866-bc0c-411b083700e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b18e5cfa-10ed-457b-8480-2744c415d925', 'volume_name': 'volume-b18e5cfa-10ed-457b-8480-2744c415d925', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:39:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-cb4e7c93-d854-461d-807e-4e4e093de121 tempest-AttachVolumeTestJSON-1021532728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24c56db7-bae1-4b19-98d0-636534dea162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:39:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-cb4e7c93-d854-461d-807e-4e4e093de121 tempest-AttachVolumeTestJSON-1021532728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24c56db7-bae1-4b19-98d0-636534dea162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:39:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-cb4e7c93-d854-461d-807e-4e4e093de121 tempest-AttachVolumeTestJSON-1021532728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fbf98d4-dd38-4ed5-b18f-7158d7a49d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:39:12 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-cb4e7c93-d854-461d-807e-4e4e093de121 tempest-AttachVolumeTestJSON-1021532728 None] Volume b18e5cfa-10ed-457b-8480-2744c415d925: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b18e5cfa-10ed-457b-8480-2744c415d925', 'volume_size': 1}
Jul 09 14:39:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-cb4e7c93-d854-461d-807e-4e4e093de121 tempest-AttachVolumeTestJSON-1021532728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:39:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-cb4e7c93-d854-461d-807e-4e4e093de121 tempest-AttachVolumeTestJSON-1021532728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:39:12 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-cb4e7c93-d854-461d-807e-4e4e093de121 tempest-AttachVolumeTestJSON-1021532728 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:39:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1205706213',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b18e5cfa-10ed-457b-8480-2744c415d925,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b915bfaa50d440baa3438aa2107e537d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:39:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:39:12Z,use_quota=True,user_id='c37e6e905ebe4532a515ec945d11fb0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:39:12 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-cb4e7c93-d854-461d-807e-4e4e093de121 tempest-AttachVolumeTestJSON-1021532728 None] Creating volume b18e5cfa-10ed-457b-8480-2744c415d925 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:39:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-cb4e7c93-d854-461d-807e-4e4e093de121 tempest-AttachVolumeTestJSON-1021532728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:39:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-cb4e7c93-d854-461d-807e-4e4e093de121 tempest-AttachVolumeTestJSON-1021532728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:39:12 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-cb4e7c93-d854-461d-807e-4e4e093de121 tempest-AttachVolumeTestJSON-1021532728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:39:12 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-cb4e7c93-d854-461d-807e-4e4e093de121 tempest-AttachVolumeTestJSON-1021532728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:39:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-cb4e7c93-d854-461d-807e-4e4e093de121 tempest-AttachVolumeTestJSON-1021532728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:39:12 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-cb4e7c93-d854-461d-807e-4e4e093de121 tempest-AttachVolumeTestJSON-1021532728 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:39:12 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-cb4e7c93-d854-461d-807e-4e4e093de121 tempest-AttachVolumeTestJSON-1021532728 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:39:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-cb4e7c93-d854-461d-807e-4e4e093de121 tempest-AttachVolumeTestJSON-1021532728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b18e5cfa-10ed-457b-8480-2744c415d925 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:39:12 devstack sudo[96799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b18e5cfa-10ed-457b-8480-2744c415d925 1073741824
Jul 09 14:39:12 devstack sudo[96799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:39:12 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-69cef63a-d08e-4bf2-9ada-6f413d9a7fff tempest-VolumesSnapshotTestJSON-1821027228 None] Acquiring lock "cinder-7494f569-aff5-4c6a-a3fb-5838e96343ff-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:39:12 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-69cef63a-d08e-4bf2-9ada-6f413d9a7fff tempest-VolumesSnapshotTestJSON-1821027228 None] Lock "cinder-7494f569-aff5-4c6a-a3fb-5838e96343ff-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:39:12 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-69cef63a-d08e-4bf2-9ada-6f413d9a7fff tempest-VolumesSnapshotTestJSON-1821027228 None] Acquiring lock "cinder-quobyte-7494f569-aff5-4c6a-a3fb-5838e96343ff" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:39:12 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-69cef63a-d08e-4bf2-9ada-6f413d9a7fff tempest-VolumesSnapshotTestJSON-1821027228 None] Lock "cinder-quobyte-7494f569-aff5-4c6a-a3fb-5838e96343ff" acquired by "delete_volume" :: waited 0.023s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:39:12 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded340ac-a6f3-48bb-b148-66641761a785]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:39:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-69cef63a-d08e-4bf2-9ada-6f413d9a7fff tempest-VolumesSnapshotTestJSON-1821027228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7494f569-aff5-4c6a-a3fb-5838e96343ff {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:39:12 devstack sudo[96797]: pam_unix(sudo:session): session closed for user root
Jul 09 14:39:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f5aacfb3-e3b8-44db-a67c-28ca9fd4bde8 tempest-GroupsTest-854722394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.856s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:39:12 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-f5aacfb3-e3b8-44db-a67c-28ca9fd4bde8 tempest-GroupsTest-854722394 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:39:12 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-f5aacfb3-e3b8-44db-a67c-28ca9fd4bde8 tempest-GroupsTest-854722394 None] Delete group completed successfully.
Jul 09 14:39:12 devstack sudo[96802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7494f569-aff5-4c6a-a3fb-5838e96343ff
Jul 09 14:39:12 devstack sudo[96802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:39:13 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-1320c12a-1fa9-4f7b-a67c-a91ec4756129 tempest-GroupsTest-854722394 None] Group tempest-GroupsTest-Group-53841784: creating
Jul 09 14:39:13 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-1320c12a-1fa9-4f7b-a67c-a91ec4756129 tempest-GroupsTest-854722394 None] Group tempest-GroupsTest-Group-53841784: created successfully
Jul 09 14:39:13 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-1320c12a-1fa9-4f7b-a67c-a91ec4756129 tempest-GroupsTest-854722394 None] Create group completed successfully.
Jul 09 14:39:13 devstack sudo[96799]: pam_unix(sudo:session): session closed for user root
Jul 09 14:39:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-cb4e7c93-d854-461d-807e-4e4e093de121 tempest-AttachVolumeTestJSON-1021532728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b18e5cfa-10ed-457b-8480-2744c415d925 1073741824" returned: 0 in 1.107s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:39:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-cb4e7c93-d854-461d-807e-4e4e093de121 tempest-AttachVolumeTestJSON-1021532728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b18e5cfa-10ed-457b-8480-2744c415d925 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:39:13 devstack sudo[96812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b18e5cfa-10ed-457b-8480-2744c415d925
Jul 09 14:39:13 devstack sudo[96812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:39:13 devstack sudo[96802]: pam_unix(sudo:session): session closed for user root
Jul 09 14:39:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-69cef63a-d08e-4bf2-9ada-6f413d9a7fff tempest-VolumesSnapshotTestJSON-1821027228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7494f569-aff5-4c6a-a3fb-5838e96343ff" returned: 0 in 0.960s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:39:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-69cef63a-d08e-4bf2-9ada-6f413d9a7fff tempest-VolumesSnapshotTestJSON-1821027228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7494f569-aff5-4c6a-a3fb-5838e96343ff {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:39:13 devstack sudo[96814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7494f569-aff5-4c6a-a3fb-5838e96343ff
Jul 09 14:39:13 devstack sudo[96814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:39:14 devstack sudo[96812]: pam_unix(sudo:session): session closed for user root
Jul 09 14:39:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-cb4e7c93-d854-461d-807e-4e4e093de121 tempest-AttachVolumeTestJSON-1021532728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b18e5cfa-10ed-457b-8480-2744c415d925" returned: 0 in 0.739s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:39:14 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-cb4e7c93-d854-461d-807e-4e4e093de121 tempest-AttachVolumeTestJSON-1021532728 None] <== create_volume: return (1898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:39:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-cb4e7c93-d854-461d-807e-4e4e093de121 tempest-AttachVolumeTestJSON-1021532728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.902s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:39:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-cb4e7c93-d854-461d-807e-4e4e093de121 tempest-AttachVolumeTestJSON-1021532728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fbf98d4-dd38-4ed5-b18f-7158d7a49d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b18e5cfa-10ed-457b-8480-2744c415d925', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:39:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-cb4e7c93-d854-461d-807e-4e4e093de121 tempest-AttachVolumeTestJSON-1021532728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55a7eecd-32de-46b2-ba3c-2f7d78edca12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:39:14 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-cb4e7c93-d854-461d-807e-4e4e093de121 tempest-AttachVolumeTestJSON-1021532728 None] Volume volume-b18e5cfa-10ed-457b-8480-2744c415d925 (b18e5cfa-10ed-457b-8480-2744c415d925): created successfully
Jul 09 14:39:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-cb4e7c93-d854-461d-807e-4e4e093de121 tempest-AttachVolumeTestJSON-1021532728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55a7eecd-32de-46b2-ba3c-2f7d78edca12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:39:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-cb4e7c93-d854-461d-807e-4e4e093de121 tempest-AttachVolumeTestJSON-1021532728 None] Flow 'volume_create_manager' (f339bd60-3d62-437a-ba04-8048c539c892) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:39:14 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-cb4e7c93-d854-461d-807e-4e4e093de121 tempest-AttachVolumeTestJSON-1021532728 None] Created volume successfully.
Jul 09 14:39:14 devstack sudo[96814]: pam_unix(sudo:session): session closed for user root
Jul 09 14:39:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-69cef63a-d08e-4bf2-9ada-6f413d9a7fff tempest-VolumesSnapshotTestJSON-1821027228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7494f569-aff5-4c6a-a3fb-5838e96343ff" returned: 0 in 0.744s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:39:14 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-69cef63a-d08e-4bf2-9ada-6f413d9a7fff tempest-VolumesSnapshotTestJSON-1821027228 None] Lock "cinder-quobyte-7494f569-aff5-4c6a-a3fb-5838e96343ff" released by "delete_volume" :: held 1.784s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:39:14 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-69cef63a-d08e-4bf2-9ada-6f413d9a7fff tempest-VolumesSnapshotTestJSON-1821027228 None] Created reservations ['6f653e15-9742-4b5c-94ff-b864e1255700', '3c211291-3db4-4509-b5a8-78c303c954d9', '989b5468-57ba-429e-9837-f9188490001c', 'b3185f5a-f63c-425d-933d-e8a5c7fd413f'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:39:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-69cef63a-d08e-4bf2-9ada-6f413d9a7fff tempest-VolumesSnapshotTestJSON-1821027228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:39:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-69cef63a-d08e-4bf2-9ada-6f413d9a7fff tempest-VolumesSnapshotTestJSON-1821027228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:39:14 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-69cef63a-d08e-4bf2-9ada-6f413d9a7fff tempest-VolumesSnapshotTestJSON-1821027228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:39:14 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-69cef63a-d08e-4bf2-9ada-6f413d9a7fff tempest-VolumesSnapshotTestJSON-1821027228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:39:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-69cef63a-d08e-4bf2-9ada-6f413d9a7fff tempest-VolumesSnapshotTestJSON-1821027228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:39:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-69cef63a-d08e-4bf2-9ada-6f413d9a7fff tempest-VolumesSnapshotTestJSON-1821027228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:39:14 devstack sudo[96818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:39:14 devstack sudo[96818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:39:14 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a8c212af-37af-4d8a-9580-4e305cd317bd tempest-VolumesSnapshotTestJSON-1821027228 None] Acquiring lock "cinder-2525802b-76f2-4dec-b821-7edce8151967-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:39:14 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a8c212af-37af-4d8a-9580-4e305cd317bd tempest-VolumesSnapshotTestJSON-1821027228 None] Lock "cinder-2525802b-76f2-4dec-b821-7edce8151967-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:39:15 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a8c212af-37af-4d8a-9580-4e305cd317bd tempest-VolumesSnapshotTestJSON-1821027228 None] Acquiring lock "cinder-quobyte-2525802b-76f2-4dec-b821-7edce8151967" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:39:15 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a8c212af-37af-4d8a-9580-4e305cd317bd tempest-VolumesSnapshotTestJSON-1821027228 None] Lock "cinder-quobyte-2525802b-76f2-4dec-b821-7edce8151967" acquired by "delete_volume" :: waited 0.036s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:39:15 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[6acec906-e2af-4e39-8082-868b9026145f]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:39:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a8c212af-37af-4d8a-9580-4e305cd317bd tempest-VolumesSnapshotTestJSON-1821027228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2525802b-76f2-4dec-b821-7edce8151967 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:39:15 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-32a90ac1-410a-4861-9196-a91ae75e20ef tempest-GroupsTest-854722394 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:39:15 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-32a90ac1-410a-4861-9196-a91ae75e20ef tempest-GroupsTest-854722394 None] Flow 'volume_create_manager' (b9e1e0dd-68fb-4831-8c95-f095d96ff4f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:39:15 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-32a90ac1-410a-4861-9196-a91ae75e20ef tempest-GroupsTest-854722394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88ae3bad-5cfd-4ac6-8739-dd2e872cd8ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:39:15 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-32a90ac1-410a-4861-9196-a91ae75e20ef tempest-GroupsTest-854722394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88ae3bad-5cfd-4ac6-8739-dd2e872cd8ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:39:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1150569241',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=814f27f1-bcc9-44a3-985a-edd0debaf97e,host='devstack@QuobyteHD#QuobyteHD',id=44390c40-3af0-4cf2-81f9-ad14a3d274e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bf301d005dd46db8b5252a25d908e4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:39:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:39:15Z,use_quota=True,user_id='1766ba551cfb4f7ba9d779568a0c6935',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8580cea1-b7b1-41bf-acab-d9e86a6f99d2),volume_type_id=8580cea1-b7b1-41bf-acab-d9e86a6f99d2)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:39:15 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-32a90ac1-410a-4861-9196-a91ae75e20ef tempest-GroupsTest-854722394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45efed45-c621-4cef-a1c0-fc2fd324e4ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:39:15 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-32a90ac1-410a-4861-9196-a91ae75e20ef tempest-GroupsTest-854722394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45efed45-c621-4cef-a1c0-fc2fd324e4ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:39:15 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-32a90ac1-410a-4861-9196-a91ae75e20ef tempest-GroupsTest-854722394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a064fa2c-30e3-4964-ab04-bc5a6f933e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:39:15 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-32a90ac1-410a-4861-9196-a91ae75e20ef tempest-GroupsTest-854722394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a064fa2c-30e3-4964-ab04-bc5a6f933e61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44390c40-3af0-4cf2-81f9-ad14a3d274e3', 'volume_name': 'volume-44390c40-3af0-4cf2-81f9-ad14a3d274e3', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:39:15 devstack sudo[96820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2525802b-76f2-4dec-b821-7edce8151967
Jul 09 14:39:15 devstack sudo[96820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:39:15 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-32a90ac1-410a-4861-9196-a91ae75e20ef tempest-GroupsTest-854722394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3062976-77cb-4052-9004-8c4cbb7332a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:39:15 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-32a90ac1-410a-4861-9196-a91ae75e20ef tempest-GroupsTest-854722394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3062976-77cb-4052-9004-8c4cbb7332a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:39:15 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-32a90ac1-410a-4861-9196-a91ae75e20ef tempest-GroupsTest-854722394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4bdb2f7-410f-4f2f-b9d2-7f575a78c1bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:39:15 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-32a90ac1-410a-4861-9196-a91ae75e20ef tempest-GroupsTest-854722394 None] Volume 44390c40-3af0-4cf2-81f9-ad14a3d274e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44390c40-3af0-4cf2-81f9-ad14a3d274e3', 'volume_size': 1}
Jul 09 14:39:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-32a90ac1-410a-4861-9196-a91ae75e20ef tempest-GroupsTest-854722394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:39:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-32a90ac1-410a-4861-9196-a91ae75e20ef tempest-GroupsTest-854722394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:39:15 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-32a90ac1-410a-4861-9196-a91ae75e20ef tempest-GroupsTest-854722394 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=814f27f1-bcc9-44a3-985a-edd0debaf97e,created_at=2026-07-09T12:39:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1150569241',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=814f27f1-bcc9-44a3-985a-edd0debaf97e,host='devstack@QuobyteHD#QuobyteHD',id=44390c40-3af0-4cf2-81f9-ad14a3d274e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bf301d005dd46db8b5252a25d908e4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:39:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:39:15Z,use_quota=True,user_id='1766ba551cfb4f7ba9d779568a0c6935',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8580cea1-b7b1-41bf-acab-d9e86a6f99d2),volume_type_id=8580cea1-b7b1-41bf-acab-d9e86a6f99d2)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:39:15 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-32a90ac1-410a-4861-9196-a91ae75e20ef tempest-GroupsTest-854722394 None] Creating volume 44390c40-3af0-4cf2-81f9-ad14a3d274e3 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:39:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-32a90ac1-410a-4861-9196-a91ae75e20ef tempest-GroupsTest-854722394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:39:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-32a90ac1-410a-4861-9196-a91ae75e20ef tempest-GroupsTest-854722394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:39:15 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-32a90ac1-410a-4861-9196-a91ae75e20ef tempest-GroupsTest-854722394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:39:15 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-32a90ac1-410a-4861-9196-a91ae75e20ef tempest-GroupsTest-854722394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:39:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-32a90ac1-410a-4861-9196-a91ae75e20ef tempest-GroupsTest-854722394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:39:15 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-32a90ac1-410a-4861-9196-a91ae75e20ef tempest-GroupsTest-854722394 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:39:15 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-32a90ac1-410a-4861-9196-a91ae75e20ef tempest-GroupsTest-854722394 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:39:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-32a90ac1-410a-4861-9196-a91ae75e20ef tempest-GroupsTest-854722394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-44390c40-3af0-4cf2-81f9-ad14a3d274e3 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:39:15 devstack sudo[96823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-44390c40-3af0-4cf2-81f9-ad14a3d274e3 1073741824
Jul 09 14:39:15 devstack sudo[96823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:39:15 devstack sudo[96818]: pam_unix(sudo:session): session closed for user root
Jul 09 14:39:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-69cef63a-d08e-4bf2-9ada-6f413d9a7fff tempest-VolumesSnapshotTestJSON-1821027228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.977s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:39:15 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-69cef63a-d08e-4bf2-9ada-6f413d9a7fff tempest-VolumesSnapshotTestJSON-1821027228 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:39:15 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-69cef63a-d08e-4bf2-9ada-6f413d9a7fff tempest-VolumesSnapshotTestJSON-1821027228 None] Deleted volume successfully.
Jul 09 14:39:15 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-69cef63a-d08e-4bf2-9ada-6f413d9a7fff tempest-VolumesSnapshotTestJSON-1821027228 None] Lock "cinder-7494f569-aff5-4c6a-a3fb-5838e96343ff-delete_volume" released by "delete_volume" :: held 3.045s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:39:16 devstack sudo[96820]: pam_unix(sudo:session): session closed for user root
Jul 09 14:39:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a8c212af-37af-4d8a-9580-4e305cd317bd tempest-VolumesSnapshotTestJSON-1821027228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2525802b-76f2-4dec-b821-7edce8151967" returned: 0 in 1.006s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:39:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a8c212af-37af-4d8a-9580-4e305cd317bd tempest-VolumesSnapshotTestJSON-1821027228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2525802b-76f2-4dec-b821-7edce8151967 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:39:16 devstack sudo[96836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2525802b-76f2-4dec-b821-7edce8151967
Jul 09 14:39:16 devstack sudo[96836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:39:16 devstack sudo[96823]: pam_unix(sudo:session): session closed for user root
Jul 09 14:39:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-32a90ac1-410a-4861-9196-a91ae75e20ef tempest-GroupsTest-854722394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-44390c40-3af0-4cf2-81f9-ad14a3d274e3 1073741824" returned: 0 in 1.019s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:39:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-32a90ac1-410a-4861-9196-a91ae75e20ef tempest-GroupsTest-854722394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-44390c40-3af0-4cf2-81f9-ad14a3d274e3 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:39:16 devstack sudo[96838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-44390c40-3af0-4cf2-81f9-ad14a3d274e3
Jul 09 14:39:16 devstack sudo[96838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:39:16 devstack sudo[96836]: pam_unix(sudo:session): session closed for user root
Jul 09 14:39:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a8c212af-37af-4d8a-9580-4e305cd317bd tempest-VolumesSnapshotTestJSON-1821027228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2525802b-76f2-4dec-b821-7edce8151967" returned: 0 in 0.759s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:39:17 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a8c212af-37af-4d8a-9580-4e305cd317bd tempest-VolumesSnapshotTestJSON-1821027228 None] Lock "cinder-quobyte-2525802b-76f2-4dec-b821-7edce8151967" released by "delete_volume" :: held 1.877s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:39:17 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-a8c212af-37af-4d8a-9580-4e305cd317bd tempest-VolumesSnapshotTestJSON-1821027228 None] Created reservations ['8ca9a92f-8991-4635-a067-10f45e2a6a37', '49bd426c-bb96-4510-820e-f93400785c64', '1f08cccf-c2c0-47d1-b765-0d8589e2d6b0', '92d18a6d-e3fe-4dd7-8357-22d0c235bb16'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:39:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a8c212af-37af-4d8a-9580-4e305cd317bd tempest-VolumesSnapshotTestJSON-1821027228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:39:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a8c212af-37af-4d8a-9580-4e305cd317bd tempest-VolumesSnapshotTestJSON-1821027228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:39:17 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a8c212af-37af-4d8a-9580-4e305cd317bd tempest-VolumesSnapshotTestJSON-1821027228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:39:17 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a8c212af-37af-4d8a-9580-4e305cd317bd tempest-VolumesSnapshotTestJSON-1821027228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:39:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a8c212af-37af-4d8a-9580-4e305cd317bd tempest-VolumesSnapshotTestJSON-1821027228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:39:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a8c212af-37af-4d8a-9580-4e305cd317bd tempest-VolumesSnapshotTestJSON-1821027228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:39:17 devstack sudo[96842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:39:17 devstack sudo[96842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:39:17 devstack sudo[96838]: pam_unix(sudo:session): session closed for user root
Jul 09 14:39:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-32a90ac1-410a-4861-9196-a91ae75e20ef tempest-GroupsTest-854722394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-44390c40-3af0-4cf2-81f9-ad14a3d274e3" returned: 0 in 0.698s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:39:17 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-32a90ac1-410a-4861-9196-a91ae75e20ef tempest-GroupsTest-854722394 None] <== create_volume: return (1809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:39:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-32a90ac1-410a-4861-9196-a91ae75e20ef tempest-GroupsTest-854722394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.813s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:39:17 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-32a90ac1-410a-4861-9196-a91ae75e20ef tempest-GroupsTest-854722394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4bdb2f7-410f-4f2f-b9d2-7f575a78c1bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44390c40-3af0-4cf2-81f9-ad14a3d274e3', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:39:17 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-32a90ac1-410a-4861-9196-a91ae75e20ef tempest-GroupsTest-854722394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (267d3e8d-fca6-4293-95c5-37fb67349c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:39:17 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-32a90ac1-410a-4861-9196-a91ae75e20ef tempest-GroupsTest-854722394 None] Volume volume-44390c40-3af0-4cf2-81f9-ad14a3d274e3 (44390c40-3af0-4cf2-81f9-ad14a3d274e3): created successfully
Jul 09 14:39:17 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-32a90ac1-410a-4861-9196-a91ae75e20ef tempest-GroupsTest-854722394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (267d3e8d-fca6-4293-95c5-37fb67349c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:39:17 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-32a90ac1-410a-4861-9196-a91ae75e20ef tempest-GroupsTest-854722394 None] Flow 'volume_create_manager' (b9e1e0dd-68fb-4831-8c95-f095d96ff4f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:39:17 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-32a90ac1-410a-4861-9196-a91ae75e20ef tempest-GroupsTest-854722394 None] Created volume successfully.
Jul 09 14:39:17 devstack sudo[96842]: pam_unix(sudo:session): session closed for user root
Jul 09 14:39:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a8c212af-37af-4d8a-9580-4e305cd317bd tempest-VolumesSnapshotTestJSON-1821027228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.720s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:39:17 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-a8c212af-37af-4d8a-9580-4e305cd317bd tempest-VolumesSnapshotTestJSON-1821027228 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:39:17 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-a8c212af-37af-4d8a-9580-4e305cd317bd tempest-VolumesSnapshotTestJSON-1821027228 None] Deleted volume successfully.
Jul 09 14:39:17 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:UPDATE=156,cinder:SELECT=117,cinder:DELETE=11,cinder:INSERT=26 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 14:39:17 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a8c212af-37af-4d8a-9580-4e305cd317bd tempest-VolumesSnapshotTestJSON-1821027228 None] Lock "cinder-2525802b-76f2-4dec-b821-7edce8151967-delete_volume" released by "delete_volume" :: held 2.935s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:39:18 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-469bf558-af68-4ef6-8db6-db7aed009b2b tempest-BackendsCapabilitiesAdminTestsJSON-1920715798 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.648853302002, 'free_capacity_gb': 1775.648853302002, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87230) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Jul 09 14:39:18 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f994bb0-90ce-4ce8-b9a1-0673f1e9d9d8 tempest-GroupsTest-854722394 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:39:18 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9f994bb0-90ce-4ce8-b9a1-0673f1e9d9d8 tempest-GroupsTest-854722394 None] Flow 'volume_create_manager' (4cc7d210-2fcd-44e6-ac75-628bea01509c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:39:18 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9f994bb0-90ce-4ce8-b9a1-0673f1e9d9d8 tempest-GroupsTest-854722394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94cdb25b-0dd2-4cfd-aae1-f027489cd918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:39:18 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9f994bb0-90ce-4ce8-b9a1-0673f1e9d9d8 tempest-GroupsTest-854722394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94cdb25b-0dd2-4cfd-aae1-f027489cd918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:39:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1899226580',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=814f27f1-bcc9-44a3-985a-edd0debaf97e,host='devstack@QuobyteHD#QuobyteHD',id=8a72228f-c3ef-45f4-837d-00d1214a3c48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bf301d005dd46db8b5252a25d908e4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:39:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:39:18Z,use_quota=True,user_id='1766ba551cfb4f7ba9d779568a0c6935',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8580cea1-b7b1-41bf-acab-d9e86a6f99d2),volume_type_id=8580cea1-b7b1-41bf-acab-d9e86a6f99d2)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:39:18 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9f994bb0-90ce-4ce8-b9a1-0673f1e9d9d8 tempest-GroupsTest-854722394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e56b4039-6630-42e7-a7e5-ec86bc9f751c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:39:18 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9f994bb0-90ce-4ce8-b9a1-0673f1e9d9d8 tempest-GroupsTest-854722394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e56b4039-6630-42e7-a7e5-ec86bc9f751c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:39:18 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9f994bb0-90ce-4ce8-b9a1-0673f1e9d9d8 tempest-GroupsTest-854722394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9463aae5-3086-43fa-bcc1-7739446df11a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:39:18 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9f994bb0-90ce-4ce8-b9a1-0673f1e9d9d8 tempest-GroupsTest-854722394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9463aae5-3086-43fa-bcc1-7739446df11a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a72228f-c3ef-45f4-837d-00d1214a3c48', 'volume_name': 'volume-8a72228f-c3ef-45f4-837d-00d1214a3c48', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:39:18 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9f994bb0-90ce-4ce8-b9a1-0673f1e9d9d8 tempest-GroupsTest-854722394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67d5f05d-91b2-4eeb-bcde-ec97564f5d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:39:18 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9f994bb0-90ce-4ce8-b9a1-0673f1e9d9d8 tempest-GroupsTest-854722394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67d5f05d-91b2-4eeb-bcde-ec97564f5d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:39:18 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9f994bb0-90ce-4ce8-b9a1-0673f1e9d9d8 tempest-GroupsTest-854722394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f679181f-5221-4324-9cae-13e84a4447e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:39:18 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-9f994bb0-90ce-4ce8-b9a1-0673f1e9d9d8 tempest-GroupsTest-854722394 None] Volume 8a72228f-c3ef-45f4-837d-00d1214a3c48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a72228f-c3ef-45f4-837d-00d1214a3c48', 'volume_size': 1}
Jul 09 14:39:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9f994bb0-90ce-4ce8-b9a1-0673f1e9d9d8 tempest-GroupsTest-854722394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:39:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9f994bb0-90ce-4ce8-b9a1-0673f1e9d9d8 tempest-GroupsTest-854722394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:39:18 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9f994bb0-90ce-4ce8-b9a1-0673f1e9d9d8 tempest-GroupsTest-854722394 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=814f27f1-bcc9-44a3-985a-edd0debaf97e,created_at=2026-07-09T12:39:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1899226580',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=814f27f1-bcc9-44a3-985a-edd0debaf97e,host='devstack@QuobyteHD#QuobyteHD',id=8a72228f-c3ef-45f4-837d-00d1214a3c48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bf301d005dd46db8b5252a25d908e4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:39:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:39:18Z,use_quota=True,user_id='1766ba551cfb4f7ba9d779568a0c6935',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8580cea1-b7b1-41bf-acab-d9e86a6f99d2),volume_type_id=8580cea1-b7b1-41bf-acab-d9e86a6f99d2)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:39:18 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-9f994bb0-90ce-4ce8-b9a1-0673f1e9d9d8 tempest-GroupsTest-854722394 None] Creating volume 8a72228f-c3ef-45f4-837d-00d1214a3c48 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:39:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9f994bb0-90ce-4ce8-b9a1-0673f1e9d9d8 tempest-GroupsTest-854722394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:39:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9f994bb0-90ce-4ce8-b9a1-0673f1e9d9d8 tempest-GroupsTest-854722394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:39:18 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9f994bb0-90ce-4ce8-b9a1-0673f1e9d9d8 tempest-GroupsTest-854722394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:39:18 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9f994bb0-90ce-4ce8-b9a1-0673f1e9d9d8 tempest-GroupsTest-854722394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:39:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9f994bb0-90ce-4ce8-b9a1-0673f1e9d9d8 tempest-GroupsTest-854722394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:39:18 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9f994bb0-90ce-4ce8-b9a1-0673f1e9d9d8 tempest-GroupsTest-854722394 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:39:18 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-9f994bb0-90ce-4ce8-b9a1-0673f1e9d9d8 tempest-GroupsTest-854722394 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:39:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9f994bb0-90ce-4ce8-b9a1-0673f1e9d9d8 tempest-GroupsTest-854722394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8a72228f-c3ef-45f4-837d-00d1214a3c48 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:39:18 devstack sudo[96845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8a72228f-c3ef-45f4-837d-00d1214a3c48 1073741824
Jul 09 14:39:18 devstack sudo[96845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:39:18 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6ae91d2a-104a-43f0-9021-b2f80fdc47c1 tempest-BackendsCapabilitiesAdminTestsJSON-1920715798 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.648853302002, 'free_capacity_gb': 1775.648853302002, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87230) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Jul 09 14:39:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-e71e80f1-9ac3-4574-8a46-c0de9c4f9ab2 req-105aa240-a0b3-46f5-9c50-b3c8d89609a7 tempest-AttachVolumeTestJSON-1021532728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:39:19 devstack sudo[96845]: pam_unix(sudo:session): session closed for user root
Jul 09 14:39:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9f994bb0-90ce-4ce8-b9a1-0673f1e9d9d8 tempest-GroupsTest-854722394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8a72228f-c3ef-45f4-837d-00d1214a3c48 1073741824" returned: 0 in 0.998s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:39:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9f994bb0-90ce-4ce8-b9a1-0673f1e9d9d8 tempest-GroupsTest-854722394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8a72228f-c3ef-45f4-837d-00d1214a3c48 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:39:19 devstack sudo[96861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8a72228f-c3ef-45f4-837d-00d1214a3c48
Jul 09 14:39:19 devstack sudo[96861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:39:20 devstack sudo[96861]: pam_unix(sudo:session): session closed for user root
Jul 09 14:39:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9f994bb0-90ce-4ce8-b9a1-0673f1e9d9d8 tempest-GroupsTest-854722394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8a72228f-c3ef-45f4-837d-00d1214a3c48" returned: 0 in 0.856s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:39:20 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9f994bb0-90ce-4ce8-b9a1-0673f1e9d9d8 tempest-GroupsTest-854722394 None] <== create_volume: return (1899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:39:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9f994bb0-90ce-4ce8-b9a1-0673f1e9d9d8 tempest-GroupsTest-854722394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.903s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:39:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-e71e80f1-9ac3-4574-8a46-c0de9c4f9ab2 req-105aa240-a0b3-46f5-9c50-b3c8d89609a7 tempest-AttachVolumeTestJSON-1021532728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.161s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:39:20 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9f994bb0-90ce-4ce8-b9a1-0673f1e9d9d8 tempest-GroupsTest-854722394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f679181f-5221-4324-9cae-13e84a4447e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a72228f-c3ef-45f4-837d-00d1214a3c48', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:39:20 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9f994bb0-90ce-4ce8-b9a1-0673f1e9d9d8 tempest-GroupsTest-854722394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5558bf6d-1197-404d-bbe8-c81271c31c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:39:20 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[f090ec43-e3ec-4f1e-aeb0-b9ed2aab0da0]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:39:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-e71e80f1-9ac3-4574-8a46-c0de9c4f9ab2 req-105aa240-a0b3-46f5-9c50-b3c8d89609a7 tempest-AttachVolumeTestJSON-1021532728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b18e5cfa-10ed-457b-8480-2744c415d925 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:39:20 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-9f994bb0-90ce-4ce8-b9a1-0673f1e9d9d8 tempest-GroupsTest-854722394 None] Volume volume-8a72228f-c3ef-45f4-837d-00d1214a3c48 (8a72228f-c3ef-45f4-837d-00d1214a3c48): created successfully
Jul 09 14:39:20 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9f994bb0-90ce-4ce8-b9a1-0673f1e9d9d8 tempest-GroupsTest-854722394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5558bf6d-1197-404d-bbe8-c81271c31c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:39:20 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9f994bb0-90ce-4ce8-b9a1-0673f1e9d9d8 tempest-GroupsTest-854722394 None] Flow 'volume_create_manager' (4cc7d210-2fcd-44e6-ac75-628bea01509c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:39:20 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-9f994bb0-90ce-4ce8-b9a1-0673f1e9d9d8 tempest-GroupsTest-854722394 None] Created volume successfully.
Jul 09 14:39:20 devstack sudo[96865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b18e5cfa-10ed-457b-8480-2744c415d925
Jul 09 14:39:20 devstack sudo[96865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:39:21 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-d034ca4e-6283-4bf7-9cac-c12d3381aac3 tempest-GroupsTest-854722394 None] Update group completed successfully.
Jul 09 14:39:21 devstack sudo[96865]: pam_unix(sudo:session): session closed for user root
Jul 09 14:39:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-e71e80f1-9ac3-4574-8a46-c0de9c4f9ab2 req-105aa240-a0b3-46f5-9c50-b3c8d89609a7 tempest-AttachVolumeTestJSON-1021532728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b18e5cfa-10ed-457b-8480-2744c415d925" returned: 0 in 0.986s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:39:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-e71e80f1-9ac3-4574-8a46-c0de9c4f9ab2 req-105aa240-a0b3-46f5-9c50-b3c8d89609a7 tempest-AttachVolumeTestJSON-1021532728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.033s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:39:21 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-e71e80f1-9ac3-4574-8a46-c0de9c4f9ab2 req-105aa240-a0b3-46f5-9c50-b3c8d89609a7 tempest-AttachVolumeTestJSON-1021532728 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653', 'name': 'volume-b18e5cfa-10ed-457b-8480-2744c415d925', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a25a5821-e016-4119-b386-e4e57038f381', 'enforce_multipath': True} {{(pid=87230) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 09 14:39:21 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-e71e80f1-9ac3-4574-8a46-c0de9c4f9ab2 req-105aa240-a0b3-46f5-9c50-b3c8d89609a7 tempest-AttachVolumeTestJSON-1021532728 None] attachment_update completed successfully.
Jul 09 14:39:22 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-87ed6193-d065-491b-b431-880396a0deae tempest-GroupsTest-854722394 None] Update group completed successfully.
Jul 09 14:39:24 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-0e10cdf3-3daa-4d64-a8fd-208ef88447ef tempest-GroupsTest-854722394 None] Acquiring lock "cinder-quobyte-44390c40-3af0-4cf2-81f9-ad14a3d274e3" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:39:24 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-0e10cdf3-3daa-4d64-a8fd-208ef88447ef tempest-GroupsTest-854722394 None] Lock "cinder-quobyte-44390c40-3af0-4cf2-81f9-ad14a3d274e3" acquired by "delete_volume" :: waited 0.034s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:39:24 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[c81c5bb9-9dfe-4a1d-84fa-dd1a2cadddc2]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:39:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0e10cdf3-3daa-4d64-a8fd-208ef88447ef tempest-GroupsTest-854722394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-44390c40-3af0-4cf2-81f9-ad14a3d274e3 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:39:24 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c64e271-afca-46e7-a4b9-20c35048a473 tempest-VolumesSnapshotListTestJSON-1328804210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:39:24 devstack sudo[96875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-44390c40-3af0-4cf2-81f9-ad14a3d274e3
Jul 09 14:39:24 devstack sudo[96875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:39:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3c64e271-afca-46e7-a4b9-20c35048a473 tempest-VolumesSnapshotListTestJSON-1328804210 None] Flow 'volume_create_manager' (2cd8f510-d52b-4e01-8f1e-a82b026e41d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:39:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3c64e271-afca-46e7-a4b9-20c35048a473 tempest-VolumesSnapshotListTestJSON-1328804210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4d170d5-240a-4e25-be8f-4c57585d4eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:39:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3c64e271-afca-46e7-a4b9-20c35048a473 tempest-VolumesSnapshotListTestJSON-1328804210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4d170d5-240a-4e25-be8f-4c57585d4eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:39:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-521668075',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3a9a842-3989-47a8-93b2-0050e3878aa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94db7cee5dc2401196c4b377c22c62e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:39:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:39:24Z,use_quota=True,user_id='0dbfc76f32124130845b9c9160a7b999',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:39:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3c64e271-afca-46e7-a4b9-20c35048a473 tempest-VolumesSnapshotListTestJSON-1328804210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a59a1e3b-8e92-4db6-a248-29069da23e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:39:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3c64e271-afca-46e7-a4b9-20c35048a473 tempest-VolumesSnapshotListTestJSON-1328804210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a59a1e3b-8e92-4db6-a248-29069da23e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:39:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3c64e271-afca-46e7-a4b9-20c35048a473 tempest-VolumesSnapshotListTestJSON-1328804210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25675be5-760b-4c1b-94ba-4334300a5f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:39:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3c64e271-afca-46e7-a4b9-20c35048a473 tempest-VolumesSnapshotListTestJSON-1328804210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25675be5-760b-4c1b-94ba-4334300a5f75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3a9a842-3989-47a8-93b2-0050e3878aa9', 'volume_name': 'volume-a3a9a842-3989-47a8-93b2-0050e3878aa9', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:39:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3c64e271-afca-46e7-a4b9-20c35048a473 tempest-VolumesSnapshotListTestJSON-1328804210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f05240fa-cf0f-486d-b8fd-ab31621735a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:39:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3c64e271-afca-46e7-a4b9-20c35048a473 tempest-VolumesSnapshotListTestJSON-1328804210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f05240fa-cf0f-486d-b8fd-ab31621735a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:39:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3c64e271-afca-46e7-a4b9-20c35048a473 tempest-VolumesSnapshotListTestJSON-1328804210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7442862b-9651-42e0-b35f-7a6150ffe108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:39:24 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-3c64e271-afca-46e7-a4b9-20c35048a473 tempest-VolumesSnapshotListTestJSON-1328804210 None] Volume a3a9a842-3989-47a8-93b2-0050e3878aa9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3a9a842-3989-47a8-93b2-0050e3878aa9', 'volume_size': 1}
Jul 09 14:39:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3c64e271-afca-46e7-a4b9-20c35048a473 tempest-VolumesSnapshotListTestJSON-1328804210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:39:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3c64e271-afca-46e7-a4b9-20c35048a473 tempest-VolumesSnapshotListTestJSON-1328804210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:39:24 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3c64e271-afca-46e7-a4b9-20c35048a473 tempest-VolumesSnapshotListTestJSON-1328804210 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:39:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-521668075',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3a9a842-3989-47a8-93b2-0050e3878aa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94db7cee5dc2401196c4b377c22c62e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:39:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:39:24Z,use_quota=True,user_id='0dbfc76f32124130845b9c9160a7b999',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:39:24 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-3c64e271-afca-46e7-a4b9-20c35048a473 tempest-VolumesSnapshotListTestJSON-1328804210 None] Creating volume a3a9a842-3989-47a8-93b2-0050e3878aa9 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:39:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3c64e271-afca-46e7-a4b9-20c35048a473 tempest-VolumesSnapshotListTestJSON-1328804210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:39:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3c64e271-afca-46e7-a4b9-20c35048a473 tempest-VolumesSnapshotListTestJSON-1328804210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:39:24 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3c64e271-afca-46e7-a4b9-20c35048a473 tempest-VolumesSnapshotListTestJSON-1328804210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:39:24 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3c64e271-afca-46e7-a4b9-20c35048a473 tempest-VolumesSnapshotListTestJSON-1328804210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:39:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3c64e271-afca-46e7-a4b9-20c35048a473 tempest-VolumesSnapshotListTestJSON-1328804210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:39:24 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3c64e271-afca-46e7-a4b9-20c35048a473 tempest-VolumesSnapshotListTestJSON-1328804210 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:39:24 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-3c64e271-afca-46e7-a4b9-20c35048a473 tempest-VolumesSnapshotListTestJSON-1328804210 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:39:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3c64e271-afca-46e7-a4b9-20c35048a473 tempest-VolumesSnapshotListTestJSON-1328804210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:39:24 devstack sudo[96877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9 1073741824
Jul 09 14:39:24 devstack sudo[96877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:39:25 devstack sudo[96875]: pam_unix(sudo:session): session closed for user root
Jul 09 14:39:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0e10cdf3-3daa-4d64-a8fd-208ef88447ef tempest-GroupsTest-854722394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-44390c40-3af0-4cf2-81f9-ad14a3d274e3" returned: 0 in 0.926s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:39:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0e10cdf3-3daa-4d64-a8fd-208ef88447ef tempest-GroupsTest-854722394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-44390c40-3af0-4cf2-81f9-ad14a3d274e3 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:39:25 devstack sudo[96886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-44390c40-3af0-4cf2-81f9-ad14a3d274e3
Jul 09 14:39:25 devstack sudo[96886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:39:25 devstack sudo[96877]: pam_unix(sudo:session): session closed for user root
Jul 09 14:39:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3c64e271-afca-46e7-a4b9-20c35048a473 tempest-VolumesSnapshotListTestJSON-1328804210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9 1073741824" returned: 0 in 1.137s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:39:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3c64e271-afca-46e7-a4b9-20c35048a473 tempest-VolumesSnapshotListTestJSON-1328804210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:39:25 devstack sudo[96891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9
Jul 09 14:39:25 devstack sudo[96891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:39:26 devstack sudo[96886]: pam_unix(sudo:session): session closed for user root
Jul 09 14:39:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0e10cdf3-3daa-4d64-a8fd-208ef88447ef tempest-GroupsTest-854722394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-44390c40-3af0-4cf2-81f9-ad14a3d274e3" returned: 0 in 0.834s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:39:26 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-0e10cdf3-3daa-4d64-a8fd-208ef88447ef tempest-GroupsTest-854722394 None] Lock "cinder-quobyte-44390c40-3af0-4cf2-81f9-ad14a3d274e3" released by "delete_volume" :: held 1.832s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:39:26 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-0e10cdf3-3daa-4d64-a8fd-208ef88447ef tempest-GroupsTest-854722394 None] Acquiring lock "cinder-quobyte-8a72228f-c3ef-45f4-837d-00d1214a3c48" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:39:26 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-0e10cdf3-3daa-4d64-a8fd-208ef88447ef tempest-GroupsTest-854722394 None] Lock "cinder-quobyte-8a72228f-c3ef-45f4-837d-00d1214a3c48" acquired by "delete_volume" :: waited 0.020s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:39:26 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[429f7e26-86fe-4347-a372-7531bcf07b34]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:39:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0e10cdf3-3daa-4d64-a8fd-208ef88447ef tempest-GroupsTest-854722394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8a72228f-c3ef-45f4-837d-00d1214a3c48 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:39:26 devstack sudo[96894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8a72228f-c3ef-45f4-837d-00d1214a3c48
Jul 09 14:39:26 devstack sudo[96894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:39:26 devstack sudo[96891]: pam_unix(sudo:session): session closed for user root
Jul 09 14:39:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3c64e271-afca-46e7-a4b9-20c35048a473 tempest-VolumesSnapshotListTestJSON-1328804210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9" returned: 0 in 0.761s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:39:26 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3c64e271-afca-46e7-a4b9-20c35048a473 tempest-VolumesSnapshotListTestJSON-1328804210 None] <== create_volume: return (1960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:39:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3c64e271-afca-46e7-a4b9-20c35048a473 tempest-VolumesSnapshotListTestJSON-1328804210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.965s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:39:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3c64e271-afca-46e7-a4b9-20c35048a473 tempest-VolumesSnapshotListTestJSON-1328804210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7442862b-9651-42e0-b35f-7a6150ffe108) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3a9a842-3989-47a8-93b2-0050e3878aa9', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:39:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3c64e271-afca-46e7-a4b9-20c35048a473 tempest-VolumesSnapshotListTestJSON-1328804210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2502b9b-f933-45e7-8316-262cc6464417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:39:26 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-3c64e271-afca-46e7-a4b9-20c35048a473 tempest-VolumesSnapshotListTestJSON-1328804210 None] Volume volume-a3a9a842-3989-47a8-93b2-0050e3878aa9 (a3a9a842-3989-47a8-93b2-0050e3878aa9): created successfully
Jul 09 14:39:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3c64e271-afca-46e7-a4b9-20c35048a473 tempest-VolumesSnapshotListTestJSON-1328804210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2502b9b-f933-45e7-8316-262cc6464417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:39:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3c64e271-afca-46e7-a4b9-20c35048a473 tempest-VolumesSnapshotListTestJSON-1328804210 None] Flow 'volume_create_manager' (2cd8f510-d52b-4e01-8f1e-a82b026e41d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:39:26 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-3c64e271-afca-46e7-a4b9-20c35048a473 tempest-VolumesSnapshotListTestJSON-1328804210 None] Created volume successfully.
Jul 09 14:39:27 devstack sudo[96894]: pam_unix(sudo:session): session closed for user root
Jul 09 14:39:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0e10cdf3-3daa-4d64-a8fd-208ef88447ef tempest-GroupsTest-854722394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8a72228f-c3ef-45f4-837d-00d1214a3c48" returned: 0 in 0.929s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:39:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0e10cdf3-3daa-4d64-a8fd-208ef88447ef tempest-GroupsTest-854722394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8a72228f-c3ef-45f4-837d-00d1214a3c48 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:39:27 devstack sudo[96924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8a72228f-c3ef-45f4-837d-00d1214a3c48
Jul 09 14:39:27 devstack sudo[96924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:39:27 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-157a3116-ef36-4d62-9574-005aa943f8b4 req-3dca1d52-e5e0-44ab-a566-69ade3198206 tempest-AttachVolumeTestJSON-1021532728 None] Terminate volume connection completed successfully.
Jul 09 14:39:27 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-157a3116-ef36-4d62-9574-005aa943f8b4 req-3dca1d52-e5e0-44ab-a566-69ade3198206 tempest-AttachVolumeTestJSON-1021532728 None] Deleting attachment 61567400-3edc-4d54-a044-a884938035a6. {{(pid=87230) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 09 14:39:27 devstack sudo[96924]: pam_unix(sudo:session): session closed for user root
Jul 09 14:39:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0e10cdf3-3daa-4d64-a8fd-208ef88447ef tempest-GroupsTest-854722394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8a72228f-c3ef-45f4-837d-00d1214a3c48" returned: 0 in 0.734s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:39:27 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-0e10cdf3-3daa-4d64-a8fd-208ef88447ef tempest-GroupsTest-854722394 None] Lock "cinder-quobyte-8a72228f-c3ef-45f4-837d-00d1214a3c48" released by "delete_volume" :: held 1.708s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:39:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-59a00965-1b6e-49b1-af64-a2b9e17437c6 tempest-VolumesSnapshotListTestJSON-1328804210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:39:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-59a00965-1b6e-49b1-af64-a2b9e17437c6 tempest-VolumesSnapshotListTestJSON-1328804210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:39:28 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-59a00965-1b6e-49b1-af64-a2b9e17437c6 tempest-VolumesSnapshotListTestJSON-1328804210 None] Creating offline snapshot 5e8f89db-0f41-49ab-8b93-d1c78132f770 of volume a3a9a842-3989-47a8-93b2-0050e3878aa9 {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 14:39:28 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-0e10cdf3-3daa-4d64-a8fd-208ef88447ef tempest-GroupsTest-854722394 None] Created reservations ['5d59b968-6e85-49fa-b3d2-27be9fe2ca0b'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:39:28 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[c83eb523-0c4a-4d07-a5d0-e27599756b26]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:39:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-59a00965-1b6e-49b1-af64-a2b9e17437c6 tempest-VolumesSnapshotListTestJSON-1328804210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:39:28 devstack cinder-volume[87230]: WARNING cinder.quota [None req-0e10cdf3-3daa-4d64-a8fd-208ef88447ef tempest-GroupsTest-854722394 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1473628510 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1473628510, it is now deprecated. Please use the default quota class for default quota.
Jul 09 14:39:28 devstack cinder-volume[87230]: WARNING cinder.quota [None req-0e10cdf3-3daa-4d64-a8fd-208ef88447ef tempest-GroupsTest-854722394 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1473628510 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1473628510, it is now deprecated. Please use the default quota class for default quota.
Jul 09 14:39:28 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-0e10cdf3-3daa-4d64-a8fd-208ef88447ef tempest-GroupsTest-854722394 None] Created reservations ['b6fc5517-e13a-4c45-9c65-430eda48adde', '6af262ee-6ee6-4cda-803d-2cba715d1e96', '7854c385-0d57-48af-99ec-99918c886379', '2942ba6b-c08a-4d23-9555-a5e567080f12'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:39:28 devstack sudo[96930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9
Jul 09 14:39:28 devstack sudo[96930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:39:28 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-0e10cdf3-3daa-4d64-a8fd-208ef88447ef tempest-GroupsTest-854722394 None] Created reservations ['3636d0c5-dba1-4c05-9e8c-00bb6135d9c5', 'ae851120-6d01-46e4-84d3-794a21dcf798', 'd62db8c2-8631-4a73-9f3d-2d7e2bece87f', 'f89ebccc-90c8-4bde-94a9-88124cb7fe98'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:39:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0e10cdf3-3daa-4d64-a8fd-208ef88447ef tempest-GroupsTest-854722394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:39:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0e10cdf3-3daa-4d64-a8fd-208ef88447ef tempest-GroupsTest-854722394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:39:28 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-0e10cdf3-3daa-4d64-a8fd-208ef88447ef tempest-GroupsTest-854722394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:39:28 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-0e10cdf3-3daa-4d64-a8fd-208ef88447ef tempest-GroupsTest-854722394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:39:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0e10cdf3-3daa-4d64-a8fd-208ef88447ef tempest-GroupsTest-854722394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:39:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0e10cdf3-3daa-4d64-a8fd-208ef88447ef tempest-GroupsTest-854722394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:39:28 devstack sudo[96932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:39:28 devstack sudo[96932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:39:29 devstack sudo[96930]: pam_unix(sudo:session): session closed for user root
Jul 09 14:39:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-59a00965-1b6e-49b1-af64-a2b9e17437c6 tempest-VolumesSnapshotListTestJSON-1328804210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9" returned: 0 in 1.070s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:39:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-59a00965-1b6e-49b1-af64-a2b9e17437c6 tempest-VolumesSnapshotListTestJSON-1328804210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9.5e8f89db-0f41-49ab-8b93-d1c78132f770 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:39:29 devstack sudo[96938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9.5e8f89db-0f41-49ab-8b93-d1c78132f770 1G
Jul 09 14:39:29 devstack sudo[96938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:39:29 devstack sudo[96932]: pam_unix(sudo:session): session closed for user root
Jul 09 14:39:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0e10cdf3-3daa-4d64-a8fd-208ef88447ef tempest-GroupsTest-854722394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.819s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:39:29 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-0e10cdf3-3daa-4d64-a8fd-208ef88447ef tempest-GroupsTest-854722394 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:39:29 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-0e10cdf3-3daa-4d64-a8fd-208ef88447ef tempest-GroupsTest-854722394 None] Delete group completed successfully.
Jul 09 14:39:30 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-c0d11bfe-70ca-4b24-a28c-2b293b538dbc req-3961841f-0c5e-46e5-877a-497706a3177a tempest-AttachVolumeTestJSON-1021532728 None] Terminate volume connection completed successfully.
Jul 09 14:39:30 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-c0d11bfe-70ca-4b24-a28c-2b293b538dbc req-3961841f-0c5e-46e5-877a-497706a3177a tempest-AttachVolumeTestJSON-1021532728 None] Deleting attachment a25a5821-e016-4119-b386-e4e57038f381. {{(pid=87230) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 09 14:39:30 devstack sudo[96938]: pam_unix(sudo:session): session closed for user root
Jul 09 14:39:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-59a00965-1b6e-49b1-af64-a2b9e17437c6 tempest-VolumesSnapshotListTestJSON-1328804210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9.5e8f89db-0f41-49ab-8b93-d1c78132f770 1G" returned: 0 in 0.972s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:39:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-59a00965-1b6e-49b1-af64-a2b9e17437c6 tempest-VolumesSnapshotListTestJSON-1328804210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3a9a842-3989-47a8-93b2-0050e3878aa9 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9.5e8f89db-0f41-49ab-8b93-d1c78132f770 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:39:30 devstack sudo[96947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3a9a842-3989-47a8-93b2-0050e3878aa9 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9.5e8f89db-0f41-49ab-8b93-d1c78132f770
Jul 09 14:39:30 devstack sudo[96947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:39:30 devstack sudo[96947]: pam_unix(sudo:session): session closed for user root
Jul 09 14:39:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-59a00965-1b6e-49b1-af64-a2b9e17437c6 tempest-VolumesSnapshotListTestJSON-1328804210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3a9a842-3989-47a8-93b2-0050e3878aa9 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9.5e8f89db-0f41-49ab-8b93-d1c78132f770" returned: 0 in 0.777s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:39:30 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-59a00965-1b6e-49b1-af64-a2b9e17437c6 tempest-VolumesSnapshotListTestJSON-1328804210 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9.5e8f89db-0f41-49ab-8b93-d1c78132f770 is being set with open permissions: ugo+rw
Jul 09 14:39:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-59a00965-1b6e-49b1-af64-a2b9e17437c6 tempest-VolumesSnapshotListTestJSON-1328804210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9.5e8f89db-0f41-49ab-8b93-d1c78132f770 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:39:30 devstack sudo[96953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9.5e8f89db-0f41-49ab-8b93-d1c78132f770
Jul 09 14:39:30 devstack sudo[96953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:39:31 devstack sudo[96953]: pam_unix(sudo:session): session closed for user root
Jul 09 14:39:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-59a00965-1b6e-49b1-af64-a2b9e17437c6 tempest-VolumesSnapshotListTestJSON-1328804210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9.5e8f89db-0f41-49ab-8b93-d1c78132f770" returned: 0 in 0.796s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:39:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-59a00965-1b6e-49b1-af64-a2b9e17437c6 tempest-VolumesSnapshotListTestJSON-1328804210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:39:31 devstack sudo[96956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9.info
Jul 09 14:39:31 devstack sudo[96956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:39:32 devstack sudo[96956]: pam_unix(sudo:session): session closed for user root
Jul 09 14:39:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-59a00965-1b6e-49b1-af64-a2b9e17437c6 tempest-VolumesSnapshotListTestJSON-1328804210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9.info" returned: 0 in 0.818s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:39:32 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-59a00965-1b6e-49b1-af64-a2b9e17437c6 tempest-VolumesSnapshotListTestJSON-1328804210 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9.info is being set with open permissions: ugo+rw
Jul 09 14:39:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-59a00965-1b6e-49b1-af64-a2b9e17437c6 tempest-VolumesSnapshotListTestJSON-1328804210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:39:32 devstack sudo[96959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9.info
Jul 09 14:39:32 devstack sudo[96959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:39:33 devstack sudo[96959]: pam_unix(sudo:session): session closed for user root
Jul 09 14:39:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-59a00965-1b6e-49b1-af64-a2b9e17437c6 tempest-VolumesSnapshotListTestJSON-1328804210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9.info" returned: 0 in 0.762s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:39:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-59a00965-1b6e-49b1-af64-a2b9e17437c6 tempest-VolumesSnapshotListTestJSON-1328804210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.332s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:39:33 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-59a00965-1b6e-49b1-af64-a2b9e17437c6 tempest-VolumesSnapshotListTestJSON-1328804210 None] Create snapshot completed successfully
Jul 09 14:39:34 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=148,cinder:UPDATE=138,cinder:DELETE=7,cinder:INSERT=37 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 14:39:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1b29d787-7211-4b56-889f-d8146c045575 tempest-VolumesSnapshotListTestJSON-1328804210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:39:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1b29d787-7211-4b56-889f-d8146c045575 tempest-VolumesSnapshotListTestJSON-1328804210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:39:34 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-1b29d787-7211-4b56-889f-d8146c045575 tempest-VolumesSnapshotListTestJSON-1328804210 None] Creating offline snapshot ae7c6527-1a9e-431b-81fc-19a9a97e4694 of volume a3a9a842-3989-47a8-93b2-0050e3878aa9 {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 14:39:34 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3adcff9-4a59-4354-9fa1-9c8dabd59a12]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:39:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1b29d787-7211-4b56-889f-d8146c045575 tempest-VolumesSnapshotListTestJSON-1328804210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9.5e8f89db-0f41-49ab-8b93-d1c78132f770 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:39:34 devstack sudo[96980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9.5e8f89db-0f41-49ab-8b93-d1c78132f770
Jul 09 14:39:34 devstack sudo[96980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:39:35 devstack sudo[96980]: pam_unix(sudo:session): session closed for user root
Jul 09 14:39:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1b29d787-7211-4b56-889f-d8146c045575 tempest-VolumesSnapshotListTestJSON-1328804210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9.5e8f89db-0f41-49ab-8b93-d1c78132f770" returned: 0 in 1.116s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:39:35 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-1b29d787-7211-4b56-889f-d8146c045575 tempest-VolumesSnapshotListTestJSON-1328804210 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3a9a842-3989-47a8-93b2-0050e3878aa9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 14:39:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1b29d787-7211-4b56-889f-d8146c045575 tempest-VolumesSnapshotListTestJSON-1328804210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9.5e8f89db-0f41-49ab-8b93-d1c78132f770,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9.ae7c6527-1a9e-431b-81fc-19a9a97e4694 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:39:35 devstack sudo[96989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9.5e8f89db-0f41-49ab-8b93-d1c78132f770,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9.ae7c6527-1a9e-431b-81fc-19a9a97e4694 1G
Jul 09 14:39:35 devstack sudo[96989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:39:37 devstack sudo[96989]: pam_unix(sudo:session): session closed for user root
Jul 09 14:39:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1b29d787-7211-4b56-889f-d8146c045575 tempest-VolumesSnapshotListTestJSON-1328804210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9.5e8f89db-0f41-49ab-8b93-d1c78132f770,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9.ae7c6527-1a9e-431b-81fc-19a9a97e4694 1G" returned: 0 in 1.154s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:39:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1b29d787-7211-4b56-889f-d8146c045575 tempest-VolumesSnapshotListTestJSON-1328804210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3a9a842-3989-47a8-93b2-0050e3878aa9.5e8f89db-0f41-49ab-8b93-d1c78132f770 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9.ae7c6527-1a9e-431b-81fc-19a9a97e4694 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:39:37 devstack sudo[96997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3a9a842-3989-47a8-93b2-0050e3878aa9.5e8f89db-0f41-49ab-8b93-d1c78132f770 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9.ae7c6527-1a9e-431b-81fc-19a9a97e4694
Jul 09 14:39:37 devstack sudo[96997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:39:38 devstack sudo[96997]: pam_unix(sudo:session): session closed for user root
Jul 09 14:39:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1b29d787-7211-4b56-889f-d8146c045575 tempest-VolumesSnapshotListTestJSON-1328804210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3a9a842-3989-47a8-93b2-0050e3878aa9.5e8f89db-0f41-49ab-8b93-d1c78132f770 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9.ae7c6527-1a9e-431b-81fc-19a9a97e4694" returned: 0 in 0.886s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:39:38 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-1b29d787-7211-4b56-889f-d8146c045575 tempest-VolumesSnapshotListTestJSON-1328804210 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9.ae7c6527-1a9e-431b-81fc-19a9a97e4694 is being set with open permissions: ugo+rw
Jul 09 14:39:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1b29d787-7211-4b56-889f-d8146c045575 tempest-VolumesSnapshotListTestJSON-1328804210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9.ae7c6527-1a9e-431b-81fc-19a9a97e4694 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:39:38 devstack sudo[97002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9.ae7c6527-1a9e-431b-81fc-19a9a97e4694
Jul 09 14:39:38 devstack sudo[97002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:39:38 devstack sudo[97002]: pam_unix(sudo:session): session closed for user root
Jul 09 14:39:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1b29d787-7211-4b56-889f-d8146c045575 tempest-VolumesSnapshotListTestJSON-1328804210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9.ae7c6527-1a9e-431b-81fc-19a9a97e4694" returned: 0 in 0.713s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:39:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1b29d787-7211-4b56-889f-d8146c045575 tempest-VolumesSnapshotListTestJSON-1328804210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.084s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:39:38 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-1b29d787-7211-4b56-889f-d8146c045575 tempest-VolumesSnapshotListTestJSON-1328804210 None] Create snapshot completed successfully
Jul 09 14:39:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6a306a8e-5435-4fa4-84e5-4133d52d5d8c tempest-VolumesSnapshotListTestJSON-1328804210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:39:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6a306a8e-5435-4fa4-84e5-4133d52d5d8c tempest-VolumesSnapshotListTestJSON-1328804210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:39:40 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-6a306a8e-5435-4fa4-84e5-4133d52d5d8c tempest-VolumesSnapshotListTestJSON-1328804210 None] Creating offline snapshot dca20698-639c-4b6e-932f-c7e254bbf10a of volume a3a9a842-3989-47a8-93b2-0050e3878aa9 {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 14:39:40 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-88280162-399e-4e9d-bdd9-da8dc739fd95 tempest-VolumesServicesTestJSON-547592976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:39:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-88280162-399e-4e9d-bdd9-da8dc739fd95 tempest-VolumesServicesTestJSON-547592976 None] Flow 'volume_create_manager' (fa2d32ad-768b-4651-b75c-c2d60c5177b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:39:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-88280162-399e-4e9d-bdd9-da8dc739fd95 tempest-VolumesServicesTestJSON-547592976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f00ac29f-0025-45f9-8e39-e602e57925a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:39:40 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[d284db88-ae82-4e7f-acf4-c8283010a83f]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:39:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6a306a8e-5435-4fa4-84e5-4133d52d5d8c tempest-VolumesSnapshotListTestJSON-1328804210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9.ae7c6527-1a9e-431b-81fc-19a9a97e4694 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:39:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-88280162-399e-4e9d-bdd9-da8dc739fd95 tempest-VolumesServicesTestJSON-547592976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f00ac29f-0025-45f9-8e39-e602e57925a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:39:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1538638462',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85ff9cf3-4153-420d-9155-5fa970e6f9a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5cd831b368f425f81151ee1e095b4c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:39:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:39:40Z,use_quota=True,user_id='d924b0c8f972434b92d0ad3012a81f07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:39:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-88280162-399e-4e9d-bdd9-da8dc739fd95 tempest-VolumesServicesTestJSON-547592976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74a247b6-6beb-4b08-b4da-c4dc958d6dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:39:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-88280162-399e-4e9d-bdd9-da8dc739fd95 tempest-VolumesServicesTestJSON-547592976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74a247b6-6beb-4b08-b4da-c4dc958d6dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:39:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-88280162-399e-4e9d-bdd9-da8dc739fd95 tempest-VolumesServicesTestJSON-547592976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aac17c48-f16f-4973-85c2-ccebb9c74b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:39:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-88280162-399e-4e9d-bdd9-da8dc739fd95 tempest-VolumesServicesTestJSON-547592976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aac17c48-f16f-4973-85c2-ccebb9c74b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85ff9cf3-4153-420d-9155-5fa970e6f9a3', 'volume_name': 'volume-85ff9cf3-4153-420d-9155-5fa970e6f9a3', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:39:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-88280162-399e-4e9d-bdd9-da8dc739fd95 tempest-VolumesServicesTestJSON-547592976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ad999ac-d880-4dd3-bc4f-c5c9c77b73d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:39:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-88280162-399e-4e9d-bdd9-da8dc739fd95 tempest-VolumesServicesTestJSON-547592976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ad999ac-d880-4dd3-bc4f-c5c9c77b73d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:39:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-88280162-399e-4e9d-bdd9-da8dc739fd95 tempest-VolumesServicesTestJSON-547592976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67cfdc91-b453-4afe-bd81-2d9c94fb9ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:39:40 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-88280162-399e-4e9d-bdd9-da8dc739fd95 tempest-VolumesServicesTestJSON-547592976 None] Volume 85ff9cf3-4153-420d-9155-5fa970e6f9a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85ff9cf3-4153-420d-9155-5fa970e6f9a3', 'volume_size': 1}
Jul 09 14:39:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-88280162-399e-4e9d-bdd9-da8dc739fd95 tempest-VolumesServicesTestJSON-547592976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:39:40 devstack sudo[97043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9.ae7c6527-1a9e-431b-81fc-19a9a97e4694
Jul 09 14:39:40 devstack sudo[97043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:39:41 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-573e04a5-6092-4c32-a0b8-0887c82d0fcd tempest-AttachVolumeTestJSON-1021532728 None] Acquiring lock "cinder-b18e5cfa-10ed-457b-8480-2744c415d925-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:39:41 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-573e04a5-6092-4c32-a0b8-0887c82d0fcd tempest-AttachVolumeTestJSON-1021532728 None] Lock "cinder-b18e5cfa-10ed-457b-8480-2744c415d925-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:39:41 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-573e04a5-6092-4c32-a0b8-0887c82d0fcd tempest-AttachVolumeTestJSON-1021532728 None] Acquiring lock "cinder-quobyte-b18e5cfa-10ed-457b-8480-2744c415d925" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:39:41 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-573e04a5-6092-4c32-a0b8-0887c82d0fcd tempest-AttachVolumeTestJSON-1021532728 None] Lock "cinder-quobyte-b18e5cfa-10ed-457b-8480-2744c415d925" acquired by "delete_volume" :: waited 0.020s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:39:41 devstack sudo[97043]: pam_unix(sudo:session): session closed for user root
Jul 09 14:39:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6a306a8e-5435-4fa4-84e5-4133d52d5d8c tempest-VolumesSnapshotListTestJSON-1328804210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9.ae7c6527-1a9e-431b-81fc-19a9a97e4694" returned: 0 in 0.962s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:39:41 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-6a306a8e-5435-4fa4-84e5-4133d52d5d8c tempest-VolumesSnapshotListTestJSON-1328804210 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3a9a842-3989-47a8-93b2-0050e3878aa9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 14:39:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6a306a8e-5435-4fa4-84e5-4133d52d5d8c tempest-VolumesSnapshotListTestJSON-1328804210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9.ae7c6527-1a9e-431b-81fc-19a9a97e4694,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9.dca20698-639c-4b6e-932f-c7e254bbf10a 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:39:41 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[07469563-7cb3-45f8-b2b4-bd5a02d7b07a]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:39:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-573e04a5-6092-4c32-a0b8-0887c82d0fcd tempest-AttachVolumeTestJSON-1021532728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b18e5cfa-10ed-457b-8480-2744c415d925 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:39:41 devstack sudo[97048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9.ae7c6527-1a9e-431b-81fc-19a9a97e4694,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9.dca20698-639c-4b6e-932f-c7e254bbf10a 1G
Jul 09 14:39:41 devstack sudo[97048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:39:41 devstack sudo[97049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b18e5cfa-10ed-457b-8480-2744c415d925
Jul 09 14:39:41 devstack sudo[97049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:39:42 devstack sudo[97049]: pam_unix(sudo:session): session closed for user root
Jul 09 14:39:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-573e04a5-6092-4c32-a0b8-0887c82d0fcd tempest-AttachVolumeTestJSON-1021532728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b18e5cfa-10ed-457b-8480-2744c415d925" returned: 0 in 0.815s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:39:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-573e04a5-6092-4c32-a0b8-0887c82d0fcd tempest-AttachVolumeTestJSON-1021532728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b18e5cfa-10ed-457b-8480-2744c415d925 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:39:42 devstack sudo[97059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b18e5cfa-10ed-457b-8480-2744c415d925
Jul 09 14:39:42 devstack sudo[97059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:39:42 devstack sudo[97048]: pam_unix(sudo:session): session closed for user root
Jul 09 14:39:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6a306a8e-5435-4fa4-84e5-4133d52d5d8c tempest-VolumesSnapshotListTestJSON-1328804210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9.ae7c6527-1a9e-431b-81fc-19a9a97e4694,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9.dca20698-639c-4b6e-932f-c7e254bbf10a 1G" returned: 0 in 1.024s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:39:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6a306a8e-5435-4fa4-84e5-4133d52d5d8c tempest-VolumesSnapshotListTestJSON-1328804210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3a9a842-3989-47a8-93b2-0050e3878aa9.ae7c6527-1a9e-431b-81fc-19a9a97e4694 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9.dca20698-639c-4b6e-932f-c7e254bbf10a {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:39:42 devstack sudo[97061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3a9a842-3989-47a8-93b2-0050e3878aa9.ae7c6527-1a9e-431b-81fc-19a9a97e4694 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9.dca20698-639c-4b6e-932f-c7e254bbf10a
Jul 09 14:39:42 devstack sudo[97061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:39:42 devstack sudo[97059]: pam_unix(sudo:session): session closed for user root
Jul 09 14:39:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-573e04a5-6092-4c32-a0b8-0887c82d0fcd tempest-AttachVolumeTestJSON-1021532728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b18e5cfa-10ed-457b-8480-2744c415d925" returned: 0 in 0.731s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:39:42 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-573e04a5-6092-4c32-a0b8-0887c82d0fcd tempest-AttachVolumeTestJSON-1021532728 None] Lock "cinder-quobyte-b18e5cfa-10ed-457b-8480-2744c415d925" released by "delete_volume" :: held 1.612s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:39:42 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-573e04a5-6092-4c32-a0b8-0887c82d0fcd tempest-AttachVolumeTestJSON-1021532728 None] Created reservations ['5b84973f-0ec4-4287-82f3-020b19b5573e', '1913b9d0-4c58-48f7-98eb-25575cd21354', '0c2e2593-16a8-4c11-818b-e474c06a6330', 'ef5515f4-38eb-4b7e-86b3-1d607b76e8f9'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:39:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-573e04a5-6092-4c32-a0b8-0887c82d0fcd tempest-AttachVolumeTestJSON-1021532728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:39:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-573e04a5-6092-4c32-a0b8-0887c82d0fcd tempest-AttachVolumeTestJSON-1021532728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:39:43 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-573e04a5-6092-4c32-a0b8-0887c82d0fcd tempest-AttachVolumeTestJSON-1021532728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:39:43 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-573e04a5-6092-4c32-a0b8-0887c82d0fcd tempest-AttachVolumeTestJSON-1021532728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:39:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-573e04a5-6092-4c32-a0b8-0887c82d0fcd tempest-AttachVolumeTestJSON-1021532728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:39:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-573e04a5-6092-4c32-a0b8-0887c82d0fcd tempest-AttachVolumeTestJSON-1021532728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:39:43 devstack sudo[97067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:39:43 devstack sudo[97067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:39:43 devstack sudo[97061]: pam_unix(sudo:session): session closed for user root
Jul 09 14:39:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6a306a8e-5435-4fa4-84e5-4133d52d5d8c tempest-VolumesSnapshotListTestJSON-1328804210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3a9a842-3989-47a8-93b2-0050e3878aa9.ae7c6527-1a9e-431b-81fc-19a9a97e4694 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9.dca20698-639c-4b6e-932f-c7e254bbf10a" returned: 0 in 0.761s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:39:43 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-6a306a8e-5435-4fa4-84e5-4133d52d5d8c tempest-VolumesSnapshotListTestJSON-1328804210 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9.dca20698-639c-4b6e-932f-c7e254bbf10a is being set with open permissions: ugo+rw
Jul 09 14:39:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6a306a8e-5435-4fa4-84e5-4133d52d5d8c tempest-VolumesSnapshotListTestJSON-1328804210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9.dca20698-639c-4b6e-932f-c7e254bbf10a {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:39:43 devstack sudo[97069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9.dca20698-639c-4b6e-932f-c7e254bbf10a
Jul 09 14:39:43 devstack sudo[97069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:39:43 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-6a5ed62f-1a90-46da-b056-e236deb97ce6 tempest-AttachVolumeTestJSON-1021532728 None] Acquiring lock "cinder-1133595f-7c70-4572-9dc7-c4954a7c4448-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:39:43 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-6a5ed62f-1a90-46da-b056-e236deb97ce6 tempest-AttachVolumeTestJSON-1021532728 None] Lock "cinder-1133595f-7c70-4572-9dc7-c4954a7c4448-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:39:43 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-6a5ed62f-1a90-46da-b056-e236deb97ce6 tempest-AttachVolumeTestJSON-1021532728 None] Acquiring lock "cinder-quobyte-1133595f-7c70-4572-9dc7-c4954a7c4448" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:39:43 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-6a5ed62f-1a90-46da-b056-e236deb97ce6 tempest-AttachVolumeTestJSON-1021532728 None] Lock "cinder-quobyte-1133595f-7c70-4572-9dc7-c4954a7c4448" acquired by "delete_volume" :: waited 0.019s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:39:43 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddb3afdb-7423-4e65-9b0e-2b50ae36ec09]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:39:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6a5ed62f-1a90-46da-b056-e236deb97ce6 tempest-AttachVolumeTestJSON-1021532728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1133595f-7c70-4572-9dc7-c4954a7c4448 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:39:43 devstack sudo[97071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1133595f-7c70-4572-9dc7-c4954a7c4448
Jul 09 14:39:43 devstack sudo[97071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:39:43 devstack sudo[97067]: pam_unix(sudo:session): session closed for user root
Jul 09 14:39:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-573e04a5-6092-4c32-a0b8-0887c82d0fcd tempest-AttachVolumeTestJSON-1021532728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.723s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:39:43 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-573e04a5-6092-4c32-a0b8-0887c82d0fcd tempest-AttachVolumeTestJSON-1021532728 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:39:43 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-573e04a5-6092-4c32-a0b8-0887c82d0fcd tempest-AttachVolumeTestJSON-1021532728 None] Deleted volume successfully.
Jul 09 14:39:43 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-573e04a5-6092-4c32-a0b8-0887c82d0fcd tempest-AttachVolumeTestJSON-1021532728 None] Lock "cinder-b18e5cfa-10ed-457b-8480-2744c415d925-delete_volume" released by "delete_volume" :: held 2.585s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:39:43 devstack sudo[97069]: pam_unix(sudo:session): session closed for user root
Jul 09 14:39:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6a306a8e-5435-4fa4-84e5-4133d52d5d8c tempest-VolumesSnapshotListTestJSON-1328804210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9.dca20698-639c-4b6e-932f-c7e254bbf10a" returned: 0 in 0.807s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:39:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6a306a8e-5435-4fa4-84e5-4133d52d5d8c tempest-VolumesSnapshotListTestJSON-1328804210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.689s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:39:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-88280162-399e-4e9d-bdd9-da8dc739fd95 tempest-VolumesServicesTestJSON-547592976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.489s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:39:43 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-88280162-399e-4e9d-bdd9-da8dc739fd95 tempest-VolumesServicesTestJSON-547592976 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:39:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1538638462',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85ff9cf3-4153-420d-9155-5fa970e6f9a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5cd831b368f425f81151ee1e095b4c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:39:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:39:40Z,use_quota=True,user_id='d924b0c8f972434b92d0ad3012a81f07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:39:43 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-88280162-399e-4e9d-bdd9-da8dc739fd95 tempest-VolumesServicesTestJSON-547592976 None] Creating volume 85ff9cf3-4153-420d-9155-5fa970e6f9a3 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:39:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-88280162-399e-4e9d-bdd9-da8dc739fd95 tempest-VolumesServicesTestJSON-547592976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:39:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-88280162-399e-4e9d-bdd9-da8dc739fd95 tempest-VolumesServicesTestJSON-547592976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:39:43 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-88280162-399e-4e9d-bdd9-da8dc739fd95 tempest-VolumesServicesTestJSON-547592976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:39:43 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-88280162-399e-4e9d-bdd9-da8dc739fd95 tempest-VolumesServicesTestJSON-547592976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:39:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-88280162-399e-4e9d-bdd9-da8dc739fd95 tempest-VolumesServicesTestJSON-547592976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:39:43 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-88280162-399e-4e9d-bdd9-da8dc739fd95 tempest-VolumesServicesTestJSON-547592976 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:39:43 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-88280162-399e-4e9d-bdd9-da8dc739fd95 tempest-VolumesServicesTestJSON-547592976 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:39:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-88280162-399e-4e9d-bdd9-da8dc739fd95 tempest-VolumesServicesTestJSON-547592976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-85ff9cf3-4153-420d-9155-5fa970e6f9a3 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:39:44 devstack sudo[97075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-85ff9cf3-4153-420d-9155-5fa970e6f9a3 1073741824
Jul 09 14:39:44 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-6a306a8e-5435-4fa4-84e5-4133d52d5d8c tempest-VolumesSnapshotListTestJSON-1328804210 None] Create snapshot completed successfully
Jul 09 14:39:44 devstack sudo[97075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:39:44 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bdf07d7-4520-4ff2-8401-41bf4907857b tempest-SnapshotsActionsTest-1933512236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:39:44 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1bdf07d7-4520-4ff2-8401-41bf4907857b tempest-SnapshotsActionsTest-1933512236 None] Flow 'volume_create_manager' (027321a2-8ed3-4312-9be8-8e0f4412c4c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:39:44 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1bdf07d7-4520-4ff2-8401-41bf4907857b tempest-SnapshotsActionsTest-1933512236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (624ccf3f-0851-41f4-9958-19013c70c052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:39:44 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1bdf07d7-4520-4ff2-8401-41bf4907857b tempest-SnapshotsActionsTest-1933512236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (624ccf3f-0851-41f4-9958-19013c70c052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:39:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-462460088',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29f428fb-5235-412a-98f9-1c121415ff54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1a671c0bd534cfe8f4eb0d3d6b9c021',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:39:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:39:44Z,use_quota=True,user_id='6da29ad095b6468c8eb6d52b8d38f5c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:39:44 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1bdf07d7-4520-4ff2-8401-41bf4907857b tempest-SnapshotsActionsTest-1933512236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a3e780c-9014-478a-945f-0d7dffc8ac54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:39:44 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1bdf07d7-4520-4ff2-8401-41bf4907857b tempest-SnapshotsActionsTest-1933512236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a3e780c-9014-478a-945f-0d7dffc8ac54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:39:44 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1bdf07d7-4520-4ff2-8401-41bf4907857b tempest-SnapshotsActionsTest-1933512236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8574da32-5dd7-4999-a12a-0f3f70364f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:39:44 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1bdf07d7-4520-4ff2-8401-41bf4907857b tempest-SnapshotsActionsTest-1933512236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8574da32-5dd7-4999-a12a-0f3f70364f85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29f428fb-5235-412a-98f9-1c121415ff54', 'volume_name': 'volume-29f428fb-5235-412a-98f9-1c121415ff54', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:39:44 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1bdf07d7-4520-4ff2-8401-41bf4907857b tempest-SnapshotsActionsTest-1933512236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00cf16cb-e44e-4be4-ad24-7e428e3683aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:39:44 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1bdf07d7-4520-4ff2-8401-41bf4907857b tempest-SnapshotsActionsTest-1933512236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00cf16cb-e44e-4be4-ad24-7e428e3683aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:39:44 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1bdf07d7-4520-4ff2-8401-41bf4907857b tempest-SnapshotsActionsTest-1933512236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (237063ea-f14b-4791-a7fa-b9468a64ade7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:39:44 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-1bdf07d7-4520-4ff2-8401-41bf4907857b tempest-SnapshotsActionsTest-1933512236 None] Volume 29f428fb-5235-412a-98f9-1c121415ff54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29f428fb-5235-412a-98f9-1c121415ff54', 'volume_size': 1}
Jul 09 14:39:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1bdf07d7-4520-4ff2-8401-41bf4907857b tempest-SnapshotsActionsTest-1933512236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:39:44 devstack sudo[97071]: pam_unix(sudo:session): session closed for user root
Jul 09 14:39:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6a5ed62f-1a90-46da-b056-e236deb97ce6 tempest-AttachVolumeTestJSON-1021532728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1133595f-7c70-4572-9dc7-c4954a7c4448" returned: 0 in 0.914s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:39:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6a5ed62f-1a90-46da-b056-e236deb97ce6 tempest-AttachVolumeTestJSON-1021532728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1133595f-7c70-4572-9dc7-c4954a7c4448 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:39:44 devstack sudo[97080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1133595f-7c70-4572-9dc7-c4954a7c4448
Jul 09 14:39:44 devstack sudo[97080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:39:45 devstack sudo[97075]: pam_unix(sudo:session): session closed for user root
Jul 09 14:39:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-88280162-399e-4e9d-bdd9-da8dc739fd95 tempest-VolumesServicesTestJSON-547592976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-85ff9cf3-4153-420d-9155-5fa970e6f9a3 1073741824" returned: 0 in 1.086s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:39:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-88280162-399e-4e9d-bdd9-da8dc739fd95 tempest-VolumesServicesTestJSON-547592976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-85ff9cf3-4153-420d-9155-5fa970e6f9a3 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:39:45 devstack sudo[97085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-85ff9cf3-4153-420d-9155-5fa970e6f9a3
Jul 09 14:39:45 devstack sudo[97085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:39:45 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b0e7d2f5-edd3-4445-90a2-c7718928c485 tempest-VolumesSnapshotListTestJSON-1328804210 None] Acquiring lock "cinder-dca20698-639c-4b6e-932f-c7e254bbf10a-delete_snapshot" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:39:45 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b0e7d2f5-edd3-4445-90a2-c7718928c485 tempest-VolumesSnapshotListTestJSON-1328804210 None] Lock "cinder-dca20698-639c-4b6e-932f-c7e254bbf10a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:39:45 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b0e7d2f5-edd3-4445-90a2-c7718928c485 tempest-VolumesSnapshotListTestJSON-1328804210 None] Acquiring lock "cinder-quobyte-a3a9a842-3989-47a8-93b2-0050e3878aa9" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:39:45 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b0e7d2f5-edd3-4445-90a2-c7718928c485 tempest-VolumesSnapshotListTestJSON-1328804210 None] Lock "cinder-quobyte-a3a9a842-3989-47a8-93b2-0050e3878aa9" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:39:45 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b0e7d2f5-edd3-4445-90a2-c7718928c485 tempest-VolumesSnapshotListTestJSON-1328804210 None] Acquiring lock "cinder-quobyte-dca20698-639c-4b6e-932f-c7e254bbf10a" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:39:45 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b0e7d2f5-edd3-4445-90a2-c7718928c485 tempest-VolumesSnapshotListTestJSON-1328804210 None] Lock "cinder-quobyte-dca20698-639c-4b6e-932f-c7e254bbf10a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:39:45 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-b0e7d2f5-edd3-4445-90a2-c7718928c485 tempest-VolumesSnapshotListTestJSON-1328804210 None] Deleting offline snapshot dca20698-639c-4b6e-932f-c7e254bbf10a of volume a3a9a842-3989-47a8-93b2-0050e3878aa9 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 14:39:45 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-b0e7d2f5-edd3-4445-90a2-c7718928c485 tempest-VolumesSnapshotListTestJSON-1328804210 None] snapshot_file for this snap is: volume-a3a9a842-3989-47a8-93b2-0050e3878aa9.dca20698-639c-4b6e-932f-c7e254bbf10a {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 14:39:45 devstack sudo[97080]: pam_unix(sudo:session): session closed for user root
Jul 09 14:39:45 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e8aa8f-8a86-4f6a-b675-f75d2d1fd758]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:39:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6a5ed62f-1a90-46da-b056-e236deb97ce6 tempest-AttachVolumeTestJSON-1021532728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1133595f-7c70-4572-9dc7-c4954a7c4448" returned: 0 in 0.792s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:39:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b0e7d2f5-edd3-4445-90a2-c7718928c485 tempest-VolumesSnapshotListTestJSON-1328804210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9.dca20698-639c-4b6e-932f-c7e254bbf10a {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:39:45 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-6a5ed62f-1a90-46da-b056-e236deb97ce6 tempest-AttachVolumeTestJSON-1021532728 None] Lock "cinder-quobyte-1133595f-7c70-4572-9dc7-c4954a7c4448" released by "delete_volume" :: held 1.779s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:39:45 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-6a5ed62f-1a90-46da-b056-e236deb97ce6 tempest-AttachVolumeTestJSON-1021532728 None] Created reservations ['03306ab0-c3dc-4213-a9fe-c4aaa008673d', '23d1c269-142e-48ad-a022-edb7fac38e3e', '613e49cf-67ba-4ba1-a138-37ac2da08cc2', '5c33f8dc-2738-4175-b19d-eb586fe4954f'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:39:45 devstack sudo[97088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9.dca20698-639c-4b6e-932f-c7e254bbf10a
Jul 09 14:39:45 devstack sudo[97088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:39:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6a5ed62f-1a90-46da-b056-e236deb97ce6 tempest-AttachVolumeTestJSON-1021532728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:39:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6a5ed62f-1a90-46da-b056-e236deb97ce6 tempest-AttachVolumeTestJSON-1021532728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:39:45 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-6a5ed62f-1a90-46da-b056-e236deb97ce6 tempest-AttachVolumeTestJSON-1021532728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:39:45 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-6a5ed62f-1a90-46da-b056-e236deb97ce6 tempest-AttachVolumeTestJSON-1021532728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:39:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6a5ed62f-1a90-46da-b056-e236deb97ce6 tempest-AttachVolumeTestJSON-1021532728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:39:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6a5ed62f-1a90-46da-b056-e236deb97ce6 tempest-AttachVolumeTestJSON-1021532728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:39:45 devstack sudo[97090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:39:45 devstack sudo[97090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:39:45 devstack sudo[97085]: pam_unix(sudo:session): session closed for user root
Jul 09 14:39:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-88280162-399e-4e9d-bdd9-da8dc739fd95 tempest-VolumesServicesTestJSON-547592976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-85ff9cf3-4153-420d-9155-5fa970e6f9a3" returned: 0 in 0.716s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:39:45 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-88280162-399e-4e9d-bdd9-da8dc739fd95 tempest-VolumesServicesTestJSON-547592976 None] <== create_volume: return (1855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:39:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-88280162-399e-4e9d-bdd9-da8dc739fd95 tempest-VolumesServicesTestJSON-547592976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.859s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:39:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1bdf07d7-4520-4ff2-8401-41bf4907857b tempest-SnapshotsActionsTest-1933512236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.424s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:39:45 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-1bdf07d7-4520-4ff2-8401-41bf4907857b tempest-SnapshotsActionsTest-1933512236 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:39:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-462460088',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29f428fb-5235-412a-98f9-1c121415ff54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1a671c0bd534cfe8f4eb0d3d6b9c021',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:39:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:39:44Z,use_quota=True,user_id='6da29ad095b6468c8eb6d52b8d38f5c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:39:45 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-1bdf07d7-4520-4ff2-8401-41bf4907857b tempest-SnapshotsActionsTest-1933512236 None] Creating volume 29f428fb-5235-412a-98f9-1c121415ff54 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:39:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1bdf07d7-4520-4ff2-8401-41bf4907857b tempest-SnapshotsActionsTest-1933512236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:39:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1bdf07d7-4520-4ff2-8401-41bf4907857b tempest-SnapshotsActionsTest-1933512236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:39:45 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-1bdf07d7-4520-4ff2-8401-41bf4907857b tempest-SnapshotsActionsTest-1933512236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:39:45 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-1bdf07d7-4520-4ff2-8401-41bf4907857b tempest-SnapshotsActionsTest-1933512236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:39:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1bdf07d7-4520-4ff2-8401-41bf4907857b tempest-SnapshotsActionsTest-1933512236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:39:45 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-1bdf07d7-4520-4ff2-8401-41bf4907857b tempest-SnapshotsActionsTest-1933512236 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:39:45 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-1bdf07d7-4520-4ff2-8401-41bf4907857b tempest-SnapshotsActionsTest-1933512236 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:39:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1bdf07d7-4520-4ff2-8401-41bf4907857b tempest-SnapshotsActionsTest-1933512236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:39:45 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-88280162-399e-4e9d-bdd9-da8dc739fd95 tempest-VolumesServicesTestJSON-547592976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67cfdc91-b453-4afe-bd81-2d9c94fb9ab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85ff9cf3-4153-420d-9155-5fa970e6f9a3', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:39:45 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-88280162-399e-4e9d-bdd9-da8dc739fd95 tempest-VolumesServicesTestJSON-547592976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9c0b4e9-db1a-46f0-a535-e511e628f830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:39:45 devstack sudo[97093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54 1073741824
Jul 09 14:39:45 devstack sudo[97093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:39:45 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-034c87ff-df02-4fab-9f10-f1c8b4cf0d7d tempest-AttachVolumeTestJSON-1021532728 None] Acquiring lock "cinder-f4037ab3-2b95-420a-8f05-28104dae06eb-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:39:45 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-88280162-399e-4e9d-bdd9-da8dc739fd95 tempest-VolumesServicesTestJSON-547592976 None] Volume volume-85ff9cf3-4153-420d-9155-5fa970e6f9a3 (85ff9cf3-4153-420d-9155-5fa970e6f9a3): created successfully
Jul 09 14:39:45 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-88280162-399e-4e9d-bdd9-da8dc739fd95 tempest-VolumesServicesTestJSON-547592976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9c0b4e9-db1a-46f0-a535-e511e628f830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:39:45 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-88280162-399e-4e9d-bdd9-da8dc739fd95 tempest-VolumesServicesTestJSON-547592976 None] Flow 'volume_create_manager' (fa2d32ad-768b-4651-b75c-c2d60c5177b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:39:45 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-88280162-399e-4e9d-bdd9-da8dc739fd95 tempest-VolumesServicesTestJSON-547592976 None] Created volume successfully.
Jul 09 14:39:45 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-034c87ff-df02-4fab-9f10-f1c8b4cf0d7d tempest-AttachVolumeTestJSON-1021532728 None] Lock "cinder-f4037ab3-2b95-420a-8f05-28104dae06eb-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:39:45 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-034c87ff-df02-4fab-9f10-f1c8b4cf0d7d tempest-AttachVolumeTestJSON-1021532728 None] Acquiring lock "cinder-quobyte-f4037ab3-2b95-420a-8f05-28104dae06eb" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:39:46 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-034c87ff-df02-4fab-9f10-f1c8b4cf0d7d tempest-AttachVolumeTestJSON-1021532728 None] Lock "cinder-quobyte-f4037ab3-2b95-420a-8f05-28104dae06eb" acquired by "delete_volume" :: waited 0.018s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:39:46 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff9390c-12f5-4de4-9cac-bdd181d41d71]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:39:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-034c87ff-df02-4fab-9f10-f1c8b4cf0d7d tempest-AttachVolumeTestJSON-1021532728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-f4037ab3-2b95-420a-8f05-28104dae06eb {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:39:46 devstack sudo[97097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-f4037ab3-2b95-420a-8f05-28104dae06eb
Jul 09 14:39:46 devstack sudo[97097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:39:46 devstack sudo[97088]: pam_unix(sudo:session): session closed for user root
Jul 09 14:39:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b0e7d2f5-edd3-4445-90a2-c7718928c485 tempest-VolumesSnapshotListTestJSON-1328804210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9.dca20698-639c-4b6e-932f-c7e254bbf10a" returned: 0 in 0.896s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:39:46 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-b0e7d2f5-edd3-4445-90a2-c7718928c485 tempest-VolumesSnapshotListTestJSON-1328804210 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3a9a842-3989-47a8-93b2-0050e3878aa9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 14:39:46 devstack sudo[97090]: pam_unix(sudo:session): session closed for user root
Jul 09 14:39:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6a5ed62f-1a90-46da-b056-e236deb97ce6 tempest-AttachVolumeTestJSON-1021532728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.749s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:39:46 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-6a5ed62f-1a90-46da-b056-e236deb97ce6 tempest-AttachVolumeTestJSON-1021532728 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:39:46 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[8801789f-a317-4232-baff-5e43aaa0d6f4]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:39:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b0e7d2f5-edd3-4445-90a2-c7718928c485 tempest-VolumesSnapshotListTestJSON-1328804210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9.ae7c6527-1a9e-431b-81fc-19a9a97e4694 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:39:46 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-6a5ed62f-1a90-46da-b056-e236deb97ce6 tempest-AttachVolumeTestJSON-1021532728 None] Deleted volume successfully.
Jul 09 14:39:46 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-6a5ed62f-1a90-46da-b056-e236deb97ce6 tempest-AttachVolumeTestJSON-1021532728 None] Lock "cinder-1133595f-7c70-4572-9dc7-c4954a7c4448-delete_volume" released by "delete_volume" :: held 2.823s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:39:46 devstack sudo[97101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9.ae7c6527-1a9e-431b-81fc-19a9a97e4694
Jul 09 14:39:46 devstack sudo[97101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:39:46 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-163fcb12-3d07-482c-b733-7d6a59f9d214 tempest-VolumesServicesTestJSON-547592976 None] Acquiring lock "cinder-85ff9cf3-4153-420d-9155-5fa970e6f9a3-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:39:46 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-163fcb12-3d07-482c-b733-7d6a59f9d214 tempest-VolumesServicesTestJSON-547592976 None] Lock "cinder-85ff9cf3-4153-420d-9155-5fa970e6f9a3-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:39:46 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-163fcb12-3d07-482c-b733-7d6a59f9d214 tempest-VolumesServicesTestJSON-547592976 None] Acquiring lock "cinder-quobyte-85ff9cf3-4153-420d-9155-5fa970e6f9a3" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:39:46 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-163fcb12-3d07-482c-b733-7d6a59f9d214 tempest-VolumesServicesTestJSON-547592976 None] Lock "cinder-quobyte-85ff9cf3-4153-420d-9155-5fa970e6f9a3" acquired by "delete_volume" :: waited 0.016s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:39:46 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f324932-ddce-4116-be8c-e3cf6a919754]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:39:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-163fcb12-3d07-482c-b733-7d6a59f9d214 tempest-VolumesServicesTestJSON-547592976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-85ff9cf3-4153-420d-9155-5fa970e6f9a3 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:39:46 devstack sudo[97093]: pam_unix(sudo:session): session closed for user root
Jul 09 14:39:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1bdf07d7-4520-4ff2-8401-41bf4907857b tempest-SnapshotsActionsTest-1933512236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54 1073741824" returned: 0 in 1.118s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:39:46 devstack sudo[97097]: pam_unix(sudo:session): session closed for user root
Jul 09 14:39:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-034c87ff-df02-4fab-9f10-f1c8b4cf0d7d tempest-AttachVolumeTestJSON-1021532728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-f4037ab3-2b95-420a-8f05-28104dae06eb" returned: 0 in 0.940s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:39:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-034c87ff-df02-4fab-9f10-f1c8b4cf0d7d tempest-AttachVolumeTestJSON-1021532728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-f4037ab3-2b95-420a-8f05-28104dae06eb {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:39:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1bdf07d7-4520-4ff2-8401-41bf4907857b tempest-SnapshotsActionsTest-1933512236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:39:47 devstack sudo[97114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-f4037ab3-2b95-420a-8f05-28104dae06eb
Jul 09 14:39:47 devstack sudo[97114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:39:47 devstack sudo[97110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-85ff9cf3-4153-420d-9155-5fa970e6f9a3
Jul 09 14:39:47 devstack sudo[97110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:39:47 devstack sudo[97115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54
Jul 09 14:39:47 devstack sudo[97115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:39:47 devstack sudo[97101]: pam_unix(sudo:session): session closed for user root
Jul 09 14:39:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b0e7d2f5-edd3-4445-90a2-c7718928c485 tempest-VolumesSnapshotListTestJSON-1328804210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9.ae7c6527-1a9e-431b-81fc-19a9a97e4694" returned: 0 in 0.890s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:39:47 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-b0e7d2f5-edd3-4445-90a2-c7718928c485 tempest-VolumesSnapshotListTestJSON-1328804210 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3a9a842-3989-47a8-93b2-0050e3878aa9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 14:39:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b0e7d2f5-edd3-4445-90a2-c7718928c485 tempest-VolumesSnapshotListTestJSON-1328804210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9.dca20698-639c-4b6e-932f-c7e254bbf10a {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:39:47 devstack sudo[97119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9.dca20698-639c-4b6e-932f-c7e254bbf10a
Jul 09 14:39:47 devstack sudo[97119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:39:47 devstack sudo[97114]: pam_unix(sudo:session): session closed for user root
Jul 09 14:39:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-034c87ff-df02-4fab-9f10-f1c8b4cf0d7d tempest-AttachVolumeTestJSON-1021532728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-f4037ab3-2b95-420a-8f05-28104dae06eb" returned: 0 in 0.721s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:39:47 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-034c87ff-df02-4fab-9f10-f1c8b4cf0d7d tempest-AttachVolumeTestJSON-1021532728 None] Lock "cinder-quobyte-f4037ab3-2b95-420a-8f05-28104dae06eb" released by "delete_volume" :: held 1.720s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:39:47 devstack sudo[97110]: pam_unix(sudo:session): session closed for user root
Jul 09 14:39:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-163fcb12-3d07-482c-b733-7d6a59f9d214 tempest-VolumesServicesTestJSON-547592976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-85ff9cf3-4153-420d-9155-5fa970e6f9a3" returned: 0 in 0.845s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:39:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-163fcb12-3d07-482c-b733-7d6a59f9d214 tempest-VolumesServicesTestJSON-547592976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-85ff9cf3-4153-420d-9155-5fa970e6f9a3 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:39:47 devstack sudo[97129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-85ff9cf3-4153-420d-9155-5fa970e6f9a3
Jul 09 14:39:47 devstack sudo[97129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:39:47 devstack sudo[97115]: pam_unix(sudo:session): session closed for user root
Jul 09 14:39:47 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-034c87ff-df02-4fab-9f10-f1c8b4cf0d7d tempest-AttachVolumeTestJSON-1021532728 None] Created reservations ['09f9d3f2-06eb-48cd-bf21-2e5f115b162c', '2d8f92c3-5bb4-41da-9b93-4feafe2c7d66', '63ad43bc-ec21-46ed-acaa-83054a972cac', 'ffeffd80-b843-4c6f-bf74-f2ebb3c72a42'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:39:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1bdf07d7-4520-4ff2-8401-41bf4907857b tempest-SnapshotsActionsTest-1933512236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54" returned: 0 in 0.805s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:39:47 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-1bdf07d7-4520-4ff2-8401-41bf4907857b tempest-SnapshotsActionsTest-1933512236 None] <== create_volume: return (1990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:39:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1bdf07d7-4520-4ff2-8401-41bf4907857b tempest-SnapshotsActionsTest-1933512236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.993s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:39:47 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1bdf07d7-4520-4ff2-8401-41bf4907857b tempest-SnapshotsActionsTest-1933512236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (237063ea-f14b-4791-a7fa-b9468a64ade7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29f428fb-5235-412a-98f9-1c121415ff54', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:39:47 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1bdf07d7-4520-4ff2-8401-41bf4907857b tempest-SnapshotsActionsTest-1933512236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bfc7dc1-6dea-4d57-a7fb-5bd60b54f71a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:39:47 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-1bdf07d7-4520-4ff2-8401-41bf4907857b tempest-SnapshotsActionsTest-1933512236 None] Volume volume-29f428fb-5235-412a-98f9-1c121415ff54 (29f428fb-5235-412a-98f9-1c121415ff54): created successfully
Jul 09 14:39:47 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1bdf07d7-4520-4ff2-8401-41bf4907857b tempest-SnapshotsActionsTest-1933512236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bfc7dc1-6dea-4d57-a7fb-5bd60b54f71a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:39:47 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1bdf07d7-4520-4ff2-8401-41bf4907857b tempest-SnapshotsActionsTest-1933512236 None] Flow 'volume_create_manager' (027321a2-8ed3-4312-9be8-8e0f4412c4c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:39:47 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-1bdf07d7-4520-4ff2-8401-41bf4907857b tempest-SnapshotsActionsTest-1933512236 None] Created volume successfully.
Jul 09 14:39:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-034c87ff-df02-4fab-9f10-f1c8b4cf0d7d tempest-AttachVolumeTestJSON-1021532728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:39:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-034c87ff-df02-4fab-9f10-f1c8b4cf0d7d tempest-AttachVolumeTestJSON-1021532728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:39:47 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-034c87ff-df02-4fab-9f10-f1c8b4cf0d7d tempest-AttachVolumeTestJSON-1021532728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:39:47 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-034c87ff-df02-4fab-9f10-f1c8b4cf0d7d tempest-AttachVolumeTestJSON-1021532728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:39:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-034c87ff-df02-4fab-9f10-f1c8b4cf0d7d tempest-AttachVolumeTestJSON-1021532728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:39:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-034c87ff-df02-4fab-9f10-f1c8b4cf0d7d tempest-AttachVolumeTestJSON-1021532728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:39:47 devstack sudo[97132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:39:47 devstack sudo[97132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:39:48 devstack sudo[97119]: pam_unix(sudo:session): session closed for user root
Jul 09 14:39:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b0e7d2f5-edd3-4445-90a2-c7718928c485 tempest-VolumesSnapshotListTestJSON-1328804210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9.dca20698-639c-4b6e-932f-c7e254bbf10a" returned: 0 in 0.882s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:39:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b0e7d2f5-edd3-4445-90a2-c7718928c485 tempest-VolumesSnapshotListTestJSON-1328804210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9.dca20698-639c-4b6e-932f-c7e254bbf10a {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:39:48 devstack sudo[97134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9.dca20698-639c-4b6e-932f-c7e254bbf10a
Jul 09 14:39:48 devstack sudo[97134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:39:48 devstack sudo[97129]: pam_unix(sudo:session): session closed for user root
Jul 09 14:39:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-163fcb12-3d07-482c-b733-7d6a59f9d214 tempest-VolumesServicesTestJSON-547592976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-85ff9cf3-4153-420d-9155-5fa970e6f9a3" returned: 0 in 0.708s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:39:48 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-163fcb12-3d07-482c-b733-7d6a59f9d214 tempest-VolumesServicesTestJSON-547592976 None] Lock "cinder-quobyte-85ff9cf3-4153-420d-9155-5fa970e6f9a3" released by "delete_volume" :: held 1.624s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:39:48 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-163fcb12-3d07-482c-b733-7d6a59f9d214 tempest-VolumesServicesTestJSON-547592976 None] Created reservations ['9fb2540f-40d1-4fd3-8916-a2a03b02a586', '052b8d5c-f3e1-41e2-9633-23f6d865213b', '05e5511d-3ed2-49c4-a80b-96909e7e7f8c', '8428f434-16fa-4f98-808f-9dd7e3df1344'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:39:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-163fcb12-3d07-482c-b733-7d6a59f9d214 tempest-VolumesServicesTestJSON-547592976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:39:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-163fcb12-3d07-482c-b733-7d6a59f9d214 tempest-VolumesServicesTestJSON-547592976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:39:48 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-163fcb12-3d07-482c-b733-7d6a59f9d214 tempest-VolumesServicesTestJSON-547592976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:39:48 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-163fcb12-3d07-482c-b733-7d6a59f9d214 tempest-VolumesServicesTestJSON-547592976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:39:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-163fcb12-3d07-482c-b733-7d6a59f9d214 tempest-VolumesServicesTestJSON-547592976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:39:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-163fcb12-3d07-482c-b733-7d6a59f9d214 tempest-VolumesServicesTestJSON-547592976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:39:48 devstack sudo[97138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:39:48 devstack sudo[97138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:39:48 devstack sudo[97132]: pam_unix(sudo:session): session closed for user root
Jul 09 14:39:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-034c87ff-df02-4fab-9f10-f1c8b4cf0d7d tempest-AttachVolumeTestJSON-1021532728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.779s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:39:48 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-034c87ff-df02-4fab-9f10-f1c8b4cf0d7d tempest-AttachVolumeTestJSON-1021532728 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:39:48 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-034c87ff-df02-4fab-9f10-f1c8b4cf0d7d tempest-AttachVolumeTestJSON-1021532728 None] Deleted volume successfully.
Jul 09 14:39:48 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-034c87ff-df02-4fab-9f10-f1c8b4cf0d7d tempest-AttachVolumeTestJSON-1021532728 None] Lock "cinder-f4037ab3-2b95-420a-8f05-28104dae06eb-delete_volume" released by "delete_volume" :: held 2.820s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:39:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-301e808e-6465-4849-8f22-fbc8886cea2b tempest-SnapshotsActionsTest-1933512236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:39:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-301e808e-6465-4849-8f22-fbc8886cea2b tempest-SnapshotsActionsTest-1933512236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:39:48 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-301e808e-6465-4849-8f22-fbc8886cea2b tempest-SnapshotsActionsTest-1933512236 None] Creating offline snapshot 9e0132d1-de38-4d07-8bbd-6bcb1a634a01 of volume 29f428fb-5235-412a-98f9-1c121415ff54 {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 14:39:48 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[46639a57-19b7-4a19-b37b-70e44d7ddaa9]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:39:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-301e808e-6465-4849-8f22-fbc8886cea2b tempest-SnapshotsActionsTest-1933512236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:39:49 devstack sudo[97134]: pam_unix(sudo:session): session closed for user root
Jul 09 14:39:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b0e7d2f5-edd3-4445-90a2-c7718928c485 tempest-VolumesSnapshotListTestJSON-1328804210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9.dca20698-639c-4b6e-932f-c7e254bbf10a" returned: 0 in 0.989s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:39:49 devstack sudo[97141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54
Jul 09 14:39:49 devstack sudo[97141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:39:49 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b0e7d2f5-edd3-4445-90a2-c7718928c485 tempest-VolumesSnapshotListTestJSON-1328804210 None] Lock "cinder-quobyte-dca20698-639c-4b6e-932f-c7e254bbf10a" released by "_delete_snapshot" :: held 3.819s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:39:49 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b0e7d2f5-edd3-4445-90a2-c7718928c485 tempest-VolumesSnapshotListTestJSON-1328804210 None] Lock "cinder-quobyte-a3a9a842-3989-47a8-93b2-0050e3878aa9" released by "delete_snapshot" :: held 3.853s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:39:49 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-b0e7d2f5-edd3-4445-90a2-c7718928c485 tempest-VolumesSnapshotListTestJSON-1328804210 None] Created reservations ['132970f1-d124-4185-9c23-ab4d57934178', 'edc05153-daf6-4ede-8b32-2e6b34ac78ee', '072f632a-a10c-4fbd-8f63-47b18d4f09de', 'f6e23286-d396-49d3-9147-7a060a3d8f8b'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:39:49 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-b0e7d2f5-edd3-4445-90a2-c7718928c485 tempest-VolumesSnapshotListTestJSON-1328804210 None] Delete snapshot completed successfully.
Jul 09 14:39:49 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b0e7d2f5-edd3-4445-90a2-c7718928c485 tempest-VolumesSnapshotListTestJSON-1328804210 None] Lock "cinder-dca20698-639c-4b6e-932f-c7e254bbf10a-delete_snapshot" released by "delete_snapshot" :: held 4.132s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:39:49 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b80a8253-edab-4f91-9bc7-a9c071d70a47 tempest-VolumesSnapshotListTestJSON-1328804210 None] Acquiring lock "cinder-ae7c6527-1a9e-431b-81fc-19a9a97e4694-delete_snapshot" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:39:49 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b80a8253-edab-4f91-9bc7-a9c071d70a47 tempest-VolumesSnapshotListTestJSON-1328804210 None] Lock "cinder-ae7c6527-1a9e-431b-81fc-19a9a97e4694-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:39:49 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b80a8253-edab-4f91-9bc7-a9c071d70a47 tempest-VolumesSnapshotListTestJSON-1328804210 None] Acquiring lock "cinder-quobyte-a3a9a842-3989-47a8-93b2-0050e3878aa9" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:39:49 devstack sudo[97138]: pam_unix(sudo:session): session closed for user root
Jul 09 14:39:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-163fcb12-3d07-482c-b733-7d6a59f9d214 tempest-VolumesServicesTestJSON-547592976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.986s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:39:49 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-163fcb12-3d07-482c-b733-7d6a59f9d214 tempest-VolumesServicesTestJSON-547592976 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:39:49 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-163fcb12-3d07-482c-b733-7d6a59f9d214 tempest-VolumesServicesTestJSON-547592976 None] Deleted volume successfully.
Jul 09 14:39:49 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b80a8253-edab-4f91-9bc7-a9c071d70a47 tempest-VolumesSnapshotListTestJSON-1328804210 None] Lock "cinder-quobyte-a3a9a842-3989-47a8-93b2-0050e3878aa9" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:39:49 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b80a8253-edab-4f91-9bc7-a9c071d70a47 tempest-VolumesSnapshotListTestJSON-1328804210 None] Acquiring lock "cinder-quobyte-ae7c6527-1a9e-431b-81fc-19a9a97e4694" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:39:49 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b80a8253-edab-4f91-9bc7-a9c071d70a47 tempest-VolumesSnapshotListTestJSON-1328804210 None] Lock "cinder-quobyte-ae7c6527-1a9e-431b-81fc-19a9a97e4694" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:39:49 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-b80a8253-edab-4f91-9bc7-a9c071d70a47 tempest-VolumesSnapshotListTestJSON-1328804210 None] Deleting offline snapshot ae7c6527-1a9e-431b-81fc-19a9a97e4694 of volume a3a9a842-3989-47a8-93b2-0050e3878aa9 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 14:39:49 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-b80a8253-edab-4f91-9bc7-a9c071d70a47 tempest-VolumesSnapshotListTestJSON-1328804210 None] snapshot_file for this snap is: volume-a3a9a842-3989-47a8-93b2-0050e3878aa9.ae7c6527-1a9e-431b-81fc-19a9a97e4694 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 14:39:49 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-163fcb12-3d07-482c-b733-7d6a59f9d214 tempest-VolumesServicesTestJSON-547592976 None] Lock "cinder-85ff9cf3-4153-420d-9155-5fa970e6f9a3-delete_volume" released by "delete_volume" :: held 2.898s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:39:49 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ff38ed-cad5-420f-b13c-5950c1e11e51]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:39:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b80a8253-edab-4f91-9bc7-a9c071d70a47 tempest-VolumesSnapshotListTestJSON-1328804210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9.ae7c6527-1a9e-431b-81fc-19a9a97e4694 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:39:49 devstack sudo[97144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9.ae7c6527-1a9e-431b-81fc-19a9a97e4694
Jul 09 14:39:49 devstack sudo[97144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:39:50 devstack sudo[97141]: pam_unix(sudo:session): session closed for user root
Jul 09 14:39:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-301e808e-6465-4849-8f22-fbc8886cea2b tempest-SnapshotsActionsTest-1933512236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54" returned: 0 in 1.196s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:39:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-301e808e-6465-4849-8f22-fbc8886cea2b tempest-SnapshotsActionsTest-1933512236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.9e0132d1-de38-4d07-8bbd-6bcb1a634a01 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:39:50 devstack sudo[97151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.9e0132d1-de38-4d07-8bbd-6bcb1a634a01 1G
Jul 09 14:39:50 devstack sudo[97151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:39:50 devstack sudo[97144]: pam_unix(sudo:session): session closed for user root
Jul 09 14:39:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b80a8253-edab-4f91-9bc7-a9c071d70a47 tempest-VolumesSnapshotListTestJSON-1328804210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9.ae7c6527-1a9e-431b-81fc-19a9a97e4694" returned: 0 in 1.067s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:39:50 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-b80a8253-edab-4f91-9bc7-a9c071d70a47 tempest-VolumesSnapshotListTestJSON-1328804210 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3a9a842-3989-47a8-93b2-0050e3878aa9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 14:39:50 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c06cec-1340-430e-ba41-88e537126899]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:39:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b80a8253-edab-4f91-9bc7-a9c071d70a47 tempest-VolumesSnapshotListTestJSON-1328804210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9.5e8f89db-0f41-49ab-8b93-d1c78132f770 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:39:50 devstack sudo[97160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9.5e8f89db-0f41-49ab-8b93-d1c78132f770
Jul 09 14:39:50 devstack sudo[97160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:39:51 devstack sudo[97151]: pam_unix(sudo:session): session closed for user root
Jul 09 14:39:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-301e808e-6465-4849-8f22-fbc8886cea2b tempest-SnapshotsActionsTest-1933512236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.9e0132d1-de38-4d07-8bbd-6bcb1a634a01 1G" returned: 0 in 1.121s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:39:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-301e808e-6465-4849-8f22-fbc8886cea2b tempest-SnapshotsActionsTest-1933512236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29f428fb-5235-412a-98f9-1c121415ff54 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.9e0132d1-de38-4d07-8bbd-6bcb1a634a01 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:39:51 devstack sudo[97164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29f428fb-5235-412a-98f9-1c121415ff54 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.9e0132d1-de38-4d07-8bbd-6bcb1a634a01
Jul 09 14:39:51 devstack sudo[97164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:39:51 devstack sudo[97160]: pam_unix(sudo:session): session closed for user root
Jul 09 14:39:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b80a8253-edab-4f91-9bc7-a9c071d70a47 tempest-VolumesSnapshotListTestJSON-1328804210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9.5e8f89db-0f41-49ab-8b93-d1c78132f770" returned: 0 in 1.025s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:39:51 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-b80a8253-edab-4f91-9bc7-a9c071d70a47 tempest-VolumesSnapshotListTestJSON-1328804210 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3a9a842-3989-47a8-93b2-0050e3878aa9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 14:39:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b80a8253-edab-4f91-9bc7-a9c071d70a47 tempest-VolumesSnapshotListTestJSON-1328804210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9.ae7c6527-1a9e-431b-81fc-19a9a97e4694 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:39:51 devstack sudo[97169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9.ae7c6527-1a9e-431b-81fc-19a9a97e4694
Jul 09 14:39:51 devstack sudo[97169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:39:52 devstack sudo[97164]: pam_unix(sudo:session): session closed for user root
Jul 09 14:39:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-301e808e-6465-4849-8f22-fbc8886cea2b tempest-SnapshotsActionsTest-1933512236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29f428fb-5235-412a-98f9-1c121415ff54 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.9e0132d1-de38-4d07-8bbd-6bcb1a634a01" returned: 0 in 1.068s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:39:52 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-301e808e-6465-4849-8f22-fbc8886cea2b tempest-SnapshotsActionsTest-1933512236 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.9e0132d1-de38-4d07-8bbd-6bcb1a634a01 is being set with open permissions: ugo+rw
Jul 09 14:39:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-301e808e-6465-4849-8f22-fbc8886cea2b tempest-SnapshotsActionsTest-1933512236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.9e0132d1-de38-4d07-8bbd-6bcb1a634a01 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:39:52 devstack sudo[97176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.9e0132d1-de38-4d07-8bbd-6bcb1a634a01
Jul 09 14:39:52 devstack sudo[97176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:39:52 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 14:39:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:39:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:39:52 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:39:52 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:39:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:39:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:39:52 devstack sudo[97178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:39:52 devstack sudo[97178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:39:53 devstack sudo[97169]: pam_unix(sudo:session): session closed for user root
Jul 09 14:39:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b80a8253-edab-4f91-9bc7-a9c071d70a47 tempest-VolumesSnapshotListTestJSON-1328804210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9.ae7c6527-1a9e-431b-81fc-19a9a97e4694" returned: 0 in 1.323s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:39:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b80a8253-edab-4f91-9bc7-a9c071d70a47 tempest-VolumesSnapshotListTestJSON-1328804210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9.ae7c6527-1a9e-431b-81fc-19a9a97e4694 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:39:53 devstack sudo[97186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9.ae7c6527-1a9e-431b-81fc-19a9a97e4694
Jul 09 14:39:53 devstack sudo[97186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:39:53 devstack sudo[97176]: pam_unix(sudo:session): session closed for user root
Jul 09 14:39:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-301e808e-6465-4849-8f22-fbc8886cea2b tempest-SnapshotsActionsTest-1933512236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.9e0132d1-de38-4d07-8bbd-6bcb1a634a01" returned: 0 in 1.051s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:39:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-301e808e-6465-4849-8f22-fbc8886cea2b tempest-SnapshotsActionsTest-1933512236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:39:53 devstack sudo[97189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.info
Jul 09 14:39:53 devstack sudo[97189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:39:53 devstack sudo[97178]: pam_unix(sudo:session): session closed for user root
Jul 09 14:39:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 1.088s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:39:53 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:39:53 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Running periodic task VolumeManager._thread_info {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 14:39:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] thread count: 8 {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 09 14:39:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] thread info: [<_MainThread(MainThread, started 125388812103808)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125388713797504)>, <Thread(Thread-3 (stat_writer), started daemon 125388699995392)>, <Thread(Rabbit-heartbeat, started daemon 125388700522560)>, <Thread(Thread-5 (_runner), started daemon 125388698545216)>, <Thread(Thread-7 (_runner), started daemon 125388698611264)>, <Thread(fd_logger, started daemon 125388703020672)>, <Thread(privsep_reader, started daemon 125388696441088)>] {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 09 14:39:54 devstack sudo[97186]: pam_unix(sudo:session): session closed for user root
Jul 09 14:39:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b80a8253-edab-4f91-9bc7-a9c071d70a47 tempest-VolumesSnapshotListTestJSON-1328804210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9.ae7c6527-1a9e-431b-81fc-19a9a97e4694" returned: 0 in 1.012s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:39:54 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b80a8253-edab-4f91-9bc7-a9c071d70a47 tempest-VolumesSnapshotListTestJSON-1328804210 None] Lock "cinder-quobyte-ae7c6527-1a9e-431b-81fc-19a9a97e4694" released by "_delete_snapshot" :: held 4.564s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:39:54 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b80a8253-edab-4f91-9bc7-a9c071d70a47 tempest-VolumesSnapshotListTestJSON-1328804210 None] Lock "cinder-quobyte-a3a9a842-3989-47a8-93b2-0050e3878aa9" released by "delete_snapshot" :: held 4.600s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:39:54 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-b80a8253-edab-4f91-9bc7-a9c071d70a47 tempest-VolumesSnapshotListTestJSON-1328804210 None] Created reservations ['1ef28df6-886a-4719-b794-0746c9ddd377', 'c31c2eb5-738b-47af-abde-50464cd6fe94', '690f14ef-b319-47e8-a641-9af95b4cc806', 'd2469a95-dcdd-4d54-bae5-72ff78616db5'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:39:54 devstack sudo[97189]: pam_unix(sudo:session): session closed for user root
Jul 09 14:39:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-301e808e-6465-4849-8f22-fbc8886cea2b tempest-SnapshotsActionsTest-1933512236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.info" returned: 0 in 0.892s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:39:54 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-301e808e-6465-4849-8f22-fbc8886cea2b tempest-SnapshotsActionsTest-1933512236 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.info is being set with open permissions: ugo+rw
Jul 09 14:39:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-301e808e-6465-4849-8f22-fbc8886cea2b tempest-SnapshotsActionsTest-1933512236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:39:54 devstack sudo[97193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.info
Jul 09 14:39:54 devstack sudo[97193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:39:54 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-b80a8253-edab-4f91-9bc7-a9c071d70a47 tempest-VolumesSnapshotListTestJSON-1328804210 None] Delete snapshot completed successfully.
Jul 09 14:39:54 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b80a8253-edab-4f91-9bc7-a9c071d70a47 tempest-VolumesSnapshotListTestJSON-1328804210 None] Lock "cinder-ae7c6527-1a9e-431b-81fc-19a9a97e4694-delete_snapshot" released by "delete_snapshot" :: held 4.828s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:39:54 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-efb14ea9-0479-4f2d-ad9a-19be4888fcc6 tempest-VolumesSnapshotListTestJSON-1328804210 None] Acquiring lock "cinder-5e8f89db-0f41-49ab-8b93-d1c78132f770-delete_snapshot" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:39:55 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-efb14ea9-0479-4f2d-ad9a-19be4888fcc6 tempest-VolumesSnapshotListTestJSON-1328804210 None] Lock "cinder-5e8f89db-0f41-49ab-8b93-d1c78132f770-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:39:55 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-efb14ea9-0479-4f2d-ad9a-19be4888fcc6 tempest-VolumesSnapshotListTestJSON-1328804210 None] Acquiring lock "cinder-quobyte-a3a9a842-3989-47a8-93b2-0050e3878aa9" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:39:55 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-efb14ea9-0479-4f2d-ad9a-19be4888fcc6 tempest-VolumesSnapshotListTestJSON-1328804210 None] Lock "cinder-quobyte-a3a9a842-3989-47a8-93b2-0050e3878aa9" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:39:55 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-efb14ea9-0479-4f2d-ad9a-19be4888fcc6 tempest-VolumesSnapshotListTestJSON-1328804210 None] Acquiring lock "cinder-quobyte-5e8f89db-0f41-49ab-8b93-d1c78132f770" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:39:55 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-efb14ea9-0479-4f2d-ad9a-19be4888fcc6 tempest-VolumesSnapshotListTestJSON-1328804210 None] Lock "cinder-quobyte-5e8f89db-0f41-49ab-8b93-d1c78132f770" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:39:55 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-efb14ea9-0479-4f2d-ad9a-19be4888fcc6 tempest-VolumesSnapshotListTestJSON-1328804210 None] Deleting offline snapshot 5e8f89db-0f41-49ab-8b93-d1c78132f770 of volume a3a9a842-3989-47a8-93b2-0050e3878aa9 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 14:39:55 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-efb14ea9-0479-4f2d-ad9a-19be4888fcc6 tempest-VolumesSnapshotListTestJSON-1328804210 None] snapshot_file for this snap is: volume-a3a9a842-3989-47a8-93b2-0050e3878aa9.5e8f89db-0f41-49ab-8b93-d1c78132f770 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 14:39:55 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[cffaca26-f7c3-4965-82ef-aa06605c8eec]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:39:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-efb14ea9-0479-4f2d-ad9a-19be4888fcc6 tempest-VolumesSnapshotListTestJSON-1328804210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9.5e8f89db-0f41-49ab-8b93-d1c78132f770 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:39:55 devstack sudo[97193]: pam_unix(sudo:session): session closed for user root
Jul 09 14:39:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-301e808e-6465-4849-8f22-fbc8886cea2b tempest-SnapshotsActionsTest-1933512236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.info" returned: 0 in 0.815s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:39:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-301e808e-6465-4849-8f22-fbc8886cea2b tempest-SnapshotsActionsTest-1933512236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.306s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:39:55 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-301e808e-6465-4849-8f22-fbc8886cea2b tempest-SnapshotsActionsTest-1933512236 None] Create snapshot completed successfully
Jul 09 14:39:55 devstack sudo[97202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9.5e8f89db-0f41-49ab-8b93-d1c78132f770
Jul 09 14:39:55 devstack sudo[97202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:39:56 devstack sudo[97202]: pam_unix(sudo:session): session closed for user root
Jul 09 14:39:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-efb14ea9-0479-4f2d-ad9a-19be4888fcc6 tempest-VolumesSnapshotListTestJSON-1328804210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9.5e8f89db-0f41-49ab-8b93-d1c78132f770" returned: 0 in 0.882s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:39:56 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-efb14ea9-0479-4f2d-ad9a-19be4888fcc6 tempest-VolumesSnapshotListTestJSON-1328804210 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3a9a842-3989-47a8-93b2-0050e3878aa9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 14:39:56 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[632010e9-ed39-479b-abc7-cb382a1fa004]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:39:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-efb14ea9-0479-4f2d-ad9a-19be4888fcc6 tempest-VolumesSnapshotListTestJSON-1328804210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:39:56 devstack sudo[97207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9
Jul 09 14:39:56 devstack sudo[97207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:39:56 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-3016c533-fedc-41fc-87e4-e38591b39f9b tempest-AbsoluteLimitsTests-957400663 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:39:56 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3016c533-fedc-41fc-87e4-e38591b39f9b tempest-AbsoluteLimitsTests-957400663 None] Flow 'volume_create_manager' (886602ba-8226-45c5-ad59-d2fe50138349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:39:56 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3016c533-fedc-41fc-87e4-e38591b39f9b tempest-AbsoluteLimitsTests-957400663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dac92f4d-da77-450b-a3ff-2669862f2903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:39:56 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3016c533-fedc-41fc-87e4-e38591b39f9b tempest-AbsoluteLimitsTests-957400663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dac92f4d-da77-450b-a3ff-2669862f2903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:39:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1372955156',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c62f3c0b-69cc-46d1-9a3b-da195727cb9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='467f739aa74b4212878aae83a157e338',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:39:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:39:57Z,use_quota=True,user_id='eb86085af4194d76a382ad40e311d922',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:39:56 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3016c533-fedc-41fc-87e4-e38591b39f9b tempest-AbsoluteLimitsTests-957400663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0557048c-1a19-4c01-8e43-639beb7e9dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:39:56 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3016c533-fedc-41fc-87e4-e38591b39f9b tempest-AbsoluteLimitsTests-957400663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0557048c-1a19-4c01-8e43-639beb7e9dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:39:56 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3016c533-fedc-41fc-87e4-e38591b39f9b tempest-AbsoluteLimitsTests-957400663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6f3705b-65a0-47dc-834a-2614dd8ccf43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:39:56 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3016c533-fedc-41fc-87e4-e38591b39f9b tempest-AbsoluteLimitsTests-957400663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6f3705b-65a0-47dc-834a-2614dd8ccf43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c62f3c0b-69cc-46d1-9a3b-da195727cb9d', 'volume_name': 'volume-c62f3c0b-69cc-46d1-9a3b-da195727cb9d', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:39:56 devstack sudo[97207]: pam_unix(sudo:session): session closed for user root
Jul 09 14:39:56 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3016c533-fedc-41fc-87e4-e38591b39f9b tempest-AbsoluteLimitsTests-957400663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffb82e78-e4c1-4db8-b002-14c74ac63cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:39:56 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3016c533-fedc-41fc-87e4-e38591b39f9b tempest-AbsoluteLimitsTests-957400663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffb82e78-e4c1-4db8-b002-14c74ac63cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:39:56 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3016c533-fedc-41fc-87e4-e38591b39f9b tempest-AbsoluteLimitsTests-957400663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14783c1c-9748-4c6b-8850-efe7229c587a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:39:56 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-3016c533-fedc-41fc-87e4-e38591b39f9b tempest-AbsoluteLimitsTests-957400663 None] Volume c62f3c0b-69cc-46d1-9a3b-da195727cb9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c62f3c0b-69cc-46d1-9a3b-da195727cb9d', 'volume_size': 1}
Jul 09 14:39:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3016c533-fedc-41fc-87e4-e38591b39f9b tempest-AbsoluteLimitsTests-957400663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:39:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3016c533-fedc-41fc-87e4-e38591b39f9b tempest-AbsoluteLimitsTests-957400663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:39:56 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3016c533-fedc-41fc-87e4-e38591b39f9b tempest-AbsoluteLimitsTests-957400663 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:39:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1372955156',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c62f3c0b-69cc-46d1-9a3b-da195727cb9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='467f739aa74b4212878aae83a157e338',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:39:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:39:57Z,use_quota=True,user_id='eb86085af4194d76a382ad40e311d922',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:39:56 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-3016c533-fedc-41fc-87e4-e38591b39f9b tempest-AbsoluteLimitsTests-957400663 None] Creating volume c62f3c0b-69cc-46d1-9a3b-da195727cb9d {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:39:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3016c533-fedc-41fc-87e4-e38591b39f9b tempest-AbsoluteLimitsTests-957400663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:39:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3016c533-fedc-41fc-87e4-e38591b39f9b tempest-AbsoluteLimitsTests-957400663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:39:57 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3016c533-fedc-41fc-87e4-e38591b39f9b tempest-AbsoluteLimitsTests-957400663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:39:57 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3016c533-fedc-41fc-87e4-e38591b39f9b tempest-AbsoluteLimitsTests-957400663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:39:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3016c533-fedc-41fc-87e4-e38591b39f9b tempest-AbsoluteLimitsTests-957400663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:39:57 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3016c533-fedc-41fc-87e4-e38591b39f9b tempest-AbsoluteLimitsTests-957400663 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:39:57 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-3016c533-fedc-41fc-87e4-e38591b39f9b tempest-AbsoluteLimitsTests-957400663 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:39:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3016c533-fedc-41fc-87e4-e38591b39f9b tempest-AbsoluteLimitsTests-957400663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-c62f3c0b-69cc-46d1-9a3b-da195727cb9d 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:39:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-efb14ea9-0479-4f2d-ad9a-19be4888fcc6 tempest-VolumesSnapshotListTestJSON-1328804210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9" returned: 0 in 0.978s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:39:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-efb14ea9-0479-4f2d-ad9a-19be4888fcc6 tempest-VolumesSnapshotListTestJSON-1328804210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9.5e8f89db-0f41-49ab-8b93-d1c78132f770 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:39:57 devstack sudo[97212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-c62f3c0b-69cc-46d1-9a3b-da195727cb9d 1073741824
Jul 09 14:39:57 devstack sudo[97212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:39:57 devstack sudo[97213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9.5e8f89db-0f41-49ab-8b93-d1c78132f770
Jul 09 14:39:57 devstack sudo[97213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:39:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1a979d1c-e135-4fb7-99d9-fa6bf7ffb27a tempest-SnapshotsActionsTest-1933512236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:39:57 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [req-6dec9166-bb9e-460f-8131-708e9baff4f1 req-e86ba98d-0131-4a42-b743-678b3168910a tempest-VolumesGetTestJSON-48046696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:39:57 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-6dec9166-bb9e-460f-8131-708e9baff4f1 req-e86ba98d-0131-4a42-b743-678b3168910a tempest-VolumesGetTestJSON-48046696 None] Flow 'volume_create_manager' (1ebcf3fd-e825-4840-965f-ae783fa2a19f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:39:57 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-6dec9166-bb9e-460f-8131-708e9baff4f1 req-e86ba98d-0131-4a42-b743-678b3168910a tempest-VolumesGetTestJSON-48046696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b4da9a1-b185-401c-b278-25394d08844b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:39:57 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-6dec9166-bb9e-460f-8131-708e9baff4f1 req-e86ba98d-0131-4a42-b743-678b3168910a tempest-VolumesGetTestJSON-48046696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b4da9a1-b185-401c-b278-25394d08844b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:39:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-18034638',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6aed256c-98ac-4f9e-a5c1-0fab1f694f42,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='eedd751deb534aa0a64a4ac4507bb117',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:39:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:39:57Z,use_quota=True,user_id='22260addfe624949b993b9460856e3d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:39:57 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-6dec9166-bb9e-460f-8131-708e9baff4f1 req-e86ba98d-0131-4a42-b743-678b3168910a tempest-VolumesGetTestJSON-48046696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5317eb4b-a1a0-4f9d-a327-f0ece2b97e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:39:57 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-6dec9166-bb9e-460f-8131-708e9baff4f1 req-e86ba98d-0131-4a42-b743-678b3168910a tempest-VolumesGetTestJSON-48046696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5317eb4b-a1a0-4f9d-a327-f0ece2b97e61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:39:57 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-6dec9166-bb9e-460f-8131-708e9baff4f1 req-e86ba98d-0131-4a42-b743-678b3168910a tempest-VolumesGetTestJSON-48046696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c179714a-fcd8-40b8-88a1-c575aa817e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:39:57 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-6dec9166-bb9e-460f-8131-708e9baff4f1 req-e86ba98d-0131-4a42-b743-678b3168910a tempest-VolumesGetTestJSON-48046696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c179714a-fcd8-40b8-88a1-c575aa817e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6aed256c-98ac-4f9e-a5c1-0fab1f694f42', 'volume_name': 'volume-6aed256c-98ac-4f9e-a5c1-0fab1f694f42', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:39:57 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-6dec9166-bb9e-460f-8131-708e9baff4f1 req-e86ba98d-0131-4a42-b743-678b3168910a tempest-VolumesGetTestJSON-48046696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e98472c-0735-4025-9bf3-38b9cae445be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:39:57 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-6dec9166-bb9e-460f-8131-708e9baff4f1 req-e86ba98d-0131-4a42-b743-678b3168910a tempest-VolumesGetTestJSON-48046696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e98472c-0735-4025-9bf3-38b9cae445be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:39:57 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-6dec9166-bb9e-460f-8131-708e9baff4f1 req-e86ba98d-0131-4a42-b743-678b3168910a tempest-VolumesGetTestJSON-48046696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (023e2881-deb8-434f-bf81-c2ad740015d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:39:57 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [req-6dec9166-bb9e-460f-8131-708e9baff4f1 req-e86ba98d-0131-4a42-b743-678b3168910a tempest-VolumesGetTestJSON-48046696 None] Volume 6aed256c-98ac-4f9e-a5c1-0fab1f694f42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6aed256c-98ac-4f9e-a5c1-0fab1f694f42', 'volume_size': 1}
Jul 09 14:39:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-6dec9166-bb9e-460f-8131-708e9baff4f1 req-e86ba98d-0131-4a42-b743-678b3168910a tempest-VolumesGetTestJSON-48046696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:39:57 devstack sudo[97213]: pam_unix(sudo:session): session closed for user root
Jul 09 14:39:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-efb14ea9-0479-4f2d-ad9a-19be4888fcc6 tempest-VolumesSnapshotListTestJSON-1328804210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9.5e8f89db-0f41-49ab-8b93-d1c78132f770" returned: 0 in 0.846s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:39:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-efb14ea9-0479-4f2d-ad9a-19be4888fcc6 tempest-VolumesSnapshotListTestJSON-1328804210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9.5e8f89db-0f41-49ab-8b93-d1c78132f770 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:39:57 devstack sudo[97223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9.5e8f89db-0f41-49ab-8b93-d1c78132f770
Jul 09 14:39:57 devstack sudo[97223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:39:57 devstack sudo[97212]: pam_unix(sudo:session): session closed for user root
Jul 09 14:39:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3016c533-fedc-41fc-87e4-e38591b39f9b tempest-AbsoluteLimitsTests-957400663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-c62f3c0b-69cc-46d1-9a3b-da195727cb9d 1073741824" returned: 0 in 0.916s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:39:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3016c533-fedc-41fc-87e4-e38591b39f9b tempest-AbsoluteLimitsTests-957400663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-c62f3c0b-69cc-46d1-9a3b-da195727cb9d {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:39:57 devstack sudo[97225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-c62f3c0b-69cc-46d1-9a3b-da195727cb9d
Jul 09 14:39:57 devstack sudo[97225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:39:58 devstack sudo[97223]: pam_unix(sudo:session): session closed for user root
Jul 09 14:39:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-efb14ea9-0479-4f2d-ad9a-19be4888fcc6 tempest-VolumesSnapshotListTestJSON-1328804210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9.5e8f89db-0f41-49ab-8b93-d1c78132f770" returned: 0 in 0.654s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:39:58 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-efb14ea9-0479-4f2d-ad9a-19be4888fcc6 tempest-VolumesSnapshotListTestJSON-1328804210 None] Lock "cinder-quobyte-5e8f89db-0f41-49ab-8b93-d1c78132f770" released by "_delete_snapshot" :: held 3.514s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:39:58 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-efb14ea9-0479-4f2d-ad9a-19be4888fcc6 tempest-VolumesSnapshotListTestJSON-1328804210 None] Lock "cinder-quobyte-a3a9a842-3989-47a8-93b2-0050e3878aa9" released by "delete_snapshot" :: held 3.545s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:39:58 devstack sudo[97225]: pam_unix(sudo:session): session closed for user root
Jul 09 14:39:58 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-efb14ea9-0479-4f2d-ad9a-19be4888fcc6 tempest-VolumesSnapshotListTestJSON-1328804210 None] Created reservations ['b3c539d4-2d37-4299-8b66-fe2da3cf7e25', 'd043ed86-0fa5-49a8-9e1c-80f2e41607ca', '1144cf70-b2de-4970-a335-00d2ea781ad6', '33298e94-97e4-4297-a2d5-80086cb38bb9'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:39:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3016c533-fedc-41fc-87e4-e38591b39f9b tempest-AbsoluteLimitsTests-957400663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-c62f3c0b-69cc-46d1-9a3b-da195727cb9d" returned: 0 in 0.680s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:39:58 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3016c533-fedc-41fc-87e4-e38591b39f9b tempest-AbsoluteLimitsTests-957400663 None] <== create_volume: return (1651ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:39:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3016c533-fedc-41fc-87e4-e38591b39f9b tempest-AbsoluteLimitsTests-957400663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.656s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:39:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1a979d1c-e135-4fb7-99d9-fa6bf7ffb27a tempest-SnapshotsActionsTest-1933512236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.299s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:39:58 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3016c533-fedc-41fc-87e4-e38591b39f9b tempest-AbsoluteLimitsTests-957400663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14783c1c-9748-4c6b-8850-efe7229c587a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c62f3c0b-69cc-46d1-9a3b-da195727cb9d', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:39:58 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3016c533-fedc-41fc-87e4-e38591b39f9b tempest-AbsoluteLimitsTests-957400663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd52756d-d75d-474a-b960-467d872d4d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:39:58 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-3016c533-fedc-41fc-87e4-e38591b39f9b tempest-AbsoluteLimitsTests-957400663 None] Volume volume-c62f3c0b-69cc-46d1-9a3b-da195727cb9d (c62f3c0b-69cc-46d1-9a3b-da195727cb9d): created successfully
Jul 09 14:39:58 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3016c533-fedc-41fc-87e4-e38591b39f9b tempest-AbsoluteLimitsTests-957400663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd52756d-d75d-474a-b960-467d872d4d42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:39:58 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3016c533-fedc-41fc-87e4-e38591b39f9b tempest-AbsoluteLimitsTests-957400663 None] Flow 'volume_create_manager' (886602ba-8226-45c5-ad59-d2fe50138349) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:39:58 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-1a979d1c-e135-4fb7-99d9-fa6bf7ffb27a tempest-SnapshotsActionsTest-1933512236 None] Creating offline snapshot bad2c851-9f1e-461c-a146-991f151990d0 of volume 29f428fb-5235-412a-98f9-1c121415ff54 {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 14:39:58 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-3016c533-fedc-41fc-87e4-e38591b39f9b tempest-AbsoluteLimitsTests-957400663 None] Created volume successfully.
Jul 09 14:39:58 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd57f3de-02bd-4ab8-8e63-9c6dda5adee9]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:39:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1a979d1c-e135-4fb7-99d9-fa6bf7ffb27a tempest-SnapshotsActionsTest-1933512236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.9e0132d1-de38-4d07-8bbd-6bcb1a634a01 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:39:58 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-efb14ea9-0479-4f2d-ad9a-19be4888fcc6 tempest-VolumesSnapshotListTestJSON-1328804210 None] Delete snapshot completed successfully.
Jul 09 14:39:58 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-efb14ea9-0479-4f2d-ad9a-19be4888fcc6 tempest-VolumesSnapshotListTestJSON-1328804210 None] Lock "cinder-5e8f89db-0f41-49ab-8b93-d1c78132f770-delete_snapshot" released by "delete_snapshot" :: held 3.840s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:39:58 devstack sudo[97230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.9e0132d1-de38-4d07-8bbd-6bcb1a634a01
Jul 09 14:39:58 devstack sudo[97230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:39:59 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a6f8e251-5319-4a47-ba2f-4179dc7c9333 tempest-AbsoluteLimitsTests-957400663 None] Acquiring lock "cinder-c62f3c0b-69cc-46d1-9a3b-da195727cb9d-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:39:59 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a6f8e251-5319-4a47-ba2f-4179dc7c9333 tempest-AbsoluteLimitsTests-957400663 None] Lock "cinder-c62f3c0b-69cc-46d1-9a3b-da195727cb9d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:39:59 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a6f8e251-5319-4a47-ba2f-4179dc7c9333 tempest-AbsoluteLimitsTests-957400663 None] Acquiring lock "cinder-quobyte-c62f3c0b-69cc-46d1-9a3b-da195727cb9d" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:39:59 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a6f8e251-5319-4a47-ba2f-4179dc7c9333 tempest-AbsoluteLimitsTests-957400663 None] Lock "cinder-quobyte-c62f3c0b-69cc-46d1-9a3b-da195727cb9d" acquired by "delete_volume" :: waited 0.015s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:39:59 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[09861bf5-3622-4c62-890a-ee1ec7b4b341]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:39:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a6f8e251-5319-4a47-ba2f-4179dc7c9333 tempest-AbsoluteLimitsTests-957400663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-c62f3c0b-69cc-46d1-9a3b-da195727cb9d {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:39:59 devstack sudo[97232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-c62f3c0b-69cc-46d1-9a3b-da195727cb9d
Jul 09 14:39:59 devstack sudo[97232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:39:59 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-307fa6a1-41e2-4829-9a95-406f28705212 tempest-VolumesSnapshotListTestJSON-1328804210 None] Acquiring lock "cinder-a3a9a842-3989-47a8-93b2-0050e3878aa9-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:39:59 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-307fa6a1-41e2-4829-9a95-406f28705212 tempest-VolumesSnapshotListTestJSON-1328804210 None] Lock "cinder-a3a9a842-3989-47a8-93b2-0050e3878aa9-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:39:59 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-307fa6a1-41e2-4829-9a95-406f28705212 tempest-VolumesSnapshotListTestJSON-1328804210 None] Acquiring lock "cinder-quobyte-a3a9a842-3989-47a8-93b2-0050e3878aa9" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:39:59 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-307fa6a1-41e2-4829-9a95-406f28705212 tempest-VolumesSnapshotListTestJSON-1328804210 None] Lock "cinder-quobyte-a3a9a842-3989-47a8-93b2-0050e3878aa9" acquired by "delete_volume" :: waited 0.026s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:39:59 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b6911a4-67a7-4ae9-9ce8-e1241f91588b]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:39:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-307fa6a1-41e2-4829-9a95-406f28705212 tempest-VolumesSnapshotListTestJSON-1328804210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:39:59 devstack sudo[97234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9
Jul 09 14:39:59 devstack sudo[97234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:39:59 devstack sudo[97230]: pam_unix(sudo:session): session closed for user root
Jul 09 14:39:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1a979d1c-e135-4fb7-99d9-fa6bf7ffb27a tempest-SnapshotsActionsTest-1933512236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.9e0132d1-de38-4d07-8bbd-6bcb1a634a01" returned: 0 in 0.858s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:39:59 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-1a979d1c-e135-4fb7-99d9-fa6bf7ffb27a tempest-SnapshotsActionsTest-1933512236 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29f428fb-5235-412a-98f9-1c121415ff54(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 14:39:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1a979d1c-e135-4fb7-99d9-fa6bf7ffb27a tempest-SnapshotsActionsTest-1933512236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.9e0132d1-de38-4d07-8bbd-6bcb1a634a01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.bad2c851-9f1e-461c-a146-991f151990d0 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:39:59 devstack sudo[97239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.9e0132d1-de38-4d07-8bbd-6bcb1a634a01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.bad2c851-9f1e-461c-a146-991f151990d0 1G
Jul 09 14:39:59 devstack sudo[97239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:39:59 devstack sudo[97232]: pam_unix(sudo:session): session closed for user root
Jul 09 14:39:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a6f8e251-5319-4a47-ba2f-4179dc7c9333 tempest-AbsoluteLimitsTests-957400663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-c62f3c0b-69cc-46d1-9a3b-da195727cb9d" returned: 0 in 0.847s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:39:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a6f8e251-5319-4a47-ba2f-4179dc7c9333 tempest-AbsoluteLimitsTests-957400663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-c62f3c0b-69cc-46d1-9a3b-da195727cb9d {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:39:59 devstack sudo[97244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-c62f3c0b-69cc-46d1-9a3b-da195727cb9d
Jul 09 14:39:59 devstack sudo[97244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:00 devstack sudo[97234]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-307fa6a1-41e2-4829-9a95-406f28705212 tempest-VolumesSnapshotListTestJSON-1328804210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9" returned: 0 in 0.797s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-307fa6a1-41e2-4829-9a95-406f28705212 tempest-VolumesSnapshotListTestJSON-1328804210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:00 devstack sudo[97252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9
Jul 09 14:40:00 devstack sudo[97252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:00 devstack sudo[97239]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1a979d1c-e135-4fb7-99d9-fa6bf7ffb27a tempest-SnapshotsActionsTest-1933512236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.9e0132d1-de38-4d07-8bbd-6bcb1a634a01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.bad2c851-9f1e-461c-a146-991f151990d0 1G" returned: 0 in 0.910s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1a979d1c-e135-4fb7-99d9-fa6bf7ffb27a tempest-SnapshotsActionsTest-1933512236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29f428fb-5235-412a-98f9-1c121415ff54.9e0132d1-de38-4d07-8bbd-6bcb1a634a01 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.bad2c851-9f1e-461c-a146-991f151990d0 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:00 devstack sudo[97257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29f428fb-5235-412a-98f9-1c121415ff54.9e0132d1-de38-4d07-8bbd-6bcb1a634a01 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.bad2c851-9f1e-461c-a146-991f151990d0
Jul 09 14:40:00 devstack sudo[97257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:00 devstack sudo[97244]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a6f8e251-5319-4a47-ba2f-4179dc7c9333 tempest-AbsoluteLimitsTests-957400663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-c62f3c0b-69cc-46d1-9a3b-da195727cb9d" returned: 0 in 0.739s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:00 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a6f8e251-5319-4a47-ba2f-4179dc7c9333 tempest-AbsoluteLimitsTests-957400663 None] Lock "cinder-quobyte-c62f3c0b-69cc-46d1-9a3b-da195727cb9d" released by "delete_volume" :: held 1.627s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:40:00 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-a6f8e251-5319-4a47-ba2f-4179dc7c9333 tempest-AbsoluteLimitsTests-957400663 None] Created reservations ['769c8c8b-ce4b-4f69-95d1-13e4229b4c67', '77c09d22-d831-47fe-aa95-363391b3101e', '9239a98a-d891-4bd6-ba26-ea37ed0b5b8d', '7068c6de-363d-4ca5-a48a-635fd66aaec2'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:40:00 devstack sudo[97252]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-307fa6a1-41e2-4829-9a95-406f28705212 tempest-VolumesSnapshotListTestJSON-1328804210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a3a9a842-3989-47a8-93b2-0050e3878aa9" returned: 0 in 0.711s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:00 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-307fa6a1-41e2-4829-9a95-406f28705212 tempest-VolumesSnapshotListTestJSON-1328804210 None] Lock "cinder-quobyte-a3a9a842-3989-47a8-93b2-0050e3878aa9" released by "delete_volume" :: held 1.591s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:40:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a6f8e251-5319-4a47-ba2f-4179dc7c9333 tempest-AbsoluteLimitsTests-957400663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:40:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a6f8e251-5319-4a47-ba2f-4179dc7c9333 tempest-AbsoluteLimitsTests-957400663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:40:01 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a6f8e251-5319-4a47-ba2f-4179dc7c9333 tempest-AbsoluteLimitsTests-957400663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:40:01 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a6f8e251-5319-4a47-ba2f-4179dc7c9333 tempest-AbsoluteLimitsTests-957400663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:40:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a6f8e251-5319-4a47-ba2f-4179dc7c9333 tempest-AbsoluteLimitsTests-957400663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:40:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a6f8e251-5319-4a47-ba2f-4179dc7c9333 tempest-AbsoluteLimitsTests-957400663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:01 devstack sudo[97260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:40:01 devstack sudo[97260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:01 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-307fa6a1-41e2-4829-9a95-406f28705212 tempest-VolumesSnapshotListTestJSON-1328804210 None] Created reservations ['e365b51f-29d3-473e-935c-b0c1e21cf2e8', 'cf6d1015-b748-4a51-a397-1f5f35577943', '60ec638d-284c-4df4-96e5-377bd00bdceb', '719115e8-c7ac-45aa-a7b8-a1d28122400d'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:40:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-307fa6a1-41e2-4829-9a95-406f28705212 tempest-VolumesSnapshotListTestJSON-1328804210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:40:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-307fa6a1-41e2-4829-9a95-406f28705212 tempest-VolumesSnapshotListTestJSON-1328804210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:40:01 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-307fa6a1-41e2-4829-9a95-406f28705212 tempest-VolumesSnapshotListTestJSON-1328804210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:40:01 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-307fa6a1-41e2-4829-9a95-406f28705212 tempest-VolumesSnapshotListTestJSON-1328804210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:40:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-307fa6a1-41e2-4829-9a95-406f28705212 tempest-VolumesSnapshotListTestJSON-1328804210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:40:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-307fa6a1-41e2-4829-9a95-406f28705212 tempest-VolumesSnapshotListTestJSON-1328804210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:01 devstack sudo[97262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:40:01 devstack sudo[97262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:01 devstack sudo[97257]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1a979d1c-e135-4fb7-99d9-fa6bf7ffb27a tempest-SnapshotsActionsTest-1933512236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29f428fb-5235-412a-98f9-1c121415ff54.9e0132d1-de38-4d07-8bbd-6bcb1a634a01 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.bad2c851-9f1e-461c-a146-991f151990d0" returned: 0 in 0.759s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:01 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-1a979d1c-e135-4fb7-99d9-fa6bf7ffb27a tempest-SnapshotsActionsTest-1933512236 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.bad2c851-9f1e-461c-a146-991f151990d0 is being set with open permissions: ugo+rw
Jul 09 14:40:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1a979d1c-e135-4fb7-99d9-fa6bf7ffb27a tempest-SnapshotsActionsTest-1933512236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.bad2c851-9f1e-461c-a146-991f151990d0 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:01 devstack sudo[97267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.bad2c851-9f1e-461c-a146-991f151990d0
Jul 09 14:40:01 devstack sudo[97267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:01 devstack sudo[97260]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a6f8e251-5319-4a47-ba2f-4179dc7c9333 tempest-AbsoluteLimitsTests-957400663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.797s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:01 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-a6f8e251-5319-4a47-ba2f-4179dc7c9333 tempest-AbsoluteLimitsTests-957400663 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:40:01 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-a6f8e251-5319-4a47-ba2f-4179dc7c9333 tempest-AbsoluteLimitsTests-957400663 None] Deleted volume successfully.
Jul 09 14:40:01 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a6f8e251-5319-4a47-ba2f-4179dc7c9333 tempest-AbsoluteLimitsTests-957400663 None] Lock "cinder-c62f3c0b-69cc-46d1-9a3b-da195727cb9d-delete_volume" released by "delete_volume" :: held 2.828s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:40:02 devstack sudo[97262]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-307fa6a1-41e2-4829-9a95-406f28705212 tempest-VolumesSnapshotListTestJSON-1328804210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.921s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:02 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-307fa6a1-41e2-4829-9a95-406f28705212 tempest-VolumesSnapshotListTestJSON-1328804210 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:40:02 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-307fa6a1-41e2-4829-9a95-406f28705212 tempest-VolumesSnapshotListTestJSON-1328804210 None] Deleted volume successfully.
Jul 09 14:40:02 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-307fa6a1-41e2-4829-9a95-406f28705212 tempest-VolumesSnapshotListTestJSON-1328804210 None] Lock "cinder-a3a9a842-3989-47a8-93b2-0050e3878aa9-delete_volume" released by "delete_volume" :: held 2.767s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:40:02 devstack sudo[97267]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1a979d1c-e135-4fb7-99d9-fa6bf7ffb27a tempest-SnapshotsActionsTest-1933512236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.bad2c851-9f1e-461c-a146-991f151990d0" returned: 0 in 0.800s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1a979d1c-e135-4fb7-99d9-fa6bf7ffb27a tempest-SnapshotsActionsTest-1933512236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.538s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:40:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-6dec9166-bb9e-460f-8131-708e9baff4f1 req-e86ba98d-0131-4a42-b743-678b3168910a tempest-VolumesGetTestJSON-48046696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.757s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:40:02 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [req-6dec9166-bb9e-460f-8131-708e9baff4f1 req-e86ba98d-0131-4a42-b743-678b3168910a tempest-VolumesGetTestJSON-48046696 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:39:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-18034638',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6aed256c-98ac-4f9e-a5c1-0fab1f694f42,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='eedd751deb534aa0a64a4ac4507bb117',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:39:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:39:57Z,use_quota=True,user_id='22260addfe624949b993b9460856e3d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:40:02 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [req-6dec9166-bb9e-460f-8131-708e9baff4f1 req-e86ba98d-0131-4a42-b743-678b3168910a tempest-VolumesGetTestJSON-48046696 None] Creating volume 6aed256c-98ac-4f9e-a5c1-0fab1f694f42 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:40:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-6dec9166-bb9e-460f-8131-708e9baff4f1 req-e86ba98d-0131-4a42-b743-678b3168910a tempest-VolumesGetTestJSON-48046696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:40:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-6dec9166-bb9e-460f-8131-708e9baff4f1 req-e86ba98d-0131-4a42-b743-678b3168910a tempest-VolumesGetTestJSON-48046696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:40:02 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [req-6dec9166-bb9e-460f-8131-708e9baff4f1 req-e86ba98d-0131-4a42-b743-678b3168910a tempest-VolumesGetTestJSON-48046696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:40:02 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [req-6dec9166-bb9e-460f-8131-708e9baff4f1 req-e86ba98d-0131-4a42-b743-678b3168910a tempest-VolumesGetTestJSON-48046696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:40:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-6dec9166-bb9e-460f-8131-708e9baff4f1 req-e86ba98d-0131-4a42-b743-678b3168910a tempest-VolumesGetTestJSON-48046696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:40:02 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [req-6dec9166-bb9e-460f-8131-708e9baff4f1 req-e86ba98d-0131-4a42-b743-678b3168910a tempest-VolumesGetTestJSON-48046696 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:40:02 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [req-6dec9166-bb9e-460f-8131-708e9baff4f1 req-e86ba98d-0131-4a42-b743-678b3168910a tempest-VolumesGetTestJSON-48046696 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:40:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-6dec9166-bb9e-460f-8131-708e9baff4f1 req-e86ba98d-0131-4a42-b743-678b3168910a tempest-VolumesGetTestJSON-48046696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-6aed256c-98ac-4f9e-a5c1-0fab1f694f42 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:02 devstack sudo[97272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-6aed256c-98ac-4f9e-a5c1-0fab1f694f42 1073741824
Jul 09 14:40:02 devstack sudo[97272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:02 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-1a979d1c-e135-4fb7-99d9-fa6bf7ffb27a tempest-SnapshotsActionsTest-1933512236 None] Create snapshot completed successfully
Jul 09 14:40:02 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-125c1203-5cd2-40ef-8327-e1347a4088b2 tempest-SnapshotsActionsTest-983213510 None] Acquiring lock "cinder-bad2c851-9f1e-461c-a146-991f151990d0-delete_snapshot" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:40:02 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-125c1203-5cd2-40ef-8327-e1347a4088b2 tempest-SnapshotsActionsTest-983213510 None] Lock "cinder-bad2c851-9f1e-461c-a146-991f151990d0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:40:02 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-125c1203-5cd2-40ef-8327-e1347a4088b2 tempest-SnapshotsActionsTest-983213510 None] Acquiring lock "cinder-quobyte-29f428fb-5235-412a-98f9-1c121415ff54" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:40:02 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-125c1203-5cd2-40ef-8327-e1347a4088b2 tempest-SnapshotsActionsTest-983213510 None] Lock "cinder-quobyte-29f428fb-5235-412a-98f9-1c121415ff54" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:40:02 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-125c1203-5cd2-40ef-8327-e1347a4088b2 tempest-SnapshotsActionsTest-983213510 None] Acquiring lock "cinder-quobyte-bad2c851-9f1e-461c-a146-991f151990d0" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:40:02 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-125c1203-5cd2-40ef-8327-e1347a4088b2 tempest-SnapshotsActionsTest-983213510 None] Lock "cinder-quobyte-bad2c851-9f1e-461c-a146-991f151990d0" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:40:02 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-125c1203-5cd2-40ef-8327-e1347a4088b2 tempest-SnapshotsActionsTest-983213510 None] Deleting offline snapshot bad2c851-9f1e-461c-a146-991f151990d0 of volume 29f428fb-5235-412a-98f9-1c121415ff54 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 14:40:02 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-125c1203-5cd2-40ef-8327-e1347a4088b2 tempest-SnapshotsActionsTest-983213510 None] snapshot_file for this snap is: volume-29f428fb-5235-412a-98f9-1c121415ff54.bad2c851-9f1e-461c-a146-991f151990d0 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 14:40:02 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[d099d2b7-bf15-44e3-9e77-ec6c633e212f]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:40:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-125c1203-5cd2-40ef-8327-e1347a4088b2 tempest-SnapshotsActionsTest-983213510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.bad2c851-9f1e-461c-a146-991f151990d0 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:02 devstack sudo[97274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.bad2c851-9f1e-461c-a146-991f151990d0
Jul 09 14:40:02 devstack sudo[97274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:03 devstack sudo[97272]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-6dec9166-bb9e-460f-8131-708e9baff4f1 req-e86ba98d-0131-4a42-b743-678b3168910a tempest-VolumesGetTestJSON-48046696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-6aed256c-98ac-4f9e-a5c1-0fab1f694f42 1073741824" returned: 0 in 1.121s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-6dec9166-bb9e-460f-8131-708e9baff4f1 req-e86ba98d-0131-4a42-b743-678b3168910a tempest-VolumesGetTestJSON-48046696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-6aed256c-98ac-4f9e-a5c1-0fab1f694f42 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:03 devstack sudo[97280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-6aed256c-98ac-4f9e-a5c1-0fab1f694f42
Jul 09 14:40:03 devstack sudo[97280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:03 devstack sudo[97274]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-125c1203-5cd2-40ef-8327-e1347a4088b2 tempest-SnapshotsActionsTest-983213510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.bad2c851-9f1e-461c-a146-991f151990d0" returned: 0 in 0.952s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:03 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-125c1203-5cd2-40ef-8327-e1347a4088b2 tempest-SnapshotsActionsTest-983213510 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29f428fb-5235-412a-98f9-1c121415ff54(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 14:40:03 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8b15a8c-2c6a-4fbd-bd00-6149f8a37e2d]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:40:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-125c1203-5cd2-40ef-8327-e1347a4088b2 tempest-SnapshotsActionsTest-983213510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.9e0132d1-de38-4d07-8bbd-6bcb1a634a01 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:03 devstack sudo[97285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.9e0132d1-de38-4d07-8bbd-6bcb1a634a01
Jul 09 14:40:03 devstack sudo[97285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:04 devstack sudo[97280]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-6dec9166-bb9e-460f-8131-708e9baff4f1 req-e86ba98d-0131-4a42-b743-678b3168910a tempest-VolumesGetTestJSON-48046696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-6aed256c-98ac-4f9e-a5c1-0fab1f694f42" returned: 0 in 0.782s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:04 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [req-6dec9166-bb9e-460f-8131-708e9baff4f1 req-e86ba98d-0131-4a42-b743-678b3168910a tempest-VolumesGetTestJSON-48046696 None] <== create_volume: return (1963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:40:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-6dec9166-bb9e-460f-8131-708e9baff4f1 req-e86ba98d-0131-4a42-b743-678b3168910a tempest-VolumesGetTestJSON-48046696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.968s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:40:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-6dec9166-bb9e-460f-8131-708e9baff4f1 req-e86ba98d-0131-4a42-b743-678b3168910a tempest-VolumesGetTestJSON-48046696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (023e2881-deb8-434f-bf81-c2ad740015d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6aed256c-98ac-4f9e-a5c1-0fab1f694f42', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:40:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-6dec9166-bb9e-460f-8131-708e9baff4f1 req-e86ba98d-0131-4a42-b743-678b3168910a tempest-VolumesGetTestJSON-48046696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3c0e2db-977c-4f4b-b565-4cf75a519892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:40:04 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [req-6dec9166-bb9e-460f-8131-708e9baff4f1 req-e86ba98d-0131-4a42-b743-678b3168910a tempest-VolumesGetTestJSON-48046696 None] Volume volume-6aed256c-98ac-4f9e-a5c1-0fab1f694f42 (6aed256c-98ac-4f9e-a5c1-0fab1f694f42): created successfully
Jul 09 14:40:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-6dec9166-bb9e-460f-8131-708e9baff4f1 req-e86ba98d-0131-4a42-b743-678b3168910a tempest-VolumesGetTestJSON-48046696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3c0e2db-977c-4f4b-b565-4cf75a519892) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:40:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-6dec9166-bb9e-460f-8131-708e9baff4f1 req-e86ba98d-0131-4a42-b743-678b3168910a tempest-VolumesGetTestJSON-48046696 None] Flow 'volume_create_manager' (1ebcf3fd-e825-4840-965f-ae783fa2a19f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:40:04 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-6dec9166-bb9e-460f-8131-708e9baff4f1 req-e86ba98d-0131-4a42-b743-678b3168910a tempest-VolumesGetTestJSON-48046696 None] Created volume successfully.
Jul 09 14:40:04 devstack sudo[97285]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-125c1203-5cd2-40ef-8327-e1347a4088b2 tempest-SnapshotsActionsTest-983213510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.9e0132d1-de38-4d07-8bbd-6bcb1a634a01" returned: 0 in 0.961s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:04 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-125c1203-5cd2-40ef-8327-e1347a4088b2 tempest-SnapshotsActionsTest-983213510 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29f428fb-5235-412a-98f9-1c121415ff54(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 14:40:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-125c1203-5cd2-40ef-8327-e1347a4088b2 tempest-SnapshotsActionsTest-983213510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.bad2c851-9f1e-461c-a146-991f151990d0 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:04 devstack sudo[97291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.bad2c851-9f1e-461c-a146-991f151990d0
Jul 09 14:40:04 devstack sudo[97291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:05 devstack cinder-volume[87230]: DEBUG cinder.coordination [req-c51a9026-25cd-4946-b7ff-be5e236a0292 req-366a39ce-9353-491e-a757-cd52fea729ac tempest-VolumesGetTestJSON-48046696 None] Acquiring lock "cinder-6aed256c-98ac-4f9e-a5c1-0fab1f694f42-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:40:05 devstack cinder-volume[87230]: DEBUG cinder.coordination [req-c51a9026-25cd-4946-b7ff-be5e236a0292 req-366a39ce-9353-491e-a757-cd52fea729ac tempest-VolumesGetTestJSON-48046696 None] Lock "cinder-6aed256c-98ac-4f9e-a5c1-0fab1f694f42-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:40:05 devstack cinder-volume[87230]: DEBUG cinder.coordination [req-c51a9026-25cd-4946-b7ff-be5e236a0292 req-366a39ce-9353-491e-a757-cd52fea729ac tempest-VolumesGetTestJSON-48046696 None] Acquiring lock "cinder-quobyte-6aed256c-98ac-4f9e-a5c1-0fab1f694f42" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:40:05 devstack cinder-volume[87230]: DEBUG cinder.coordination [req-c51a9026-25cd-4946-b7ff-be5e236a0292 req-366a39ce-9353-491e-a757-cd52fea729ac tempest-VolumesGetTestJSON-48046696 None] Lock "cinder-quobyte-6aed256c-98ac-4f9e-a5c1-0fab1f694f42" acquired by "delete_volume" :: waited 0.022s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:40:05 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[11644295-a0ba-4680-b7c3-b0942141adde]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:40:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-c51a9026-25cd-4946-b7ff-be5e236a0292 req-366a39ce-9353-491e-a757-cd52fea729ac tempest-VolumesGetTestJSON-48046696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-6aed256c-98ac-4f9e-a5c1-0fab1f694f42 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:05 devstack sudo[97291]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-125c1203-5cd2-40ef-8327-e1347a4088b2 tempest-SnapshotsActionsTest-983213510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.bad2c851-9f1e-461c-a146-991f151990d0" returned: 0 in 1.128s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-125c1203-5cd2-40ef-8327-e1347a4088b2 tempest-SnapshotsActionsTest-983213510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.bad2c851-9f1e-461c-a146-991f151990d0 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:05 devstack sudo[97298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.bad2c851-9f1e-461c-a146-991f151990d0
Jul 09 14:40:05 devstack sudo[97298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:05 devstack sudo[97297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-6aed256c-98ac-4f9e-a5c1-0fab1f694f42
Jul 09 14:40:05 devstack sudo[97297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:06 devstack sudo[97298]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-125c1203-5cd2-40ef-8327-e1347a4088b2 tempest-SnapshotsActionsTest-983213510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.bad2c851-9f1e-461c-a146-991f151990d0" returned: 0 in 0.852s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:06 devstack sudo[97297]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:06 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-125c1203-5cd2-40ef-8327-e1347a4088b2 tempest-SnapshotsActionsTest-983213510 None] Lock "cinder-quobyte-bad2c851-9f1e-461c-a146-991f151990d0" released by "_delete_snapshot" :: held 4.032s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:40:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-c51a9026-25cd-4946-b7ff-be5e236a0292 req-366a39ce-9353-491e-a757-cd52fea729ac tempest-VolumesGetTestJSON-48046696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-6aed256c-98ac-4f9e-a5c1-0fab1f694f42" returned: 0 in 0.984s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-c51a9026-25cd-4946-b7ff-be5e236a0292 req-366a39ce-9353-491e-a757-cd52fea729ac tempest-VolumesGetTestJSON-48046696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-6aed256c-98ac-4f9e-a5c1-0fab1f694f42 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:06 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-125c1203-5cd2-40ef-8327-e1347a4088b2 tempest-SnapshotsActionsTest-983213510 None] Lock "cinder-quobyte-29f428fb-5235-412a-98f9-1c121415ff54" released by "delete_snapshot" :: held 4.085s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:40:06 devstack sudo[97305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-6aed256c-98ac-4f9e-a5c1-0fab1f694f42
Jul 09 14:40:06 devstack sudo[97305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:06 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-125c1203-5cd2-40ef-8327-e1347a4088b2 tempest-SnapshotsActionsTest-983213510 None] Created reservations ['bd409a7c-2eae-464c-a6b0-c4faed0e5c9c', '30ae2927-b56e-427f-94ba-1ff11ac89b37', 'a358d9cf-71a8-4090-920a-747c8fc4f0b7', '4eb5955c-83f0-4b8e-a89c-a49a26718522'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:40:06 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-125c1203-5cd2-40ef-8327-e1347a4088b2 tempest-SnapshotsActionsTest-983213510 None] Delete snapshot completed successfully.
Jul 09 14:40:06 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-125c1203-5cd2-40ef-8327-e1347a4088b2 tempest-SnapshotsActionsTest-983213510 None] Lock "cinder-bad2c851-9f1e-461c-a146-991f151990d0-delete_snapshot" released by "delete_snapshot" :: held 4.334s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:40:07 devstack sudo[97305]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-c51a9026-25cd-4946-b7ff-be5e236a0292 req-366a39ce-9353-491e-a757-cd52fea729ac tempest-VolumesGetTestJSON-48046696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-6aed256c-98ac-4f9e-a5c1-0fab1f694f42" returned: 0 in 0.762s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:07 devstack cinder-volume[87230]: DEBUG cinder.coordination [req-c51a9026-25cd-4946-b7ff-be5e236a0292 req-366a39ce-9353-491e-a757-cd52fea729ac tempest-VolumesGetTestJSON-48046696 None] Lock "cinder-quobyte-6aed256c-98ac-4f9e-a5c1-0fab1f694f42" released by "delete_volume" :: held 1.824s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:40:07 devstack cinder-volume[87230]: DEBUG cinder.quota [req-c51a9026-25cd-4946-b7ff-be5e236a0292 req-366a39ce-9353-491e-a757-cd52fea729ac tempest-VolumesGetTestJSON-48046696 None] Created reservations ['e260ed65-d59f-4a79-97a2-1a863b3c7fb2', '7039b55a-3c3b-4d7b-8910-6c21ad0e4704', '29b0506f-f372-4ccb-be6e-efd53a66c1b7', '02794a9f-e3b7-427a-a8f2-2d2b7180cb0b'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:40:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-c51a9026-25cd-4946-b7ff-be5e236a0292 req-366a39ce-9353-491e-a757-cd52fea729ac tempest-VolumesGetTestJSON-48046696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:40:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-c51a9026-25cd-4946-b7ff-be5e236a0292 req-366a39ce-9353-491e-a757-cd52fea729ac tempest-VolumesGetTestJSON-48046696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:40:07 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [req-c51a9026-25cd-4946-b7ff-be5e236a0292 req-366a39ce-9353-491e-a757-cd52fea729ac tempest-VolumesGetTestJSON-48046696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:40:07 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [req-c51a9026-25cd-4946-b7ff-be5e236a0292 req-366a39ce-9353-491e-a757-cd52fea729ac tempest-VolumesGetTestJSON-48046696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:40:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-c51a9026-25cd-4946-b7ff-be5e236a0292 req-366a39ce-9353-491e-a757-cd52fea729ac tempest-VolumesGetTestJSON-48046696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:40:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-c51a9026-25cd-4946-b7ff-be5e236a0292 req-366a39ce-9353-491e-a757-cd52fea729ac tempest-VolumesGetTestJSON-48046696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:07 devstack sudo[97308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:40:07 devstack sudo[97308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:08 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-695f4e49-e371-413d-b372-15599f99d7a0 tempest-VolumesTransfersV357Test-1798633478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:40:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-695f4e49-e371-413d-b372-15599f99d7a0 tempest-VolumesTransfersV357Test-1798633478 None] Flow 'volume_create_manager' (c697d8d1-73f8-4750-bdad-462e7157bb8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:40:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-695f4e49-e371-413d-b372-15599f99d7a0 tempest-VolumesTransfersV357Test-1798633478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (332f6ad7-66e8-4f58-aad1-ee70762b6fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:40:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-695f4e49-e371-413d-b372-15599f99d7a0 tempest-VolumesTransfersV357Test-1798633478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (332f6ad7-66e8-4f58-aad1-ee70762b6fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:40:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1560539770',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc3190cc-60b3-4260-b0ae-cac7cf210bae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c69ddbe92dc425986e2175000117da1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:40:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:40:08Z,use_quota=True,user_id='24e8461f3bb443e9ac2431e44589bb4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:40:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-695f4e49-e371-413d-b372-15599f99d7a0 tempest-VolumesTransfersV357Test-1798633478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57f7a5f5-5ac4-4532-be00-dc18054ddbaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:40:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-695f4e49-e371-413d-b372-15599f99d7a0 tempest-VolumesTransfersV357Test-1798633478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57f7a5f5-5ac4-4532-be00-dc18054ddbaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:40:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-695f4e49-e371-413d-b372-15599f99d7a0 tempest-VolumesTransfersV357Test-1798633478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c501d63e-7b7c-48dd-a70c-8d29af03cb9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:40:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-695f4e49-e371-413d-b372-15599f99d7a0 tempest-VolumesTransfersV357Test-1798633478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c501d63e-7b7c-48dd-a70c-8d29af03cb9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc3190cc-60b3-4260-b0ae-cac7cf210bae', 'volume_name': 'volume-fc3190cc-60b3-4260-b0ae-cac7cf210bae', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:40:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-695f4e49-e371-413d-b372-15599f99d7a0 tempest-VolumesTransfersV357Test-1798633478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (004d9e11-a2af-4b85-9fc3-a044e8e3716c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:40:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-695f4e49-e371-413d-b372-15599f99d7a0 tempest-VolumesTransfersV357Test-1798633478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (004d9e11-a2af-4b85-9fc3-a044e8e3716c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:40:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-695f4e49-e371-413d-b372-15599f99d7a0 tempest-VolumesTransfersV357Test-1798633478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aad66527-5fa4-4d20-821f-9f3ef2f9242c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:40:08 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-695f4e49-e371-413d-b372-15599f99d7a0 tempest-VolumesTransfersV357Test-1798633478 None] Volume fc3190cc-60b3-4260-b0ae-cac7cf210bae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc3190cc-60b3-4260-b0ae-cac7cf210bae', 'volume_size': 1}
Jul 09 14:40:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-695f4e49-e371-413d-b372-15599f99d7a0 tempest-VolumesTransfersV357Test-1798633478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:40:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-695f4e49-e371-413d-b372-15599f99d7a0 tempest-VolumesTransfersV357Test-1798633478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:40:08 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-695f4e49-e371-413d-b372-15599f99d7a0 tempest-VolumesTransfersV357Test-1798633478 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:40:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1560539770',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc3190cc-60b3-4260-b0ae-cac7cf210bae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c69ddbe92dc425986e2175000117da1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:40:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:40:08Z,use_quota=True,user_id='24e8461f3bb443e9ac2431e44589bb4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:40:08 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-695f4e49-e371-413d-b372-15599f99d7a0 tempest-VolumesTransfersV357Test-1798633478 None] Creating volume fc3190cc-60b3-4260-b0ae-cac7cf210bae {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:40:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-695f4e49-e371-413d-b372-15599f99d7a0 tempest-VolumesTransfersV357Test-1798633478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:40:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-695f4e49-e371-413d-b372-15599f99d7a0 tempest-VolumesTransfersV357Test-1798633478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:40:08 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-695f4e49-e371-413d-b372-15599f99d7a0 tempest-VolumesTransfersV357Test-1798633478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:40:08 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-695f4e49-e371-413d-b372-15599f99d7a0 tempest-VolumesTransfersV357Test-1798633478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:40:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-695f4e49-e371-413d-b372-15599f99d7a0 tempest-VolumesTransfersV357Test-1798633478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:40:08 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-695f4e49-e371-413d-b372-15599f99d7a0 tempest-VolumesTransfersV357Test-1798633478 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:40:08 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-695f4e49-e371-413d-b372-15599f99d7a0 tempest-VolumesTransfersV357Test-1798633478 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:40:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-695f4e49-e371-413d-b372-15599f99d7a0 tempest-VolumesTransfersV357Test-1798633478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-fc3190cc-60b3-4260-b0ae-cac7cf210bae 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:08 devstack sudo[97311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-fc3190cc-60b3-4260-b0ae-cac7cf210bae 1073741824
Jul 09 14:40:08 devstack sudo[97311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-51c697e8-85ee-46b1-89b8-9ef6ba505f6f tempest-SnapshotsActionsTest-1933512236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:40:08 devstack sudo[97308]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-c51a9026-25cd-4946-b7ff-be5e236a0292 req-366a39ce-9353-491e-a757-cd52fea729ac tempest-VolumesGetTestJSON-48046696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.995s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:08 devstack cinder-volume[87230]: DEBUG cinder.manager [req-c51a9026-25cd-4946-b7ff-be5e236a0292 req-366a39ce-9353-491e-a757-cd52fea729ac tempest-VolumesGetTestJSON-48046696 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:40:08 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-c51a9026-25cd-4946-b7ff-be5e236a0292 req-366a39ce-9353-491e-a757-cd52fea729ac tempest-VolumesGetTestJSON-48046696 None] Deleted volume successfully.
Jul 09 14:40:08 devstack cinder-volume[87230]: DEBUG cinder.coordination [req-c51a9026-25cd-4946-b7ff-be5e236a0292 req-366a39ce-9353-491e-a757-cd52fea729ac tempest-VolumesGetTestJSON-48046696 None] Lock "cinder-6aed256c-98ac-4f9e-a5c1-0fab1f694f42-delete_volume" released by "delete_volume" :: held 3.081s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:40:09 devstack sudo[97311]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-695f4e49-e371-413d-b372-15599f99d7a0 tempest-VolumesTransfersV357Test-1798633478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-fc3190cc-60b3-4260-b0ae-cac7cf210bae 1073741824" returned: 0 in 0.952s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-695f4e49-e371-413d-b372-15599f99d7a0 tempest-VolumesTransfersV357Test-1798633478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-fc3190cc-60b3-4260-b0ae-cac7cf210bae {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:09 devstack sudo[97319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-fc3190cc-60b3-4260-b0ae-cac7cf210bae
Jul 09 14:40:09 devstack sudo[97319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:10 devstack sudo[97319]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-695f4e49-e371-413d-b372-15599f99d7a0 tempest-VolumesTransfersV357Test-1798633478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-fc3190cc-60b3-4260-b0ae-cac7cf210bae" returned: 0 in 0.813s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:10 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-695f4e49-e371-413d-b372-15599f99d7a0 tempest-VolumesTransfersV357Test-1798633478 None] <== create_volume: return (1830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:40:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-695f4e49-e371-413d-b372-15599f99d7a0 tempest-VolumesTransfersV357Test-1798633478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.834s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:40:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-51c697e8-85ee-46b1-89b8-9ef6ba505f6f tempest-SnapshotsActionsTest-1933512236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.631s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:40:10 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-51c697e8-85ee-46b1-89b8-9ef6ba505f6f tempest-SnapshotsActionsTest-1933512236 None] Creating offline snapshot ab434943-f094-45ff-af98-b995fab57d31 of volume 29f428fb-5235-412a-98f9-1c121415ff54 {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 14:40:10 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-695f4e49-e371-413d-b372-15599f99d7a0 tempest-VolumesTransfersV357Test-1798633478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aad66527-5fa4-4d20-821f-9f3ef2f9242c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc3190cc-60b3-4260-b0ae-cac7cf210bae', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:40:10 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-695f4e49-e371-413d-b372-15599f99d7a0 tempest-VolumesTransfersV357Test-1798633478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a9f3c33-a5bd-4c9e-9c8f-2155316cb314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:40:10 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba7dd0a-f59f-479a-8759-856e8eed46d2]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:40:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-51c697e8-85ee-46b1-89b8-9ef6ba505f6f tempest-SnapshotsActionsTest-1933512236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.9e0132d1-de38-4d07-8bbd-6bcb1a634a01 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:10 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-695f4e49-e371-413d-b372-15599f99d7a0 tempest-VolumesTransfersV357Test-1798633478 None] Volume volume-fc3190cc-60b3-4260-b0ae-cac7cf210bae (fc3190cc-60b3-4260-b0ae-cac7cf210bae): created successfully
Jul 09 14:40:10 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-695f4e49-e371-413d-b372-15599f99d7a0 tempest-VolumesTransfersV357Test-1798633478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a9f3c33-a5bd-4c9e-9c8f-2155316cb314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:40:10 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-695f4e49-e371-413d-b372-15599f99d7a0 tempest-VolumesTransfersV357Test-1798633478 None] Flow 'volume_create_manager' (c697d8d1-73f8-4750-bdad-462e7157bb8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:40:10 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-695f4e49-e371-413d-b372-15599f99d7a0 tempest-VolumesTransfersV357Test-1798633478 None] Created volume successfully.
Jul 09 14:40:10 devstack sudo[97323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.9e0132d1-de38-4d07-8bbd-6bcb1a634a01
Jul 09 14:40:10 devstack sudo[97323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:11 devstack sudo[97323]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-51c697e8-85ee-46b1-89b8-9ef6ba505f6f tempest-SnapshotsActionsTest-1933512236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.9e0132d1-de38-4d07-8bbd-6bcb1a634a01" returned: 0 in 0.918s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:11 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-51c697e8-85ee-46b1-89b8-9ef6ba505f6f tempest-SnapshotsActionsTest-1933512236 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29f428fb-5235-412a-98f9-1c121415ff54(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 14:40:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-51c697e8-85ee-46b1-89b8-9ef6ba505f6f tempest-SnapshotsActionsTest-1933512236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.9e0132d1-de38-4d07-8bbd-6bcb1a634a01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.ab434943-f094-45ff-af98-b995fab57d31 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:11 devstack sudo[97330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.9e0132d1-de38-4d07-8bbd-6bcb1a634a01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.ab434943-f094-45ff-af98-b995fab57d31 1G
Jul 09 14:40:11 devstack sudo[97330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:12 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-89a17da0-e67a-4ca2-9c5d-3047d12a667c tempest-VolumesTransfersV357Test-139975308 None] Transfer volume completed successfully.
Jul 09 14:40:12 devstack sudo[97330]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-51c697e8-85ee-46b1-89b8-9ef6ba505f6f tempest-SnapshotsActionsTest-1933512236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.9e0132d1-de38-4d07-8bbd-6bcb1a634a01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.ab434943-f094-45ff-af98-b995fab57d31 1G" returned: 0 in 1.371s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-51c697e8-85ee-46b1-89b8-9ef6ba505f6f tempest-SnapshotsActionsTest-1933512236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29f428fb-5235-412a-98f9-1c121415ff54.9e0132d1-de38-4d07-8bbd-6bcb1a634a01 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.ab434943-f094-45ff-af98-b995fab57d31 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:12 devstack sudo[97336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29f428fb-5235-412a-98f9-1c121415ff54.9e0132d1-de38-4d07-8bbd-6bcb1a634a01 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.ab434943-f094-45ff-af98-b995fab57d31
Jul 09 14:40:12 devstack sudo[97336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:13 devstack sudo[97336]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-51c697e8-85ee-46b1-89b8-9ef6ba505f6f tempest-SnapshotsActionsTest-1933512236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29f428fb-5235-412a-98f9-1c121415ff54.9e0132d1-de38-4d07-8bbd-6bcb1a634a01 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.ab434943-f094-45ff-af98-b995fab57d31" returned: 0 in 1.087s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:13 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-51c697e8-85ee-46b1-89b8-9ef6ba505f6f tempest-SnapshotsActionsTest-1933512236 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.ab434943-f094-45ff-af98-b995fab57d31 is being set with open permissions: ugo+rw
Jul 09 14:40:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-51c697e8-85ee-46b1-89b8-9ef6ba505f6f tempest-SnapshotsActionsTest-1933512236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.ab434943-f094-45ff-af98-b995fab57d31 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:13 devstack sudo[97341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.ab434943-f094-45ff-af98-b995fab57d31
Jul 09 14:40:13 devstack sudo[97341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:13 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3af7d30a-b865-4815-914d-08b46c06e967 tempest-VolumesTransfersV357Test-1885242030 None] Acquiring lock "cinder-fc3190cc-60b3-4260-b0ae-cac7cf210bae-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:40:14 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3af7d30a-b865-4815-914d-08b46c06e967 tempest-VolumesTransfersV357Test-1885242030 None] Lock "cinder-fc3190cc-60b3-4260-b0ae-cac7cf210bae-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:40:14 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3af7d30a-b865-4815-914d-08b46c06e967 tempest-VolumesTransfersV357Test-1885242030 None] Acquiring lock "cinder-quobyte-fc3190cc-60b3-4260-b0ae-cac7cf210bae" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:40:14 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3af7d30a-b865-4815-914d-08b46c06e967 tempest-VolumesTransfersV357Test-1885242030 None] Lock "cinder-quobyte-fc3190cc-60b3-4260-b0ae-cac7cf210bae" acquired by "delete_volume" :: waited 0.034s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:40:14 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b556c1-4b8c-4a3e-9867-ea256838748b]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:40:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3af7d30a-b865-4815-914d-08b46c06e967 tempest-VolumesTransfersV357Test-1885242030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-fc3190cc-60b3-4260-b0ae-cac7cf210bae {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:14 devstack sudo[97343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-fc3190cc-60b3-4260-b0ae-cac7cf210bae
Jul 09 14:40:14 devstack sudo[97343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-51c697e8-85ee-46b1-89b8-9ef6ba505f6f tempest-SnapshotsActionsTest-1933512236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.ab434943-f094-45ff-af98-b995fab57d31" returned: 0 in 0.969s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:14 devstack sudo[97341]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-51c697e8-85ee-46b1-89b8-9ef6ba505f6f tempest-SnapshotsActionsTest-1933512236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.533s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:40:14 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-51c697e8-85ee-46b1-89b8-9ef6ba505f6f tempest-SnapshotsActionsTest-1933512236 None] Create snapshot completed successfully
Jul 09 14:40:15 devstack sudo[97343]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3af7d30a-b865-4815-914d-08b46c06e967 tempest-VolumesTransfersV357Test-1885242030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-fc3190cc-60b3-4260-b0ae-cac7cf210bae" returned: 0 in 1.125s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3af7d30a-b865-4815-914d-08b46c06e967 tempest-VolumesTransfersV357Test-1885242030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-fc3190cc-60b3-4260-b0ae-cac7cf210bae {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:15 devstack sudo[97349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-fc3190cc-60b3-4260-b0ae-cac7cf210bae
Jul 09 14:40:15 devstack sudo[97349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:16 devstack sudo[97349]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3af7d30a-b865-4815-914d-08b46c06e967 tempest-VolumesTransfersV357Test-1885242030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-fc3190cc-60b3-4260-b0ae-cac7cf210bae" returned: 0 in 0.768s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:16 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3af7d30a-b865-4815-914d-08b46c06e967 tempest-VolumesTransfersV357Test-1885242030 None] Lock "cinder-quobyte-fc3190cc-60b3-4260-b0ae-cac7cf210bae" released by "delete_volume" :: held 1.955s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:40:16 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-711fd6ed-5e9e-4301-829c-4a695feb3bc1 tempest-SnapshotsActionsTest-983213510 None] Acquiring lock "cinder-ab434943-f094-45ff-af98-b995fab57d31-delete_snapshot" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:40:16 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-711fd6ed-5e9e-4301-829c-4a695feb3bc1 tempest-SnapshotsActionsTest-983213510 None] Lock "cinder-ab434943-f094-45ff-af98-b995fab57d31-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:40:16 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-711fd6ed-5e9e-4301-829c-4a695feb3bc1 tempest-SnapshotsActionsTest-983213510 None] Acquiring lock "cinder-quobyte-29f428fb-5235-412a-98f9-1c121415ff54" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:40:16 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-711fd6ed-5e9e-4301-829c-4a695feb3bc1 tempest-SnapshotsActionsTest-983213510 None] Lock "cinder-quobyte-29f428fb-5235-412a-98f9-1c121415ff54" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:40:16 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-711fd6ed-5e9e-4301-829c-4a695feb3bc1 tempest-SnapshotsActionsTest-983213510 None] Acquiring lock "cinder-quobyte-ab434943-f094-45ff-af98-b995fab57d31" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:40:16 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-3af7d30a-b865-4815-914d-08b46c06e967 tempest-VolumesTransfersV357Test-1885242030 None] Created reservations ['0b02a5b2-9d96-46a3-862a-d7a8fb4a24bb', 'fb8f184e-ba5a-4efb-b23e-b829552c576e', '6059f580-d53b-43fa-bbb4-e15fad191600', 'a806bb15-5953-47c4-a069-370a2e36e2a1'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:40:16 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-711fd6ed-5e9e-4301-829c-4a695feb3bc1 tempest-SnapshotsActionsTest-983213510 None] Lock "cinder-quobyte-ab434943-f094-45ff-af98-b995fab57d31" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:40:16 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-711fd6ed-5e9e-4301-829c-4a695feb3bc1 tempest-SnapshotsActionsTest-983213510 None] Deleting offline snapshot ab434943-f094-45ff-af98-b995fab57d31 of volume 29f428fb-5235-412a-98f9-1c121415ff54 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 14:40:16 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-711fd6ed-5e9e-4301-829c-4a695feb3bc1 tempest-SnapshotsActionsTest-983213510 None] snapshot_file for this snap is: volume-29f428fb-5235-412a-98f9-1c121415ff54.ab434943-f094-45ff-af98-b995fab57d31 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 14:40:16 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcdeeae3-f669-4319-abe8-156c80509d14]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:40:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-711fd6ed-5e9e-4301-829c-4a695feb3bc1 tempest-SnapshotsActionsTest-983213510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.ab434943-f094-45ff-af98-b995fab57d31 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3af7d30a-b865-4815-914d-08b46c06e967 tempest-VolumesTransfersV357Test-1885242030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:40:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3af7d30a-b865-4815-914d-08b46c06e967 tempest-VolumesTransfersV357Test-1885242030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:40:16 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3af7d30a-b865-4815-914d-08b46c06e967 tempest-VolumesTransfersV357Test-1885242030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:40:16 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3af7d30a-b865-4815-914d-08b46c06e967 tempest-VolumesTransfersV357Test-1885242030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:40:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3af7d30a-b865-4815-914d-08b46c06e967 tempest-VolumesTransfersV357Test-1885242030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:40:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3af7d30a-b865-4815-914d-08b46c06e967 tempest-VolumesTransfersV357Test-1885242030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:16 devstack sudo[97352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.ab434943-f094-45ff-af98-b995fab57d31
Jul 09 14:40:16 devstack sudo[97352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:16 devstack sudo[97353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:40:16 devstack sudo[97353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:17 devstack sudo[97353]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3af7d30a-b865-4815-914d-08b46c06e967 tempest-VolumesTransfersV357Test-1885242030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.846s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:17 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-3af7d30a-b865-4815-914d-08b46c06e967 tempest-VolumesTransfersV357Test-1885242030 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:40:17 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-3af7d30a-b865-4815-914d-08b46c06e967 tempest-VolumesTransfersV357Test-1885242030 None] Deleted volume successfully.
Jul 09 14:40:17 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3af7d30a-b865-4815-914d-08b46c06e967 tempest-VolumesTransfersV357Test-1885242030 None] Lock "cinder-fc3190cc-60b3-4260-b0ae-cac7cf210bae-delete_volume" released by "delete_volume" :: held 3.259s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:40:17 devstack sudo[97352]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-711fd6ed-5e9e-4301-829c-4a695feb3bc1 tempest-SnapshotsActionsTest-983213510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.ab434943-f094-45ff-af98-b995fab57d31" returned: 0 in 1.035s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:17 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-711fd6ed-5e9e-4301-829c-4a695feb3bc1 tempest-SnapshotsActionsTest-983213510 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29f428fb-5235-412a-98f9-1c121415ff54(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 14:40:17 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[07d3abca-2c17-419e-a020-bebef615518e]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:40:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-711fd6ed-5e9e-4301-829c-4a695feb3bc1 tempest-SnapshotsActionsTest-983213510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.9e0132d1-de38-4d07-8bbd-6bcb1a634a01 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:17 devstack sudo[97362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.9e0132d1-de38-4d07-8bbd-6bcb1a634a01
Jul 09 14:40:17 devstack sudo[97362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:18 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=105,cinder:UPDATE=140,cinder:INSERT=32,cinder:DELETE=10 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 14:40:18 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-17f5036f-818e-460f-82d0-bfde85da0fec tempest-VolumesTransfersV357Test-1798633478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:40:18 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-17f5036f-818e-460f-82d0-bfde85da0fec tempest-VolumesTransfersV357Test-1798633478 None] Flow 'volume_create_manager' (d427cf19-8a2f-474c-b478-4f8ff37db910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:40:18 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-17f5036f-818e-460f-82d0-bfde85da0fec tempest-VolumesTransfersV357Test-1798633478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b4bd176-6ecc-4018-b765-448740c3aa5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:40:18 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-17f5036f-818e-460f-82d0-bfde85da0fec tempest-VolumesTransfersV357Test-1798633478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b4bd176-6ecc-4018-b765-448740c3aa5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:40:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1451242941',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08a5026d-573e-4e2c-b7e2-20413014d2c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c69ddbe92dc425986e2175000117da1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:40:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:40:18Z,use_quota=True,user_id='24e8461f3bb443e9ac2431e44589bb4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:40:18 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-17f5036f-818e-460f-82d0-bfde85da0fec tempest-VolumesTransfersV357Test-1798633478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84105ecc-fbd2-4143-ab84-52e91c38b42b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:40:18 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-17f5036f-818e-460f-82d0-bfde85da0fec tempest-VolumesTransfersV357Test-1798633478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84105ecc-fbd2-4143-ab84-52e91c38b42b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:40:18 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-17f5036f-818e-460f-82d0-bfde85da0fec tempest-VolumesTransfersV357Test-1798633478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d4a77a2-1725-414e-94cd-699dd3bf63a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:40:18 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-17f5036f-818e-460f-82d0-bfde85da0fec tempest-VolumesTransfersV357Test-1798633478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d4a77a2-1725-414e-94cd-699dd3bf63a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08a5026d-573e-4e2c-b7e2-20413014d2c1', 'volume_name': 'volume-08a5026d-573e-4e2c-b7e2-20413014d2c1', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:40:18 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-17f5036f-818e-460f-82d0-bfde85da0fec tempest-VolumesTransfersV357Test-1798633478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb6f2192-1f3f-45a7-a4ae-be8db146cb8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:40:18 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-17f5036f-818e-460f-82d0-bfde85da0fec tempest-VolumesTransfersV357Test-1798633478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb6f2192-1f3f-45a7-a4ae-be8db146cb8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:40:18 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-17f5036f-818e-460f-82d0-bfde85da0fec tempest-VolumesTransfersV357Test-1798633478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (648e07ab-b636-4dbd-bcbf-ef857f69c830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:40:18 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-17f5036f-818e-460f-82d0-bfde85da0fec tempest-VolumesTransfersV357Test-1798633478 None] Volume 08a5026d-573e-4e2c-b7e2-20413014d2c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08a5026d-573e-4e2c-b7e2-20413014d2c1', 'volume_size': 1}
Jul 09 14:40:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-17f5036f-818e-460f-82d0-bfde85da0fec tempest-VolumesTransfersV357Test-1798633478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:40:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-17f5036f-818e-460f-82d0-bfde85da0fec tempest-VolumesTransfersV357Test-1798633478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:40:18 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-17f5036f-818e-460f-82d0-bfde85da0fec tempest-VolumesTransfersV357Test-1798633478 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:40:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1451242941',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08a5026d-573e-4e2c-b7e2-20413014d2c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c69ddbe92dc425986e2175000117da1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:40:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:40:18Z,use_quota=True,user_id='24e8461f3bb443e9ac2431e44589bb4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:40:18 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-17f5036f-818e-460f-82d0-bfde85da0fec tempest-VolumesTransfersV357Test-1798633478 None] Creating volume 08a5026d-573e-4e2c-b7e2-20413014d2c1 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:40:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-17f5036f-818e-460f-82d0-bfde85da0fec tempest-VolumesTransfersV357Test-1798633478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:40:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-17f5036f-818e-460f-82d0-bfde85da0fec tempest-VolumesTransfersV357Test-1798633478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:40:18 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-17f5036f-818e-460f-82d0-bfde85da0fec tempest-VolumesTransfersV357Test-1798633478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:40:18 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-17f5036f-818e-460f-82d0-bfde85da0fec tempest-VolumesTransfersV357Test-1798633478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:40:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-17f5036f-818e-460f-82d0-bfde85da0fec tempest-VolumesTransfersV357Test-1798633478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:40:18 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-17f5036f-818e-460f-82d0-bfde85da0fec tempest-VolumesTransfersV357Test-1798633478 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:40:18 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-17f5036f-818e-460f-82d0-bfde85da0fec tempest-VolumesTransfersV357Test-1798633478 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:40:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-17f5036f-818e-460f-82d0-bfde85da0fec tempest-VolumesTransfersV357Test-1798633478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-08a5026d-573e-4e2c-b7e2-20413014d2c1 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:18 devstack sudo[97364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-08a5026d-573e-4e2c-b7e2-20413014d2c1 1073741824
Jul 09 14:40:18 devstack sudo[97364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:18 devstack sudo[97362]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-711fd6ed-5e9e-4301-829c-4a695feb3bc1 tempest-SnapshotsActionsTest-983213510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.9e0132d1-de38-4d07-8bbd-6bcb1a634a01" returned: 0 in 1.179s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:18 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-711fd6ed-5e9e-4301-829c-4a695feb3bc1 tempest-SnapshotsActionsTest-983213510 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29f428fb-5235-412a-98f9-1c121415ff54(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 14:40:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-711fd6ed-5e9e-4301-829c-4a695feb3bc1 tempest-SnapshotsActionsTest-983213510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.ab434943-f094-45ff-af98-b995fab57d31 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:18 devstack sudo[97369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.ab434943-f094-45ff-af98-b995fab57d31
Jul 09 14:40:18 devstack sudo[97369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:19 devstack sudo[97364]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-17f5036f-818e-460f-82d0-bfde85da0fec tempest-VolumesTransfersV357Test-1798633478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-08a5026d-573e-4e2c-b7e2-20413014d2c1 1073741824" returned: 0 in 1.075s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-17f5036f-818e-460f-82d0-bfde85da0fec tempest-VolumesTransfersV357Test-1798633478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-08a5026d-573e-4e2c-b7e2-20413014d2c1 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:19 devstack sudo[97381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-08a5026d-573e-4e2c-b7e2-20413014d2c1
Jul 09 14:40:19 devstack sudo[97381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:19 devstack sudo[97369]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-711fd6ed-5e9e-4301-829c-4a695feb3bc1 tempest-SnapshotsActionsTest-983213510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.ab434943-f094-45ff-af98-b995fab57d31" returned: 0 in 0.964s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-711fd6ed-5e9e-4301-829c-4a695feb3bc1 tempest-SnapshotsActionsTest-983213510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.ab434943-f094-45ff-af98-b995fab57d31 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:19 devstack sudo[97383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.ab434943-f094-45ff-af98-b995fab57d31
Jul 09 14:40:19 devstack sudo[97383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:20 devstack sudo[97381]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-17f5036f-818e-460f-82d0-bfde85da0fec tempest-VolumesTransfersV357Test-1798633478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-08a5026d-573e-4e2c-b7e2-20413014d2c1" returned: 0 in 0.868s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:20 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-17f5036f-818e-460f-82d0-bfde85da0fec tempest-VolumesTransfersV357Test-1798633478 None] <== create_volume: return (2010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:40:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-17f5036f-818e-460f-82d0-bfde85da0fec tempest-VolumesTransfersV357Test-1798633478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.013s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:40:20 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-17f5036f-818e-460f-82d0-bfde85da0fec tempest-VolumesTransfersV357Test-1798633478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (648e07ab-b636-4dbd-bcbf-ef857f69c830) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08a5026d-573e-4e2c-b7e2-20413014d2c1', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:40:20 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-17f5036f-818e-460f-82d0-bfde85da0fec tempest-VolumesTransfersV357Test-1798633478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7442823-1c11-4788-9d0e-ece634c9cee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:40:20 devstack sudo[97383]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-711fd6ed-5e9e-4301-829c-4a695feb3bc1 tempest-SnapshotsActionsTest-983213510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.ab434943-f094-45ff-af98-b995fab57d31" returned: 0 in 0.836s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:20 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-17f5036f-818e-460f-82d0-bfde85da0fec tempest-VolumesTransfersV357Test-1798633478 None] Volume volume-08a5026d-573e-4e2c-b7e2-20413014d2c1 (08a5026d-573e-4e2c-b7e2-20413014d2c1): created successfully
Jul 09 14:40:20 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-17f5036f-818e-460f-82d0-bfde85da0fec tempest-VolumesTransfersV357Test-1798633478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7442823-1c11-4788-9d0e-ece634c9cee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:40:20 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-17f5036f-818e-460f-82d0-bfde85da0fec tempest-VolumesTransfersV357Test-1798633478 None] Flow 'volume_create_manager' (d427cf19-8a2f-474c-b478-4f8ff37db910) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:40:20 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-711fd6ed-5e9e-4301-829c-4a695feb3bc1 tempest-SnapshotsActionsTest-983213510 None] Lock "cinder-quobyte-ab434943-f094-45ff-af98-b995fab57d31" released by "_delete_snapshot" :: held 4.196s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:40:20 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-711fd6ed-5e9e-4301-829c-4a695feb3bc1 tempest-SnapshotsActionsTest-983213510 None] Lock "cinder-quobyte-29f428fb-5235-412a-98f9-1c121415ff54" released by "delete_snapshot" :: held 4.234s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:40:20 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-17f5036f-818e-460f-82d0-bfde85da0fec tempest-VolumesTransfersV357Test-1798633478 None] Created volume successfully.
Jul 09 14:40:20 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-711fd6ed-5e9e-4301-829c-4a695feb3bc1 tempest-SnapshotsActionsTest-983213510 None] Created reservations ['b155b536-dea4-48b3-9f09-24a8fa87d8db', '078975ab-ca48-4377-bd65-1ccb56303b90', '1619014d-b5f7-4d81-9a19-ab5e58760eeb', 'd8b3a1bf-47df-449e-8d5d-d0de9231a64a'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:40:20 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-711fd6ed-5e9e-4301-829c-4a695feb3bc1 tempest-SnapshotsActionsTest-983213510 None] Delete snapshot completed successfully.
Jul 09 14:40:20 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-711fd6ed-5e9e-4301-829c-4a695feb3bc1 tempest-SnapshotsActionsTest-983213510 None] Lock "cinder-ab434943-f094-45ff-af98-b995fab57d31-delete_snapshot" released by "delete_snapshot" :: held 4.415s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:40:21 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b79b7f55-090e-49a6-bb1e-4f5d7dd4dcca tempest-VolumesTransfersV357Test-1885242030 None] Acquiring lock "cinder-08a5026d-573e-4e2c-b7e2-20413014d2c1-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:40:21 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b79b7f55-090e-49a6-bb1e-4f5d7dd4dcca tempest-VolumesTransfersV357Test-1885242030 None] Lock "cinder-08a5026d-573e-4e2c-b7e2-20413014d2c1-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:40:21 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b79b7f55-090e-49a6-bb1e-4f5d7dd4dcca tempest-VolumesTransfersV357Test-1885242030 None] Acquiring lock "cinder-quobyte-08a5026d-573e-4e2c-b7e2-20413014d2c1" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:40:21 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b79b7f55-090e-49a6-bb1e-4f5d7dd4dcca tempest-VolumesTransfersV357Test-1885242030 None] Lock "cinder-quobyte-08a5026d-573e-4e2c-b7e2-20413014d2c1" acquired by "delete_volume" :: waited 0.023s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:40:21 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[968516a8-3b9c-4432-9b8f-d5fcd377f616]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:40:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b79b7f55-090e-49a6-bb1e-4f5d7dd4dcca tempest-VolumesTransfersV357Test-1885242030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-08a5026d-573e-4e2c-b7e2-20413014d2c1 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-df500962-dafc-4b2e-a450-aaf2ef780f49 tempest-SnapshotsActionsTest-1933512236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:40:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-df500962-dafc-4b2e-a450-aaf2ef780f49 tempest-SnapshotsActionsTest-1933512236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:40:21 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-df500962-dafc-4b2e-a450-aaf2ef780f49 tempest-SnapshotsActionsTest-1933512236 None] Creating offline snapshot 57b9cf0d-e3f6-4955-a080-22fe255cf8e9 of volume 29f428fb-5235-412a-98f9-1c121415ff54 {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 14:40:21 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[db383440-8e8b-4179-93ad-322e592aa844]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:40:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-df500962-dafc-4b2e-a450-aaf2ef780f49 tempest-SnapshotsActionsTest-1933512236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.9e0132d1-de38-4d07-8bbd-6bcb1a634a01 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:21 devstack sudo[97390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-08a5026d-573e-4e2c-b7e2-20413014d2c1
Jul 09 14:40:21 devstack sudo[97390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:22 devstack sudo[97392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.9e0132d1-de38-4d07-8bbd-6bcb1a634a01
Jul 09 14:40:22 devstack sudo[97392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:22 devstack sudo[97390]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b79b7f55-090e-49a6-bb1e-4f5d7dd4dcca tempest-VolumesTransfersV357Test-1885242030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-08a5026d-573e-4e2c-b7e2-20413014d2c1" returned: 0 in 1.163s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b79b7f55-090e-49a6-bb1e-4f5d7dd4dcca tempest-VolumesTransfersV357Test-1885242030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-08a5026d-573e-4e2c-b7e2-20413014d2c1 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:23 devstack sudo[97397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-08a5026d-573e-4e2c-b7e2-20413014d2c1
Jul 09 14:40:23 devstack sudo[97397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:23 devstack sudo[97392]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-df500962-dafc-4b2e-a450-aaf2ef780f49 tempest-SnapshotsActionsTest-1933512236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.9e0132d1-de38-4d07-8bbd-6bcb1a634a01" returned: 0 in 1.342s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:23 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-df500962-dafc-4b2e-a450-aaf2ef780f49 tempest-SnapshotsActionsTest-1933512236 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29f428fb-5235-412a-98f9-1c121415ff54(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 14:40:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-df500962-dafc-4b2e-a450-aaf2ef780f49 tempest-SnapshotsActionsTest-1933512236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.9e0132d1-de38-4d07-8bbd-6bcb1a634a01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.57b9cf0d-e3f6-4955-a080-22fe255cf8e9 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:23 devstack sudo[97402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.9e0132d1-de38-4d07-8bbd-6bcb1a634a01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.57b9cf0d-e3f6-4955-a080-22fe255cf8e9 1G
Jul 09 14:40:23 devstack sudo[97402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:23 devstack sudo[97397]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b79b7f55-090e-49a6-bb1e-4f5d7dd4dcca tempest-VolumesTransfersV357Test-1885242030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-08a5026d-573e-4e2c-b7e2-20413014d2c1" returned: 0 in 0.849s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:23 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b79b7f55-090e-49a6-bb1e-4f5d7dd4dcca tempest-VolumesTransfersV357Test-1885242030 None] Lock "cinder-quobyte-08a5026d-573e-4e2c-b7e2-20413014d2c1" released by "delete_volume" :: held 2.077s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:40:23 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-b79b7f55-090e-49a6-bb1e-4f5d7dd4dcca tempest-VolumesTransfersV357Test-1885242030 None] Created reservations ['ae1996bb-0bc5-4567-aa50-0146ffecba3b', '4720960c-8417-488e-be3a-fe2857083c27', '5eca036a-ab79-4126-a1c0-b3770176bf98', '7bc581f8-38c2-4775-9a25-25f6dffc3d7c'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:40:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b79b7f55-090e-49a6-bb1e-4f5d7dd4dcca tempest-VolumesTransfersV357Test-1885242030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:40:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b79b7f55-090e-49a6-bb1e-4f5d7dd4dcca tempest-VolumesTransfersV357Test-1885242030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:40:24 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b79b7f55-090e-49a6-bb1e-4f5d7dd4dcca tempest-VolumesTransfersV357Test-1885242030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:40:24 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b79b7f55-090e-49a6-bb1e-4f5d7dd4dcca tempest-VolumesTransfersV357Test-1885242030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:40:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b79b7f55-090e-49a6-bb1e-4f5d7dd4dcca tempest-VolumesTransfersV357Test-1885242030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:40:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b79b7f55-090e-49a6-bb1e-4f5d7dd4dcca tempest-VolumesTransfersV357Test-1885242030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:24 devstack sudo[97405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:40:24 devstack sudo[97405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:24 devstack sudo[97402]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-df500962-dafc-4b2e-a450-aaf2ef780f49 tempest-SnapshotsActionsTest-1933512236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.9e0132d1-de38-4d07-8bbd-6bcb1a634a01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.57b9cf0d-e3f6-4955-a080-22fe255cf8e9 1G" returned: 0 in 1.327s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-df500962-dafc-4b2e-a450-aaf2ef780f49 tempest-SnapshotsActionsTest-1933512236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29f428fb-5235-412a-98f9-1c121415ff54.9e0132d1-de38-4d07-8bbd-6bcb1a634a01 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.57b9cf0d-e3f6-4955-a080-22fe255cf8e9 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:24 devstack sudo[97411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29f428fb-5235-412a-98f9-1c121415ff54.9e0132d1-de38-4d07-8bbd-6bcb1a634a01 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.57b9cf0d-e3f6-4955-a080-22fe255cf8e9
Jul 09 14:40:24 devstack sudo[97411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:25 devstack sudo[97405]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b79b7f55-090e-49a6-bb1e-4f5d7dd4dcca tempest-VolumesTransfersV357Test-1885242030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 1.372s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:25 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-b79b7f55-090e-49a6-bb1e-4f5d7dd4dcca tempest-VolumesTransfersV357Test-1885242030 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:40:25 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-b79b7f55-090e-49a6-bb1e-4f5d7dd4dcca tempest-VolumesTransfersV357Test-1885242030 None] Deleted volume successfully.
Jul 09 14:40:25 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b79b7f55-090e-49a6-bb1e-4f5d7dd4dcca tempest-VolumesTransfersV357Test-1885242030 None] Lock "cinder-08a5026d-573e-4e2c-b7e2-20413014d2c1-delete_volume" released by "delete_volume" :: held 3.778s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:40:25 devstack sudo[97411]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-df500962-dafc-4b2e-a450-aaf2ef780f49 tempest-SnapshotsActionsTest-1933512236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29f428fb-5235-412a-98f9-1c121415ff54.9e0132d1-de38-4d07-8bbd-6bcb1a634a01 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.57b9cf0d-e3f6-4955-a080-22fe255cf8e9" returned: 0 in 1.131s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:25 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-df500962-dafc-4b2e-a450-aaf2ef780f49 tempest-SnapshotsActionsTest-1933512236 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.57b9cf0d-e3f6-4955-a080-22fe255cf8e9 is being set with open permissions: ugo+rw
Jul 09 14:40:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-df500962-dafc-4b2e-a450-aaf2ef780f49 tempest-SnapshotsActionsTest-1933512236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.57b9cf0d-e3f6-4955-a080-22fe255cf8e9 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:25 devstack sudo[97419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.57b9cf0d-e3f6-4955-a080-22fe255cf8e9
Jul 09 14:40:25 devstack sudo[97419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:26 devstack sudo[97419]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-df500962-dafc-4b2e-a450-aaf2ef780f49 tempest-SnapshotsActionsTest-1933512236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.57b9cf0d-e3f6-4955-a080-22fe255cf8e9" returned: 0 in 0.867s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-df500962-dafc-4b2e-a450-aaf2ef780f49 tempest-SnapshotsActionsTest-1933512236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.818s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:40:26 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-df500962-dafc-4b2e-a450-aaf2ef780f49 tempest-SnapshotsActionsTest-1933512236 None] Create snapshot completed successfully
Jul 09 14:40:27 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-2168af66-b522-4efd-af2d-1edba554a60e tempest-SnapshotsActionsTest-983213510 None] Acquiring lock "cinder-57b9cf0d-e3f6-4955-a080-22fe255cf8e9-delete_snapshot" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:40:27 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-2168af66-b522-4efd-af2d-1edba554a60e tempest-SnapshotsActionsTest-983213510 None] Lock "cinder-57b9cf0d-e3f6-4955-a080-22fe255cf8e9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:40:27 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-2168af66-b522-4efd-af2d-1edba554a60e tempest-SnapshotsActionsTest-983213510 None] Acquiring lock "cinder-quobyte-29f428fb-5235-412a-98f9-1c121415ff54" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:40:27 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-2168af66-b522-4efd-af2d-1edba554a60e tempest-SnapshotsActionsTest-983213510 None] Lock "cinder-quobyte-29f428fb-5235-412a-98f9-1c121415ff54" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:40:27 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-2168af66-b522-4efd-af2d-1edba554a60e tempest-SnapshotsActionsTest-983213510 None] Acquiring lock "cinder-quobyte-57b9cf0d-e3f6-4955-a080-22fe255cf8e9" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:40:27 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-2168af66-b522-4efd-af2d-1edba554a60e tempest-SnapshotsActionsTest-983213510 None] Lock "cinder-quobyte-57b9cf0d-e3f6-4955-a080-22fe255cf8e9" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:40:27 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-2168af66-b522-4efd-af2d-1edba554a60e tempest-SnapshotsActionsTest-983213510 None] Deleting offline snapshot 57b9cf0d-e3f6-4955-a080-22fe255cf8e9 of volume 29f428fb-5235-412a-98f9-1c121415ff54 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 14:40:27 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-2168af66-b522-4efd-af2d-1edba554a60e tempest-SnapshotsActionsTest-983213510 None] snapshot_file for this snap is: volume-29f428fb-5235-412a-98f9-1c121415ff54.57b9cf0d-e3f6-4955-a080-22fe255cf8e9 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 14:40:27 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba670b6f-ec35-4f7d-8859-09d7e5a1ab43]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:40:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2168af66-b522-4efd-af2d-1edba554a60e tempest-SnapshotsActionsTest-983213510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.57b9cf0d-e3f6-4955-a080-22fe255cf8e9 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:27 devstack sudo[97422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.57b9cf0d-e3f6-4955-a080-22fe255cf8e9
Jul 09 14:40:27 devstack sudo[97422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:28 devstack sudo[97422]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2168af66-b522-4efd-af2d-1edba554a60e tempest-SnapshotsActionsTest-983213510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.57b9cf0d-e3f6-4955-a080-22fe255cf8e9" returned: 0 in 0.960s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:28 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-2168af66-b522-4efd-af2d-1edba554a60e tempest-SnapshotsActionsTest-983213510 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29f428fb-5235-412a-98f9-1c121415ff54(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 14:40:28 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bf94c03-af98-464a-8bee-86e5c67ff154]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:40:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2168af66-b522-4efd-af2d-1edba554a60e tempest-SnapshotsActionsTest-983213510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.9e0132d1-de38-4d07-8bbd-6bcb1a634a01 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:28 devstack sudo[97427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.9e0132d1-de38-4d07-8bbd-6bcb1a634a01
Jul 09 14:40:28 devstack sudo[97427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:29 devstack sudo[97427]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2168af66-b522-4efd-af2d-1edba554a60e tempest-SnapshotsActionsTest-983213510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.9e0132d1-de38-4d07-8bbd-6bcb1a634a01" returned: 0 in 1.026s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:29 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-2168af66-b522-4efd-af2d-1edba554a60e tempest-SnapshotsActionsTest-983213510 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29f428fb-5235-412a-98f9-1c121415ff54(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 14:40:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2168af66-b522-4efd-af2d-1edba554a60e tempest-SnapshotsActionsTest-983213510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.57b9cf0d-e3f6-4955-a080-22fe255cf8e9 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:29 devstack sudo[97432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.57b9cf0d-e3f6-4955-a080-22fe255cf8e9
Jul 09 14:40:29 devstack sudo[97432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:30 devstack sudo[97432]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2168af66-b522-4efd-af2d-1edba554a60e tempest-SnapshotsActionsTest-983213510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.57b9cf0d-e3f6-4955-a080-22fe255cf8e9" returned: 0 in 1.029s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2168af66-b522-4efd-af2d-1edba554a60e tempest-SnapshotsActionsTest-983213510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.57b9cf0d-e3f6-4955-a080-22fe255cf8e9 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:30 devstack sudo[97439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.57b9cf0d-e3f6-4955-a080-22fe255cf8e9
Jul 09 14:40:30 devstack sudo[97439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:31 devstack sudo[97439]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2168af66-b522-4efd-af2d-1edba554a60e tempest-SnapshotsActionsTest-983213510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.57b9cf0d-e3f6-4955-a080-22fe255cf8e9" returned: 0 in 0.901s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:31 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-2168af66-b522-4efd-af2d-1edba554a60e tempest-SnapshotsActionsTest-983213510 None] Lock "cinder-quobyte-57b9cf0d-e3f6-4955-a080-22fe255cf8e9" released by "_delete_snapshot" :: held 4.085s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:40:31 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-2168af66-b522-4efd-af2d-1edba554a60e tempest-SnapshotsActionsTest-983213510 None] Lock "cinder-quobyte-29f428fb-5235-412a-98f9-1c121415ff54" released by "delete_snapshot" :: held 4.113s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:40:31 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-2168af66-b522-4efd-af2d-1edba554a60e tempest-SnapshotsActionsTest-983213510 None] Created reservations ['5da094eb-e5a6-41a1-89a8-31c60e368306', '78c09b0f-f62a-4c34-8a80-79d433154a8a', 'e5ac99eb-d2d3-46e3-8196-afb63269c9a1', '5293f0ac-7666-4560-9323-7b90e4ebd1d7'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:40:31 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-2168af66-b522-4efd-af2d-1edba554a60e tempest-SnapshotsActionsTest-983213510 None] Delete snapshot completed successfully.
Jul 09 14:40:31 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-2168af66-b522-4efd-af2d-1edba554a60e tempest-SnapshotsActionsTest-983213510 None] Lock "cinder-57b9cf0d-e3f6-4955-a080-22fe255cf8e9-delete_snapshot" released by "delete_snapshot" :: held 4.341s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:40:32 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3c30208-ce98-419e-b0c9-04dd46dff369 tempest-TestInstancesWithCinderVolumes-1507168999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:40:32 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b3c30208-ce98-419e-b0c9-04dd46dff369 tempest-TestInstancesWithCinderVolumes-1507168999 None] Flow 'volume_create_manager' (d33a32b9-5787-4ced-8451-9feeef50383c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:40:32 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b3c30208-ce98-419e-b0c9-04dd46dff369 tempest-TestInstancesWithCinderVolumes-1507168999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9aa77bc0-e2dd-4d43-8c10-2a9e592dfcb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:40:32 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b3c30208-ce98-419e-b0c9-04dd46dff369 tempest-TestInstancesWithCinderVolumes-1507168999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9aa77bc0-e2dd-4d43-8c10-2a9e592dfcb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:40:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2095182867',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffedc0c5-a50b-4b16-8c53-4c21c22887bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d8059ec86374956a065be7130e3147d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:40:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:40:33Z,use_quota=True,user_id='4ae993e4d1df42e986fb68763b0a4b66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23d690e8-5abc-48a7-834b-7ef67016ff3f),volume_type_id=23d690e8-5abc-48a7-834b-7ef67016ff3f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:40:32 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b3c30208-ce98-419e-b0c9-04dd46dff369 tempest-TestInstancesWithCinderVolumes-1507168999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf19ea47-6129-41ad-85b2-b5d4f99fcaec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:40:32 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b3c30208-ce98-419e-b0c9-04dd46dff369 tempest-TestInstancesWithCinderVolumes-1507168999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf19ea47-6129-41ad-85b2-b5d4f99fcaec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:40:32 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b3c30208-ce98-419e-b0c9-04dd46dff369 tempest-TestInstancesWithCinderVolumes-1507168999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26ce7234-6d96-40e5-9cd8-1bc3ac2eb8e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:40:32 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b3c30208-ce98-419e-b0c9-04dd46dff369 tempest-TestInstancesWithCinderVolumes-1507168999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26ce7234-6d96-40e5-9cd8-1bc3ac2eb8e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffedc0c5-a50b-4b16-8c53-4c21c22887bd', 'volume_name': 'volume-ffedc0c5-a50b-4b16-8c53-4c21c22887bd', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:40:32 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b3c30208-ce98-419e-b0c9-04dd46dff369 tempest-TestInstancesWithCinderVolumes-1507168999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad9c6537-0ee0-453c-89d4-f29e7c54ba8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:40:32 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b3c30208-ce98-419e-b0c9-04dd46dff369 tempest-TestInstancesWithCinderVolumes-1507168999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad9c6537-0ee0-453c-89d4-f29e7c54ba8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:40:32 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b3c30208-ce98-419e-b0c9-04dd46dff369 tempest-TestInstancesWithCinderVolumes-1507168999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5639fccf-94c8-4656-83f6-9f9590c3422b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:40:32 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-b3c30208-ce98-419e-b0c9-04dd46dff369 tempest-TestInstancesWithCinderVolumes-1507168999 None] Volume ffedc0c5-a50b-4b16-8c53-4c21c22887bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffedc0c5-a50b-4b16-8c53-4c21c22887bd', 'volume_size': 1}
Jul 09 14:40:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b3c30208-ce98-419e-b0c9-04dd46dff369 tempest-TestInstancesWithCinderVolumes-1507168999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:40:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b3c30208-ce98-419e-b0c9-04dd46dff369 tempest-TestInstancesWithCinderVolumes-1507168999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:40:32 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b3c30208-ce98-419e-b0c9-04dd46dff369 tempest-TestInstancesWithCinderVolumes-1507168999 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:40:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2095182867',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffedc0c5-a50b-4b16-8c53-4c21c22887bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d8059ec86374956a065be7130e3147d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:40:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:40:33Z,use_quota=True,user_id='4ae993e4d1df42e986fb68763b0a4b66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23d690e8-5abc-48a7-834b-7ef67016ff3f),volume_type_id=23d690e8-5abc-48a7-834b-7ef67016ff3f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:40:32 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-b3c30208-ce98-419e-b0c9-04dd46dff369 tempest-TestInstancesWithCinderVolumes-1507168999 None] Creating volume ffedc0c5-a50b-4b16-8c53-4c21c22887bd {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:40:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b3c30208-ce98-419e-b0c9-04dd46dff369 tempest-TestInstancesWithCinderVolumes-1507168999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:40:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b3c30208-ce98-419e-b0c9-04dd46dff369 tempest-TestInstancesWithCinderVolumes-1507168999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:40:32 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b3c30208-ce98-419e-b0c9-04dd46dff369 tempest-TestInstancesWithCinderVolumes-1507168999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:40:32 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b3c30208-ce98-419e-b0c9-04dd46dff369 tempest-TestInstancesWithCinderVolumes-1507168999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:40:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b3c30208-ce98-419e-b0c9-04dd46dff369 tempest-TestInstancesWithCinderVolumes-1507168999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:40:32 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b3c30208-ce98-419e-b0c9-04dd46dff369 tempest-TestInstancesWithCinderVolumes-1507168999 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:40:32 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-b3c30208-ce98-419e-b0c9-04dd46dff369 tempest-TestInstancesWithCinderVolumes-1507168999 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:40:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b3c30208-ce98-419e-b0c9-04dd46dff369 tempest-TestInstancesWithCinderVolumes-1507168999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ffedc0c5-a50b-4b16-8c53-4c21c22887bd 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:32 devstack sudo[97443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ffedc0c5-a50b-4b16-8c53-4c21c22887bd 1073741824
Jul 09 14:40:32 devstack sudo[97443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:33 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-5286545f-12c2-43e4-9e69-3ea661bb66a7 tempest-TestInstancesWithCinderVolumes-1507168999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:40:33 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5286545f-12c2-43e4-9e69-3ea661bb66a7 tempest-TestInstancesWithCinderVolumes-1507168999 None] Flow 'volume_create_manager' (28b63944-9c52-4643-9a4b-4f7f933e6e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:40:33 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5286545f-12c2-43e4-9e69-3ea661bb66a7 tempest-TestInstancesWithCinderVolumes-1507168999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (610663d9-2129-42ea-9b4a-b149be399c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:40:33 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5286545f-12c2-43e4-9e69-3ea661bb66a7 tempest-TestInstancesWithCinderVolumes-1507168999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (610663d9-2129-42ea-9b4a-b149be399c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:40:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1012594025',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d49df72-89a9-4f2c-ac53-c34b068fb2d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d8059ec86374956a065be7130e3147d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:40:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:40:33Z,use_quota=True,user_id='4ae993e4d1df42e986fb68763b0a4b66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67145771-273b-40bc-ae10-cebd24768324),volume_type_id=67145771-273b-40bc-ae10-cebd24768324)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:40:33 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5286545f-12c2-43e4-9e69-3ea661bb66a7 tempest-TestInstancesWithCinderVolumes-1507168999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7a65590-a61d-4ed3-a549-235a2e9cbe3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:40:33 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5286545f-12c2-43e4-9e69-3ea661bb66a7 tempest-TestInstancesWithCinderVolumes-1507168999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7a65590-a61d-4ed3-a549-235a2e9cbe3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:40:33 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5286545f-12c2-43e4-9e69-3ea661bb66a7 tempest-TestInstancesWithCinderVolumes-1507168999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11cc7601-3f89-4de0-b518-f1acc8e0c080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:40:33 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5286545f-12c2-43e4-9e69-3ea661bb66a7 tempest-TestInstancesWithCinderVolumes-1507168999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11cc7601-3f89-4de0-b518-f1acc8e0c080) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d49df72-89a9-4f2c-ac53-c34b068fb2d9', 'volume_name': 'volume-8d49df72-89a9-4f2c-ac53-c34b068fb2d9', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:40:33 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5286545f-12c2-43e4-9e69-3ea661bb66a7 tempest-TestInstancesWithCinderVolumes-1507168999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af174ef4-b181-4764-9dcc-225d20751b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:40:33 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5286545f-12c2-43e4-9e69-3ea661bb66a7 tempest-TestInstancesWithCinderVolumes-1507168999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af174ef4-b181-4764-9dcc-225d20751b96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:40:33 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5286545f-12c2-43e4-9e69-3ea661bb66a7 tempest-TestInstancesWithCinderVolumes-1507168999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d679443-dfec-4023-b996-c561b85a60f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:40:33 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-5286545f-12c2-43e4-9e69-3ea661bb66a7 tempest-TestInstancesWithCinderVolumes-1507168999 None] Volume 8d49df72-89a9-4f2c-ac53-c34b068fb2d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d49df72-89a9-4f2c-ac53-c34b068fb2d9', 'volume_size': 1}
Jul 09 14:40:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5286545f-12c2-43e4-9e69-3ea661bb66a7 tempest-TestInstancesWithCinderVolumes-1507168999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:40:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-bf296fc2-d66c-4cfd-95c1-43d80521d98c tempest-SnapshotsActionsTest-1933512236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:40:34 devstack sudo[97443]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b3c30208-ce98-419e-b0c9-04dd46dff369 tempest-TestInstancesWithCinderVolumes-1507168999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ffedc0c5-a50b-4b16-8c53-4c21c22887bd 1073741824" returned: 0 in 1.196s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b3c30208-ce98-419e-b0c9-04dd46dff369 tempest-TestInstancesWithCinderVolumes-1507168999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ffedc0c5-a50b-4b16-8c53-4c21c22887bd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:34 devstack sudo[97449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ffedc0c5-a50b-4b16-8c53-4c21c22887bd
Jul 09 14:40:34 devstack sudo[97449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:34 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-a237badd-be07-4cfb-b287-015af4bbb3b0 tempest-TestInstancesWithCinderVolumes-1507168999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:40:34 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a237badd-be07-4cfb-b287-015af4bbb3b0 tempest-TestInstancesWithCinderVolumes-1507168999 None] Flow 'volume_create_manager' (ff9cb0ac-8e30-4b27-99f0-f0a98d4df900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:40:34 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a237badd-be07-4cfb-b287-015af4bbb3b0 tempest-TestInstancesWithCinderVolumes-1507168999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (684f434f-63a3-48bf-bc19-e6df95c04359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:40:34 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a237badd-be07-4cfb-b287-015af4bbb3b0 tempest-TestInstancesWithCinderVolumes-1507168999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (684f434f-63a3-48bf-bc19-e6df95c04359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:40:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1288446180',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2daa519b-cac8-4271-9ebc-dc62c34f83fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d8059ec86374956a065be7130e3147d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:40:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:40:35Z,use_quota=True,user_id='4ae993e4d1df42e986fb68763b0a4b66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54ba6268-4b98-41ff-b4e8-42fb1f5d34f1),volume_type_id=54ba6268-4b98-41ff-b4e8-42fb1f5d34f1)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:40:34 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a237badd-be07-4cfb-b287-015af4bbb3b0 tempest-TestInstancesWithCinderVolumes-1507168999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (263f368b-10bc-4a60-b060-3a1b2b35550c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:40:34 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a237badd-be07-4cfb-b287-015af4bbb3b0 tempest-TestInstancesWithCinderVolumes-1507168999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (263f368b-10bc-4a60-b060-3a1b2b35550c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:40:34 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a237badd-be07-4cfb-b287-015af4bbb3b0 tempest-TestInstancesWithCinderVolumes-1507168999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24aed5cf-a1bc-4bf5-9c5c-dbebcfad0e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:40:34 devstack cinder-volume[87230]: DEBUG cinder.image.glance [None req-a237badd-be07-4cfb-b287-015af4bbb3b0 tempest-TestInstancesWithCinderVolumes-1507168999 None] Creating Keystone auth plugin from conf {{(pid=87230) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 09 14:40:35 devstack sudo[97449]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b3c30208-ce98-419e-b0c9-04dd46dff369 tempest-TestInstancesWithCinderVolumes-1507168999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ffedc0c5-a50b-4b16-8c53-4c21c22887bd" returned: 0 in 0.867s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:35 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b3c30208-ce98-419e-b0c9-04dd46dff369 tempest-TestInstancesWithCinderVolumes-1507168999 None] <== create_volume: return (2140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:40:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b3c30208-ce98-419e-b0c9-04dd46dff369 tempest-TestInstancesWithCinderVolumes-1507168999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.144s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:40:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5286545f-12c2-43e4-9e69-3ea661bb66a7 tempest-TestInstancesWithCinderVolumes-1507168999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.663s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:40:35 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-5286545f-12c2-43e4-9e69-3ea661bb66a7 tempest-TestInstancesWithCinderVolumes-1507168999 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:40:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1012594025',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d49df72-89a9-4f2c-ac53-c34b068fb2d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d8059ec86374956a065be7130e3147d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:40:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:40:33Z,use_quota=True,user_id='4ae993e4d1df42e986fb68763b0a4b66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67145771-273b-40bc-ae10-cebd24768324),volume_type_id=67145771-273b-40bc-ae10-cebd24768324)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:40:35 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-5286545f-12c2-43e4-9e69-3ea661bb66a7 tempest-TestInstancesWithCinderVolumes-1507168999 None] Creating volume 8d49df72-89a9-4f2c-ac53-c34b068fb2d9 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:40:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5286545f-12c2-43e4-9e69-3ea661bb66a7 tempest-TestInstancesWithCinderVolumes-1507168999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:40:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5286545f-12c2-43e4-9e69-3ea661bb66a7 tempest-TestInstancesWithCinderVolumes-1507168999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:40:35 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-5286545f-12c2-43e4-9e69-3ea661bb66a7 tempest-TestInstancesWithCinderVolumes-1507168999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:40:35 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-5286545f-12c2-43e4-9e69-3ea661bb66a7 tempest-TestInstancesWithCinderVolumes-1507168999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:40:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5286545f-12c2-43e4-9e69-3ea661bb66a7 tempest-TestInstancesWithCinderVolumes-1507168999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:40:35 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-5286545f-12c2-43e4-9e69-3ea661bb66a7 tempest-TestInstancesWithCinderVolumes-1507168999 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:40:35 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-5286545f-12c2-43e4-9e69-3ea661bb66a7 tempest-TestInstancesWithCinderVolumes-1507168999 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:40:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5286545f-12c2-43e4-9e69-3ea661bb66a7 tempest-TestInstancesWithCinderVolumes-1507168999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8d49df72-89a9-4f2c-ac53-c34b068fb2d9 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b3c30208-ce98-419e-b0c9-04dd46dff369 tempest-TestInstancesWithCinderVolumes-1507168999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5639fccf-94c8-4656-83f6-9f9590c3422b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffedc0c5-a50b-4b16-8c53-4c21c22887bd', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:40:35 devstack sudo[97452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8d49df72-89a9-4f2c-ac53-c34b068fb2d9 1073741824
Jul 09 14:40:35 devstack sudo[97452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b3c30208-ce98-419e-b0c9-04dd46dff369 tempest-TestInstancesWithCinderVolumes-1507168999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f62400d5-f8a9-4c9a-b9a0-25b25dbf22e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:40:35 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=113,cinder:UPDATE=133,cinder:INSERT=35,cinder:DELETE=10 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 14:40:35 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-b3c30208-ce98-419e-b0c9-04dd46dff369 tempest-TestInstancesWithCinderVolumes-1507168999 None] Volume volume-ffedc0c5-a50b-4b16-8c53-4c21c22887bd (ffedc0c5-a50b-4b16-8c53-4c21c22887bd): created successfully
Jul 09 14:40:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b3c30208-ce98-419e-b0c9-04dd46dff369 tempest-TestInstancesWithCinderVolumes-1507168999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f62400d5-f8a9-4c9a-b9a0-25b25dbf22e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:40:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b3c30208-ce98-419e-b0c9-04dd46dff369 tempest-TestInstancesWithCinderVolumes-1507168999 None] Flow 'volume_create_manager' (d33a32b9-5787-4ced-8451-9feeef50383c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:40:35 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecd3be9d-d37c-4e3f-b759-97d3023230b6 tempest-VolumesExtendTest-1843197783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:40:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ecd3be9d-d37c-4e3f-b759-97d3023230b6 tempest-VolumesExtendTest-1843197783 None] Flow 'volume_create_manager' (7d18c904-990d-450f-a809-c3fa07c20f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:40:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ecd3be9d-d37c-4e3f-b759-97d3023230b6 tempest-VolumesExtendTest-1843197783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0225b4c-1eb7-4d18-a070-6fdd26c5249e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:40:35 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-b3c30208-ce98-419e-b0c9-04dd46dff369 tempest-TestInstancesWithCinderVolumes-1507168999 None] Created volume successfully.
Jul 09 14:40:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ecd3be9d-d37c-4e3f-b759-97d3023230b6 tempest-VolumesExtendTest-1843197783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0225b4c-1eb7-4d18-a070-6fdd26c5249e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:40:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1344392065',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d17241d-9a43-49fb-ab93-138e06235f8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f52ae6a0dc4b45fab3ce8a7f7a8dcee3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:40:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:40:35Z,use_quota=True,user_id='711195e602864fcf85875a54368e16f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:40:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ecd3be9d-d37c-4e3f-b759-97d3023230b6 tempest-VolumesExtendTest-1843197783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b4cc41a-2be9-4f16-a5f8-af96da2e13c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:40:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ecd3be9d-d37c-4e3f-b759-97d3023230b6 tempest-VolumesExtendTest-1843197783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b4cc41a-2be9-4f16-a5f8-af96da2e13c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:40:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ecd3be9d-d37c-4e3f-b759-97d3023230b6 tempest-VolumesExtendTest-1843197783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cc7f850-9bc5-424d-80b4-00e94a3eec90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:40:35 devstack cinder-volume[87230]: DEBUG cinder.image.glance [None req-ecd3be9d-d37c-4e3f-b759-97d3023230b6 tempest-VolumesExtendTest-1843197783 None] Creating Keystone auth plugin from conf {{(pid=87230) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 09 14:40:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a237badd-be07-4cfb-b287-015af4bbb3b0 tempest-TestInstancesWithCinderVolumes-1507168999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24aed5cf-a1bc-4bf5-9c5c-dbebcfad0e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2daa519b-cac8-4271-9ebc-dc62c34f83fb', 'volume_name': 'volume-2daa519b-cac8-4271-9ebc-dc62c34f83fb', 'volume_size': 1, 'image_id': '08e6daa8-5ce8-4cd2-8e64-4df2bbb84823', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/08e6daa8-5ce8-4cd2-8e64-4df2bbb84823', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2112186624', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5d8059ec86374956a065be7130e3147d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '08e6daa8-5ce8-4cd2-8e64-4df2bbb84823', 'created_at': datetime.datetime(2026, 7, 9, 12, 40, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 12, 40, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/08e6daa8-5ce8-4cd2-8e64-4df2bbb84823/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x720a548afd40>}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:40:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a237badd-be07-4cfb-b287-015af4bbb3b0 tempest-TestInstancesWithCinderVolumes-1507168999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f861463a-3def-4257-b033-e50666654231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:40:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a237badd-be07-4cfb-b287-015af4bbb3b0 tempest-TestInstancesWithCinderVolumes-1507168999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f861463a-3def-4257-b033-e50666654231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:40:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a237badd-be07-4cfb-b287-015af4bbb3b0 tempest-TestInstancesWithCinderVolumes-1507168999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7479d7fa-96a3-49ba-ad47-ac1f5e75fcbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:40:35 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-a237badd-be07-4cfb-b287-015af4bbb3b0 tempest-TestInstancesWithCinderVolumes-1507168999 None] Volume 2daa519b-cac8-4271-9ebc-dc62c34f83fb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2daa519b-cac8-4271-9ebc-dc62c34f83fb', 'volume_size': 1, 'image_id': '08e6daa8-5ce8-4cd2-8e64-4df2bbb84823', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/08e6daa8-5ce8-4cd2-8e64-4df2bbb84823', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2112186624', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5d8059ec86374956a065be7130e3147d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '08e6daa8-5ce8-4cd2-8e64-4df2bbb84823', 'created_at': datetime.datetime(2026, 7, 9, 12, 40, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 12, 40, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/08e6daa8-5ce8-4cd2-8e64-4df2bbb84823/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x720a548afd40>}
Jul 09 14:40:35 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-a237badd-be07-4cfb-b287-015af4bbb3b0 tempest-TestInstancesWithCinderVolumes-1507168999 None] Trying to clone 2daa519b-cac8-4271-9ebc-dc62c34f83fb from image 08e6daa8-5ce8-4cd2-8e64-4df2bbb84823 at location (None, [{'url': 'file:///opt/stack/data/glance/images/08e6daa8-5ce8-4cd2-8e64-4df2bbb84823', 'metadata': {}}]). {{(pid=87230) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 09 14:40:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ecd3be9d-d37c-4e3f-b759-97d3023230b6 tempest-VolumesExtendTest-1843197783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cc7f850-9bc5-424d-80b4-00e94a3eec90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7d17241d-9a43-49fb-ab93-138e06235f8b', 'volume_name': 'volume-7d17241d-9a43-49fb-ab93-138e06235f8b', 'volume_size': 1, 'image_id': '5eba314f-9adb-4fc7-aaad-9e9a3b7dae70', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5eba314f-9adb-4fc7-aaad-9e9a3b7dae70', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '10a7640b39774d00a67b2de818bf4a10', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5eba314f-9adb-4fc7-aaad-9e9a3b7dae70', 'created_at': datetime.datetime(2026, 7, 9, 12, 24, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 12, 24, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5eba314f-9adb-4fc7-aaad-9e9a3b7dae70/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x720a544bfcb0>}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:40:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ecd3be9d-d37c-4e3f-b759-97d3023230b6 tempest-VolumesExtendTest-1843197783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (878db8da-7961-40ac-bbee-0057f1f522ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:40:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ecd3be9d-d37c-4e3f-b759-97d3023230b6 tempest-VolumesExtendTest-1843197783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (878db8da-7961-40ac-bbee-0057f1f522ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:40:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ecd3be9d-d37c-4e3f-b759-97d3023230b6 tempest-VolumesExtendTest-1843197783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f07eac07-0c2f-450a-93dc-f30a43e18f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:40:35 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-ecd3be9d-d37c-4e3f-b759-97d3023230b6 tempest-VolumesExtendTest-1843197783 None] Volume 7d17241d-9a43-49fb-ab93-138e06235f8b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7d17241d-9a43-49fb-ab93-138e06235f8b', 'volume_size': 1, 'image_id': '5eba314f-9adb-4fc7-aaad-9e9a3b7dae70', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5eba314f-9adb-4fc7-aaad-9e9a3b7dae70', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '10a7640b39774d00a67b2de818bf4a10', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5eba314f-9adb-4fc7-aaad-9e9a3b7dae70', 'created_at': datetime.datetime(2026, 7, 9, 12, 24, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 12, 24, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5eba314f-9adb-4fc7-aaad-9e9a3b7dae70/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x720a544bfcb0>}
Jul 09 14:40:35 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecd3be9d-d37c-4e3f-b759-97d3023230b6 tempest-VolumesExtendTest-1843197783 None] Trying to clone 7d17241d-9a43-49fb-ab93-138e06235f8b from image 5eba314f-9adb-4fc7-aaad-9e9a3b7dae70 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5eba314f-9adb-4fc7-aaad-9e9a3b7dae70', 'metadata': {}}]). {{(pid=87230) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 09 14:40:36 devstack sudo[97452]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5286545f-12c2-43e4-9e69-3ea661bb66a7 tempest-TestInstancesWithCinderVolumes-1507168999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8d49df72-89a9-4f2c-ac53-c34b068fb2d9 1073741824" returned: 0 in 1.163s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:36 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-ecd3be9d-d37c-4e3f-b759-97d3023230b6 tempest-VolumesExtendTest-1843197783 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5eba314f-9adb-4fc7-aaad-9e9a3b7dae70_oy0nostsdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87230) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 09 14:40:36 devstack cinder-volume[87230]: INFO cinder.image.image_utils [None req-ecd3be9d-d37c-4e3f-b759-97d3023230b6 tempest-VolumesExtendTest-1843197783 None] Image download 20.69 MB at 20.69 MB/s
Jul 09 14:40:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5286545f-12c2-43e4-9e69-3ea661bb66a7 tempest-TestInstancesWithCinderVolumes-1507168999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8d49df72-89a9-4f2c-ac53-c34b068fb2d9 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:36 devstack sudo[97478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8d49df72-89a9-4f2c-ac53-c34b068fb2d9
Jul 09 14:40:36 devstack sudo[97478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:36 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef2ad8a-7d46-4740-be87-1b84872b2d2d]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:40:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ecd3be9d-d37c-4e3f-b759-97d3023230b6 tempest-VolumesExtendTest-1843197783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5eba314f-9adb-4fc7-aaad-9e9a3b7dae70_oy0nostsdevstack@QuobyteHD {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:36 devstack sudo[97480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5eba314f-9adb-4fc7-aaad-9e9a3b7dae70_oy0nostsdevstack@QuobyteHD
Jul 09 14:40:36 devstack sudo[97480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:37 devstack sudo[97478]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5286545f-12c2-43e4-9e69-3ea661bb66a7 tempest-TestInstancesWithCinderVolumes-1507168999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8d49df72-89a9-4f2c-ac53-c34b068fb2d9" returned: 0 in 0.861s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:37 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-5286545f-12c2-43e4-9e69-3ea661bb66a7 tempest-TestInstancesWithCinderVolumes-1507168999 None] <== create_volume: return (2109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:40:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5286545f-12c2-43e4-9e69-3ea661bb66a7 tempest-TestInstancesWithCinderVolumes-1507168999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.114s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:40:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-bf296fc2-d66c-4cfd-95c1-43d80521d98c tempest-SnapshotsActionsTest-1933512236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.598s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:40:37 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-bf296fc2-d66c-4cfd-95c1-43d80521d98c tempest-SnapshotsActionsTest-1933512236 None] Creating offline snapshot 9543e05a-ff93-477e-a912-e61dd8015775 of volume 29f428fb-5235-412a-98f9-1c121415ff54 {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 14:40:37 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5286545f-12c2-43e4-9e69-3ea661bb66a7 tempest-TestInstancesWithCinderVolumes-1507168999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d679443-dfec-4023-b996-c561b85a60f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d49df72-89a9-4f2c-ac53-c34b068fb2d9', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:40:37 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5286545f-12c2-43e4-9e69-3ea661bb66a7 tempest-TestInstancesWithCinderVolumes-1507168999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc3ef4f2-e4dc-46df-a050-3984688bffcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:40:37 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf7a49d5-32b6-4a99-857c-89cd9e00593c]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:40:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-bf296fc2-d66c-4cfd-95c1-43d80521d98c tempest-SnapshotsActionsTest-1933512236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.9e0132d1-de38-4d07-8bbd-6bcb1a634a01 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:37 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-5286545f-12c2-43e4-9e69-3ea661bb66a7 tempest-TestInstancesWithCinderVolumes-1507168999 None] Volume volume-8d49df72-89a9-4f2c-ac53-c34b068fb2d9 (8d49df72-89a9-4f2c-ac53-c34b068fb2d9): created successfully
Jul 09 14:40:37 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5286545f-12c2-43e4-9e69-3ea661bb66a7 tempest-TestInstancesWithCinderVolumes-1507168999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc3ef4f2-e4dc-46df-a050-3984688bffcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:40:37 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5286545f-12c2-43e4-9e69-3ea661bb66a7 tempest-TestInstancesWithCinderVolumes-1507168999 None] Flow 'volume_create_manager' (28b63944-9c52-4643-9a4b-4f7f933e6e45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:40:37 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-5286545f-12c2-43e4-9e69-3ea661bb66a7 tempest-TestInstancesWithCinderVolumes-1507168999 None] Created volume successfully.
Jul 09 14:40:37 devstack sudo[97480]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ecd3be9d-d37c-4e3f-b759-97d3023230b6 tempest-VolumesExtendTest-1843197783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5eba314f-9adb-4fc7-aaad-9e9a3b7dae70_oy0nostsdevstack@QuobyteHD" returned: 0 in 1.010s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:37 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-ecd3be9d-d37c-4e3f-b759-97d3023230b6 tempest-VolumesExtendTest-1843197783 None] Temporary image 5eba314f-9adb-4fc7-aaad-9e9a3b7dae70 is fetched for user 711195e602864fcf85875a54368e16f7. {{(pid=87230) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 09 14:40:37 devstack sudo[97487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.9e0132d1-de38-4d07-8bbd-6bcb1a634a01
Jul 09 14:40:37 devstack sudo[97487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:37 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c5661e-faef-41f9-b1e3-8ac77ab85e0a]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:40:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ecd3be9d-d37c-4e3f-b759-97d3023230b6 tempest-VolumesExtendTest-1843197783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5eba314f-9adb-4fc7-aaad-9e9a3b7dae70_oy0nostsdevstack@QuobyteHD {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:37 devstack sudo[97489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5eba314f-9adb-4fc7-aaad-9e9a3b7dae70_oy0nostsdevstack@QuobyteHD
Jul 09 14:40:37 devstack sudo[97489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:38 devstack sudo[97487]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-bf296fc2-d66c-4cfd-95c1-43d80521d98c tempest-SnapshotsActionsTest-1933512236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.9e0132d1-de38-4d07-8bbd-6bcb1a634a01" returned: 0 in 0.880s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:38 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-bf296fc2-d66c-4cfd-95c1-43d80521d98c tempest-SnapshotsActionsTest-1933512236 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29f428fb-5235-412a-98f9-1c121415ff54(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 14:40:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-bf296fc2-d66c-4cfd-95c1-43d80521d98c tempest-SnapshotsActionsTest-1933512236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.9e0132d1-de38-4d07-8bbd-6bcb1a634a01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.9543e05a-ff93-477e-a912-e61dd8015775 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:38 devstack sudo[97495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.9e0132d1-de38-4d07-8bbd-6bcb1a634a01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.9543e05a-ff93-477e-a912-e61dd8015775 1G
Jul 09 14:40:38 devstack sudo[97495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:38 devstack sudo[97489]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ecd3be9d-d37c-4e3f-b759-97d3023230b6 tempest-VolumesExtendTest-1843197783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5eba314f-9adb-4fc7-aaad-9e9a3b7dae70_oy0nostsdevstack@QuobyteHD" returned: 0 in 0.881s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-ecd3be9d-d37c-4e3f-b759-97d3023230b6 tempest-VolumesExtendTest-1843197783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:40:39 devstack sudo[97495]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-bf296fc2-d66c-4cfd-95c1-43d80521d98c tempest-SnapshotsActionsTest-1933512236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.9e0132d1-de38-4d07-8bbd-6bcb1a634a01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.9543e05a-ff93-477e-a912-e61dd8015775 1G" returned: 0 in 1.005s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-bf296fc2-d66c-4cfd-95c1-43d80521d98c tempest-SnapshotsActionsTest-1933512236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29f428fb-5235-412a-98f9-1c121415ff54.9e0132d1-de38-4d07-8bbd-6bcb1a634a01 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.9543e05a-ff93-477e-a912-e61dd8015775 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:39 devstack sudo[97503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29f428fb-5235-412a-98f9-1c121415ff54.9e0132d1-de38-4d07-8bbd-6bcb1a634a01 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.9543e05a-ff93-477e-a912-e61dd8015775
Jul 09 14:40:39 devstack sudo[97503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:39 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-a237badd-be07-4cfb-b287-015af4bbb3b0 tempest-TestInstancesWithCinderVolumes-1507168999 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_08e6daa8-5ce8-4cd2-8e64-4df2bbb84823_k2_98ua4devstack@QuobyteHD, size 20.69 MB, duration 3.97 sec {{(pid=87230) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 09 14:40:39 devstack cinder-volume[87230]: INFO cinder.image.image_utils [None req-a237badd-be07-4cfb-b287-015af4bbb3b0 tempest-TestInstancesWithCinderVolumes-1507168999 None] Image download 20.69 MB at 5.21 MB/s
Jul 09 14:40:39 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cba1e37-e319-4d86-bf8f-3b1aeac32dea]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:40:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a237badd-be07-4cfb-b287-015af4bbb3b0 tempest-TestInstancesWithCinderVolumes-1507168999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08e6daa8-5ce8-4cd2-8e64-4df2bbb84823_k2_98ua4devstack@QuobyteHD {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:39 devstack sudo[97542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08e6daa8-5ce8-4cd2-8e64-4df2bbb84823_k2_98ua4devstack@QuobyteHD
Jul 09 14:40:39 devstack sudo[97542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:39 devstack sudo[97503]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-bf296fc2-d66c-4cfd-95c1-43d80521d98c tempest-SnapshotsActionsTest-1933512236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29f428fb-5235-412a-98f9-1c121415ff54.9e0132d1-de38-4d07-8bbd-6bcb1a634a01 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.9543e05a-ff93-477e-a912-e61dd8015775" returned: 0 in 0.800s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:39 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-bf296fc2-d66c-4cfd-95c1-43d80521d98c tempest-SnapshotsActionsTest-1933512236 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.9543e05a-ff93-477e-a912-e61dd8015775 is being set with open permissions: ugo+rw
Jul 09 14:40:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-bf296fc2-d66c-4cfd-95c1-43d80521d98c tempest-SnapshotsActionsTest-1933512236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.9543e05a-ff93-477e-a912-e61dd8015775 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:39 devstack sudo[97546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.9543e05a-ff93-477e-a912-e61dd8015775
Jul 09 14:40:39 devstack sudo[97546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:40 devstack sudo[97546]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-bf296fc2-d66c-4cfd-95c1-43d80521d98c tempest-SnapshotsActionsTest-1933512236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.9543e05a-ff93-477e-a912-e61dd8015775" returned: 0 in 0.692s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:40 devstack sudo[97542]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a237badd-be07-4cfb-b287-015af4bbb3b0 tempest-TestInstancesWithCinderVolumes-1507168999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08e6daa8-5ce8-4cd2-8e64-4df2bbb84823_k2_98ua4devstack@QuobyteHD" returned: 0 in 0.881s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:40 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-a237badd-be07-4cfb-b287-015af4bbb3b0 tempest-TestInstancesWithCinderVolumes-1507168999 None] Temporary image 08e6daa8-5ce8-4cd2-8e64-4df2bbb84823 is fetched for user 4ae993e4d1df42e986fb68763b0a4b66. {{(pid=87230) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 09 14:40:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-bf296fc2-d66c-4cfd-95c1-43d80521d98c tempest-SnapshotsActionsTest-1933512236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.519s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:40:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-ecd3be9d-d37c-4e3f-b759-97d3023230b6 tempest-VolumesExtendTest-1843197783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.360s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:40:40 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-ecd3be9d-d37c-4e3f-b759-97d3023230b6 tempest-VolumesExtendTest-1843197783 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:40:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1344392065',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d17241d-9a43-49fb-ab93-138e06235f8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f52ae6a0dc4b45fab3ce8a7f7a8dcee3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:40:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:40:35Z,use_quota=True,user_id='711195e602864fcf85875a54368e16f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:40:40 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-ecd3be9d-d37c-4e3f-b759-97d3023230b6 tempest-VolumesExtendTest-1843197783 None] Creating volume 7d17241d-9a43-49fb-ab93-138e06235f8b {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:40:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-ecd3be9d-d37c-4e3f-b759-97d3023230b6 tempest-VolumesExtendTest-1843197783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:40:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-ecd3be9d-d37c-4e3f-b759-97d3023230b6 tempest-VolumesExtendTest-1843197783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:40:40 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-ecd3be9d-d37c-4e3f-b759-97d3023230b6 tempest-VolumesExtendTest-1843197783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:40:40 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-ecd3be9d-d37c-4e3f-b759-97d3023230b6 tempest-VolumesExtendTest-1843197783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:40:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-ecd3be9d-d37c-4e3f-b759-97d3023230b6 tempest-VolumesExtendTest-1843197783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:40:40 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-ecd3be9d-d37c-4e3f-b759-97d3023230b6 tempest-VolumesExtendTest-1843197783 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:40:40 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-ecd3be9d-d37c-4e3f-b759-97d3023230b6 tempest-VolumesExtendTest-1843197783 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:40:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ecd3be9d-d37c-4e3f-b759-97d3023230b6 tempest-VolumesExtendTest-1843197783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7d17241d-9a43-49fb-ab93-138e06235f8b 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:40 devstack sudo[97553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7d17241d-9a43-49fb-ab93-138e06235f8b 1073741824
Jul 09 14:40:40 devstack sudo[97553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:40 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-bf296fc2-d66c-4cfd-95c1-43d80521d98c tempest-SnapshotsActionsTest-1933512236 None] Create snapshot completed successfully
Jul 09 14:40:40 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[1484fbd2-13ca-43c0-a349-de50f220ae3b]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:40:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a237badd-be07-4cfb-b287-015af4bbb3b0 tempest-TestInstancesWithCinderVolumes-1507168999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08e6daa8-5ce8-4cd2-8e64-4df2bbb84823_k2_98ua4devstack@QuobyteHD {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:40 devstack sudo[97555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08e6daa8-5ce8-4cd2-8e64-4df2bbb84823_k2_98ua4devstack@QuobyteHD
Jul 09 14:40:40 devstack sudo[97555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:41 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-2ff138fc-39e8-496f-b84b-e273cb9a2607 tempest-SnapshotsActionsTest-983213510 None] Acquiring lock "cinder-9543e05a-ff93-477e-a912-e61dd8015775-delete_snapshot" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:40:41 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-2ff138fc-39e8-496f-b84b-e273cb9a2607 tempest-SnapshotsActionsTest-983213510 None] Lock "cinder-9543e05a-ff93-477e-a912-e61dd8015775-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:40:41 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-2ff138fc-39e8-496f-b84b-e273cb9a2607 tempest-SnapshotsActionsTest-983213510 None] Acquiring lock "cinder-quobyte-29f428fb-5235-412a-98f9-1c121415ff54" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:40:41 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-2ff138fc-39e8-496f-b84b-e273cb9a2607 tempest-SnapshotsActionsTest-983213510 None] Lock "cinder-quobyte-29f428fb-5235-412a-98f9-1c121415ff54" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:40:41 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-2ff138fc-39e8-496f-b84b-e273cb9a2607 tempest-SnapshotsActionsTest-983213510 None] Acquiring lock "cinder-quobyte-9543e05a-ff93-477e-a912-e61dd8015775" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:40:41 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-2ff138fc-39e8-496f-b84b-e273cb9a2607 tempest-SnapshotsActionsTest-983213510 None] Lock "cinder-quobyte-9543e05a-ff93-477e-a912-e61dd8015775" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:40:41 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-2ff138fc-39e8-496f-b84b-e273cb9a2607 tempest-SnapshotsActionsTest-983213510 None] Deleting offline snapshot 9543e05a-ff93-477e-a912-e61dd8015775 of volume 29f428fb-5235-412a-98f9-1c121415ff54 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 14:40:41 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-2ff138fc-39e8-496f-b84b-e273cb9a2607 tempest-SnapshotsActionsTest-983213510 None] snapshot_file for this snap is: volume-29f428fb-5235-412a-98f9-1c121415ff54.9543e05a-ff93-477e-a912-e61dd8015775 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 14:40:41 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ebfbf12-a727-4057-bf5f-cb1fa420d955]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:40:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2ff138fc-39e8-496f-b84b-e273cb9a2607 tempest-SnapshotsActionsTest-983213510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.9543e05a-ff93-477e-a912-e61dd8015775 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:41 devstack sudo[97557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.9543e05a-ff93-477e-a912-e61dd8015775
Jul 09 14:40:41 devstack sudo[97557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:41 devstack sudo[97553]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ecd3be9d-d37c-4e3f-b759-97d3023230b6 tempest-VolumesExtendTest-1843197783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7d17241d-9a43-49fb-ab93-138e06235f8b 1073741824" returned: 0 in 0.966s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ecd3be9d-d37c-4e3f-b759-97d3023230b6 tempest-VolumesExtendTest-1843197783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7d17241d-9a43-49fb-ab93-138e06235f8b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:41 devstack sudo[97567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7d17241d-9a43-49fb-ab93-138e06235f8b
Jul 09 14:40:41 devstack sudo[97567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:41 devstack sudo[97555]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a237badd-be07-4cfb-b287-015af4bbb3b0 tempest-TestInstancesWithCinderVolumes-1507168999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08e6daa8-5ce8-4cd2-8e64-4df2bbb84823_k2_98ua4devstack@QuobyteHD" returned: 0 in 1.032s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a237badd-be07-4cfb-b287-015af4bbb3b0 tempest-TestInstancesWithCinderVolumes-1507168999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:40:41 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-c76cfeb4-278c-4966-a3c4-7fcf29f9e5e4 tempest-VolumeQuotasAdminTestJSON-1297134694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:40:41 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c76cfeb4-278c-4966-a3c4-7fcf29f9e5e4 tempest-VolumeQuotasAdminTestJSON-1297134694 None] Flow 'volume_create_manager' (eb04dfd1-31bc-4da2-9aa5-bda10efbddc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:40:41 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c76cfeb4-278c-4966-a3c4-7fcf29f9e5e4 tempest-VolumeQuotasAdminTestJSON-1297134694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05c56991-9b93-40e6-bd45-37bae4187916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:40:41 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c76cfeb4-278c-4966-a3c4-7fcf29f9e5e4 tempest-VolumeQuotasAdminTestJSON-1297134694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05c56991-9b93-40e6-bd45-37bae4187916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:40:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-44677174',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66e08687-5fb6-4a8b-bcb9-635712c07549,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='775e9ad5495540f599c1dc417a08068e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:40:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:40:42Z,use_quota=True,user_id='ae34a069f26742debbeb04ce03d49836',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:40:41 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c76cfeb4-278c-4966-a3c4-7fcf29f9e5e4 tempest-VolumeQuotasAdminTestJSON-1297134694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef9f9fc4-ca0c-4c10-82f0-b2142f387393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:40:41 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c76cfeb4-278c-4966-a3c4-7fcf29f9e5e4 tempest-VolumeQuotasAdminTestJSON-1297134694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef9f9fc4-ca0c-4c10-82f0-b2142f387393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:40:41 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c76cfeb4-278c-4966-a3c4-7fcf29f9e5e4 tempest-VolumeQuotasAdminTestJSON-1297134694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94f5e433-575a-4216-8a71-40e5f74c75dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:40:41 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c76cfeb4-278c-4966-a3c4-7fcf29f9e5e4 tempest-VolumeQuotasAdminTestJSON-1297134694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94f5e433-575a-4216-8a71-40e5f74c75dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66e08687-5fb6-4a8b-bcb9-635712c07549', 'volume_name': 'volume-66e08687-5fb6-4a8b-bcb9-635712c07549', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:40:41 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c76cfeb4-278c-4966-a3c4-7fcf29f9e5e4 tempest-VolumeQuotasAdminTestJSON-1297134694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efb96c2c-9379-47a0-8c26-10aeddc1a83b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:40:41 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c76cfeb4-278c-4966-a3c4-7fcf29f9e5e4 tempest-VolumeQuotasAdminTestJSON-1297134694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efb96c2c-9379-47a0-8c26-10aeddc1a83b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:40:41 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c76cfeb4-278c-4966-a3c4-7fcf29f9e5e4 tempest-VolumeQuotasAdminTestJSON-1297134694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81d2ecf9-f255-44cd-a06b-0138b74d899b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:40:41 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-c76cfeb4-278c-4966-a3c4-7fcf29f9e5e4 tempest-VolumeQuotasAdminTestJSON-1297134694 None] Volume 66e08687-5fb6-4a8b-bcb9-635712c07549: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66e08687-5fb6-4a8b-bcb9-635712c07549', 'volume_size': 1}
Jul 09 14:40:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c76cfeb4-278c-4966-a3c4-7fcf29f9e5e4 tempest-VolumeQuotasAdminTestJSON-1297134694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:40:42 devstack sudo[97557]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2ff138fc-39e8-496f-b84b-e273cb9a2607 tempest-SnapshotsActionsTest-983213510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.9543e05a-ff93-477e-a912-e61dd8015775" returned: 0 in 0.955s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:42 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-2ff138fc-39e8-496f-b84b-e273cb9a2607 tempest-SnapshotsActionsTest-983213510 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29f428fb-5235-412a-98f9-1c121415ff54(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 14:40:42 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[2adb95fc-a5e3-4e24-98cf-ab4a17eee00c]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:40:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2ff138fc-39e8-496f-b84b-e273cb9a2607 tempest-SnapshotsActionsTest-983213510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.9e0132d1-de38-4d07-8bbd-6bcb1a634a01 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:42 devstack sudo[97572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.9e0132d1-de38-4d07-8bbd-6bcb1a634a01
Jul 09 14:40:42 devstack sudo[97572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:42 devstack sudo[97567]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ecd3be9d-d37c-4e3f-b759-97d3023230b6 tempest-VolumesExtendTest-1843197783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7d17241d-9a43-49fb-ab93-138e06235f8b" returned: 0 in 0.675s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:42 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-ecd3be9d-d37c-4e3f-b759-97d3023230b6 tempest-VolumesExtendTest-1843197783 None] <== create_volume: return (1715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:40:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-ecd3be9d-d37c-4e3f-b759-97d3023230b6 tempest-VolumesExtendTest-1843197783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.718s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:40:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a237badd-be07-4cfb-b287-015af4bbb3b0 tempest-TestInstancesWithCinderVolumes-1507168999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.600s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:40:42 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a237badd-be07-4cfb-b287-015af4bbb3b0 tempest-TestInstancesWithCinderVolumes-1507168999 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:40:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1288446180',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2daa519b-cac8-4271-9ebc-dc62c34f83fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d8059ec86374956a065be7130e3147d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:40:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:40:35Z,use_quota=True,user_id='4ae993e4d1df42e986fb68763b0a4b66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54ba6268-4b98-41ff-b4e8-42fb1f5d34f1),volume_type_id=54ba6268-4b98-41ff-b4e8-42fb1f5d34f1)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:40:42 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-a237badd-be07-4cfb-b287-015af4bbb3b0 tempest-TestInstancesWithCinderVolumes-1507168999 None] Creating volume 2daa519b-cac8-4271-9ebc-dc62c34f83fb {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:40:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a237badd-be07-4cfb-b287-015af4bbb3b0 tempest-TestInstancesWithCinderVolumes-1507168999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:40:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a237badd-be07-4cfb-b287-015af4bbb3b0 tempest-TestInstancesWithCinderVolumes-1507168999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:40:42 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a237badd-be07-4cfb-b287-015af4bbb3b0 tempest-TestInstancesWithCinderVolumes-1507168999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:40:42 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a237badd-be07-4cfb-b287-015af4bbb3b0 tempest-TestInstancesWithCinderVolumes-1507168999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:40:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a237badd-be07-4cfb-b287-015af4bbb3b0 tempest-TestInstancesWithCinderVolumes-1507168999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:40:42 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a237badd-be07-4cfb-b287-015af4bbb3b0 tempest-TestInstancesWithCinderVolumes-1507168999 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:40:42 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-a237badd-be07-4cfb-b287-015af4bbb3b0 tempest-TestInstancesWithCinderVolumes-1507168999 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:40:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a237badd-be07-4cfb-b287-015af4bbb3b0 tempest-TestInstancesWithCinderVolumes-1507168999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2daa519b-cac8-4271-9ebc-dc62c34f83fb 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:42 devstack sudo[97575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2daa519b-cac8-4271-9ebc-dc62c34f83fb 1073741824
Jul 09 14:40:42 devstack sudo[97575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:42 devstack cinder-volume[87230]: DEBUG cinder.volume.volume_utils [None req-ecd3be9d-d37c-4e3f-b759-97d3023230b6 tempest-VolumesExtendTest-1843197783 None] Attempting download of 5eba314f-9adb-4fc7-aaad-9e9a3b7dae70 ((None, [{'url': 'file:///opt/stack/data/glance/images/5eba314f-9adb-4fc7-aaad-9e9a3b7dae70', 'metadata': {}}])) to volume 7d17241d-9a43-49fb-ab93-138e06235f8b. {{(pid=87230) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 09 14:40:42 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[d70d3bae-7341-4f0f-8773-32b0c75dc870]: (4, 'raw') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:40:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ecd3be9d-d37c-4e3f-b759-97d3023230b6 tempest-VolumesExtendTest-1843197783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5eba314f-9adb-4fc7-aaad-9e9a3b7dae70_c7gngix0 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:42 devstack sudo[97577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5eba314f-9adb-4fc7-aaad-9e9a3b7dae70_c7gngix0
Jul 09 14:40:42 devstack sudo[97577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:43 devstack sudo[97572]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2ff138fc-39e8-496f-b84b-e273cb9a2607 tempest-SnapshotsActionsTest-983213510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.9e0132d1-de38-4d07-8bbd-6bcb1a634a01" returned: 0 in 0.815s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:43 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-2ff138fc-39e8-496f-b84b-e273cb9a2607 tempest-SnapshotsActionsTest-983213510 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29f428fb-5235-412a-98f9-1c121415ff54(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 14:40:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2ff138fc-39e8-496f-b84b-e273cb9a2607 tempest-SnapshotsActionsTest-983213510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.9543e05a-ff93-477e-a912-e61dd8015775 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:43 devstack sudo[97585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.9543e05a-ff93-477e-a912-e61dd8015775
Jul 09 14:40:43 devstack sudo[97585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:43 devstack sudo[97577]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ecd3be9d-d37c-4e3f-b759-97d3023230b6 tempest-VolumesExtendTest-1843197783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5eba314f-9adb-4fc7-aaad-9e9a3b7dae70_c7gngix0" returned: 0 in 0.779s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ecd3be9d-d37c-4e3f-b759-97d3023230b6 tempest-VolumesExtendTest-1843197783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5eba314f-9adb-4fc7-aaad-9e9a3b7dae70_c7gngix0 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:43 devstack sudo[97575]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a237badd-be07-4cfb-b287-015af4bbb3b0 tempest-TestInstancesWithCinderVolumes-1507168999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2daa519b-cac8-4271-9ebc-dc62c34f83fb 1073741824" returned: 0 in 0.905s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a237badd-be07-4cfb-b287-015af4bbb3b0 tempest-TestInstancesWithCinderVolumes-1507168999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2daa519b-cac8-4271-9ebc-dc62c34f83fb {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:43 devstack sudo[97591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2daa519b-cac8-4271-9ebc-dc62c34f83fb
Jul 09 14:40:43 devstack sudo[97591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:43 devstack sudo[97590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5eba314f-9adb-4fc7-aaad-9e9a3b7dae70_c7gngix0
Jul 09 14:40:43 devstack sudo[97590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:43 devstack sudo[97585]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2ff138fc-39e8-496f-b84b-e273cb9a2607 tempest-SnapshotsActionsTest-983213510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.9543e05a-ff93-477e-a912-e61dd8015775" returned: 0 in 0.855s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2ff138fc-39e8-496f-b84b-e273cb9a2607 tempest-SnapshotsActionsTest-983213510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.9543e05a-ff93-477e-a912-e61dd8015775 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:43 devstack sudo[97597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.9543e05a-ff93-477e-a912-e61dd8015775
Jul 09 14:40:43 devstack sudo[97597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:44 devstack sudo[97591]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a237badd-be07-4cfb-b287-015af4bbb3b0 tempest-TestInstancesWithCinderVolumes-1507168999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2daa519b-cac8-4271-9ebc-dc62c34f83fb" returned: 0 in 0.674s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:44 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a237badd-be07-4cfb-b287-015af4bbb3b0 tempest-TestInstancesWithCinderVolumes-1507168999 None] <== create_volume: return (1627ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:40:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a237badd-be07-4cfb-b287-015af4bbb3b0 tempest-TestInstancesWithCinderVolumes-1507168999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.630s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:40:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c76cfeb4-278c-4966-a3c4-7fcf29f9e5e4 tempest-VolumeQuotasAdminTestJSON-1297134694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.122s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:40:44 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-c76cfeb4-278c-4966-a3c4-7fcf29f9e5e4 tempest-VolumeQuotasAdminTestJSON-1297134694 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:40:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-44677174',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66e08687-5fb6-4a8b-bcb9-635712c07549,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='775e9ad5495540f599c1dc417a08068e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:40:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:40:42Z,use_quota=True,user_id='ae34a069f26742debbeb04ce03d49836',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:40:44 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-c76cfeb4-278c-4966-a3c4-7fcf29f9e5e4 tempest-VolumeQuotasAdminTestJSON-1297134694 None] Creating volume 66e08687-5fb6-4a8b-bcb9-635712c07549 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:40:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c76cfeb4-278c-4966-a3c4-7fcf29f9e5e4 tempest-VolumeQuotasAdminTestJSON-1297134694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:40:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c76cfeb4-278c-4966-a3c4-7fcf29f9e5e4 tempest-VolumeQuotasAdminTestJSON-1297134694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:40:44 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-c76cfeb4-278c-4966-a3c4-7fcf29f9e5e4 tempest-VolumeQuotasAdminTestJSON-1297134694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:40:44 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-c76cfeb4-278c-4966-a3c4-7fcf29f9e5e4 tempest-VolumeQuotasAdminTestJSON-1297134694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:40:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c76cfeb4-278c-4966-a3c4-7fcf29f9e5e4 tempest-VolumeQuotasAdminTestJSON-1297134694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:40:44 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-c76cfeb4-278c-4966-a3c4-7fcf29f9e5e4 tempest-VolumeQuotasAdminTestJSON-1297134694 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:40:44 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-c76cfeb4-278c-4966-a3c4-7fcf29f9e5e4 tempest-VolumeQuotasAdminTestJSON-1297134694 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:40:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c76cfeb4-278c-4966-a3c4-7fcf29f9e5e4 tempest-VolumeQuotasAdminTestJSON-1297134694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-66e08687-5fb6-4a8b-bcb9-635712c07549 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:44 devstack sudo[97602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-66e08687-5fb6-4a8b-bcb9-635712c07549 1073741824
Jul 09 14:40:44 devstack sudo[97602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:44 devstack sudo[97590]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ecd3be9d-d37c-4e3f-b759-97d3023230b6 tempest-VolumesExtendTest-1843197783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5eba314f-9adb-4fc7-aaad-9e9a3b7dae70_c7gngix0" returned: 1 in 0.798s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ecd3be9d-d37c-4e3f-b759-97d3023230b6 tempest-VolumesExtendTest-1843197783 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5eba314f-9adb-4fc7-aaad-9e9a3b7dae70_c7gngix0' failed. Not Retrying. {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 09 14:40:44 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da43eed-1ed2-4d7a-944c-9dba8764df02]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:40:44 devstack cinder-volume[87230]: DEBUG cinder.volume.volume_utils [None req-a237badd-be07-4cfb-b287-015af4bbb3b0 tempest-TestInstancesWithCinderVolumes-1507168999 None] Attempting download of 08e6daa8-5ce8-4cd2-8e64-4df2bbb84823 ((None, [{'url': 'file:///opt/stack/data/glance/images/08e6daa8-5ce8-4cd2-8e64-4df2bbb84823', 'metadata': {}}])) to volume 2daa519b-cac8-4271-9ebc-dc62c34f83fb. {{(pid=87230) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 09 14:40:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ecd3be9d-d37c-4e3f-b759-97d3023230b6 tempest-VolumesExtendTest-1843197783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5eba314f-9adb-4fc7-aaad-9e9a3b7dae70_oy0nostsdevstack@QuobyteHD {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:44 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[69e2d1d7-7e42-4190-b70f-d34d61c29e31]: (4, 'raw') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:40:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a237badd-be07-4cfb-b287-015af4bbb3b0 tempest-TestInstancesWithCinderVolumes-1507168999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_08e6daa8-5ce8-4cd2-8e64-4df2bbb84823__nr4swc5 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:44 devstack sudo[97604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5eba314f-9adb-4fc7-aaad-9e9a3b7dae70_oy0nostsdevstack@QuobyteHD
Jul 09 14:40:44 devstack sudo[97604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:44 devstack sudo[97605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_08e6daa8-5ce8-4cd2-8e64-4df2bbb84823__nr4swc5
Jul 09 14:40:44 devstack sudo[97605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:44 devstack sudo[97597]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2ff138fc-39e8-496f-b84b-e273cb9a2607 tempest-SnapshotsActionsTest-983213510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.9543e05a-ff93-477e-a912-e61dd8015775" returned: 0 in 0.736s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:44 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-2ff138fc-39e8-496f-b84b-e273cb9a2607 tempest-SnapshotsActionsTest-983213510 None] Lock "cinder-quobyte-9543e05a-ff93-477e-a912-e61dd8015775" released by "_delete_snapshot" :: held 3.494s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:40:44 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-2ff138fc-39e8-496f-b84b-e273cb9a2607 tempest-SnapshotsActionsTest-983213510 None] Lock "cinder-quobyte-29f428fb-5235-412a-98f9-1c121415ff54" released by "delete_snapshot" :: held 3.541s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:40:44 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-2ff138fc-39e8-496f-b84b-e273cb9a2607 tempest-SnapshotsActionsTest-983213510 None] Created reservations ['bd7a0e5a-07d7-4717-9f7b-22e109b6e503', 'f8407a48-9830-4702-bc06-5fe58d2fabee', 'a3bc7c1d-b87c-4377-97b4-f7a4f02843da', '1bb061b7-4cbb-4023-bbc9-be8e891cd587'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:40:44 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-2ff138fc-39e8-496f-b84b-e273cb9a2607 tempest-SnapshotsActionsTest-983213510 None] Delete snapshot completed successfully.
Jul 09 14:40:44 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-2ff138fc-39e8-496f-b84b-e273cb9a2607 tempest-SnapshotsActionsTest-983213510 None] Lock "cinder-9543e05a-ff93-477e-a912-e61dd8015775-delete_snapshot" released by "delete_snapshot" :: held 3.740s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:40:44 devstack sudo[97604]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ecd3be9d-d37c-4e3f-b759-97d3023230b6 tempest-VolumesExtendTest-1843197783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5eba314f-9adb-4fc7-aaad-9e9a3b7dae70_oy0nostsdevstack@QuobyteHD" returned: 0 in 0.843s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:44 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-ecd3be9d-d37c-4e3f-b759-97d3023230b6 tempest-VolumesExtendTest-1843197783 None] 5eba314f-9adb-4fc7-aaad-9e9a3b7dae70 was qcow2, converting to raw {{(pid=87230) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 09 14:40:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ecd3be9d-d37c-4e3f-b759-97d3023230b6 tempest-VolumesExtendTest-1843197783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5eba314f-9adb-4fc7-aaad-9e9a3b7dae70_oy0nostsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7d17241d-9a43-49fb-ab93-138e06235f8b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:44 devstack sudo[97616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5eba314f-9adb-4fc7-aaad-9e9a3b7dae70_oy0nostsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7d17241d-9a43-49fb-ab93-138e06235f8b
Jul 09 14:40:44 devstack sudo[97616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:45 devstack sudo[97602]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c76cfeb4-278c-4966-a3c4-7fcf29f9e5e4 tempest-VolumeQuotasAdminTestJSON-1297134694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-66e08687-5fb6-4a8b-bcb9-635712c07549 1073741824" returned: 0 in 1.023s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:45 devstack sudo[97605]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a237badd-be07-4cfb-b287-015af4bbb3b0 tempest-TestInstancesWithCinderVolumes-1507168999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_08e6daa8-5ce8-4cd2-8e64-4df2bbb84823__nr4swc5" returned: 0 in 0.885s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a237badd-be07-4cfb-b287-015af4bbb3b0 tempest-TestInstancesWithCinderVolumes-1507168999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_08e6daa8-5ce8-4cd2-8e64-4df2bbb84823__nr4swc5 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c76cfeb4-278c-4966-a3c4-7fcf29f9e5e4 tempest-VolumeQuotasAdminTestJSON-1297134694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-66e08687-5fb6-4a8b-bcb9-635712c07549 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:45 devstack sudo[97621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-66e08687-5fb6-4a8b-bcb9-635712c07549
Jul 09 14:40:45 devstack sudo[97621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:45 devstack sudo[97620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_08e6daa8-5ce8-4cd2-8e64-4df2bbb84823__nr4swc5
Jul 09 14:40:45 devstack sudo[97620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:45 devstack sudo[97621]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c76cfeb4-278c-4966-a3c4-7fcf29f9e5e4 tempest-VolumeQuotasAdminTestJSON-1297134694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-66e08687-5fb6-4a8b-bcb9-635712c07549" returned: 0 in 0.730s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:45 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-c76cfeb4-278c-4966-a3c4-7fcf29f9e5e4 tempest-VolumeQuotasAdminTestJSON-1297134694 None] <== create_volume: return (1817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:40:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c76cfeb4-278c-4966-a3c4-7fcf29f9e5e4 tempest-VolumeQuotasAdminTestJSON-1297134694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.821s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:40:45 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c76cfeb4-278c-4966-a3c4-7fcf29f9e5e4 tempest-VolumeQuotasAdminTestJSON-1297134694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81d2ecf9-f255-44cd-a06b-0138b74d899b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66e08687-5fb6-4a8b-bcb9-635712c07549', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:40:45 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c76cfeb4-278c-4966-a3c4-7fcf29f9e5e4 tempest-VolumeQuotasAdminTestJSON-1297134694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df91cfc3-2486-4784-84fd-4f07530a0a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:40:45 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-bed9cb52-e804-4446-b3bd-384adc33197a tempest-SnapshotsActionsTest-1933512236 None] Acquiring lock "cinder-9e0132d1-de38-4d07-8bbd-6bcb1a634a01-delete_snapshot" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:40:45 devstack sudo[97620]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a237badd-be07-4cfb-b287-015af4bbb3b0 tempest-TestInstancesWithCinderVolumes-1507168999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_08e6daa8-5ce8-4cd2-8e64-4df2bbb84823__nr4swc5" returned: 1 in 0.836s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a237badd-be07-4cfb-b287-015af4bbb3b0 tempest-TestInstancesWithCinderVolumes-1507168999 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_08e6daa8-5ce8-4cd2-8e64-4df2bbb84823__nr4swc5' failed. Not Retrying. {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 09 14:40:45 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e1b61f4-cf51-4dff-b048-bf0ec29ce5a9]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:40:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a237badd-be07-4cfb-b287-015af4bbb3b0 tempest-TestInstancesWithCinderVolumes-1507168999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08e6daa8-5ce8-4cd2-8e64-4df2bbb84823_k2_98ua4devstack@QuobyteHD {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:45 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-bed9cb52-e804-4446-b3bd-384adc33197a tempest-SnapshotsActionsTest-1933512236 None] Lock "cinder-9e0132d1-de38-4d07-8bbd-6bcb1a634a01-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:40:45 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-bed9cb52-e804-4446-b3bd-384adc33197a tempest-SnapshotsActionsTest-1933512236 None] Acquiring lock "cinder-quobyte-29f428fb-5235-412a-98f9-1c121415ff54" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:40:45 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-c76cfeb4-278c-4966-a3c4-7fcf29f9e5e4 tempest-VolumeQuotasAdminTestJSON-1297134694 None] Volume volume-66e08687-5fb6-4a8b-bcb9-635712c07549 (66e08687-5fb6-4a8b-bcb9-635712c07549): created successfully
Jul 09 14:40:45 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c76cfeb4-278c-4966-a3c4-7fcf29f9e5e4 tempest-VolumeQuotasAdminTestJSON-1297134694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df91cfc3-2486-4784-84fd-4f07530a0a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:40:45 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c76cfeb4-278c-4966-a3c4-7fcf29f9e5e4 tempest-VolumeQuotasAdminTestJSON-1297134694 None] Flow 'volume_create_manager' (eb04dfd1-31bc-4da2-9aa5-bda10efbddc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:40:45 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-bed9cb52-e804-4446-b3bd-384adc33197a tempest-SnapshotsActionsTest-1933512236 None] Lock "cinder-quobyte-29f428fb-5235-412a-98f9-1c121415ff54" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:40:45 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-bed9cb52-e804-4446-b3bd-384adc33197a tempest-SnapshotsActionsTest-1933512236 None] Acquiring lock "cinder-quobyte-9e0132d1-de38-4d07-8bbd-6bcb1a634a01" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:40:45 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-c76cfeb4-278c-4966-a3c4-7fcf29f9e5e4 tempest-VolumeQuotasAdminTestJSON-1297134694 None] Created volume successfully.
Jul 09 14:40:46 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-bed9cb52-e804-4446-b3bd-384adc33197a tempest-SnapshotsActionsTest-1933512236 None] Lock "cinder-quobyte-9e0132d1-de38-4d07-8bbd-6bcb1a634a01" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:40:46 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-bed9cb52-e804-4446-b3bd-384adc33197a tempest-SnapshotsActionsTest-1933512236 None] Deleting offline snapshot 9e0132d1-de38-4d07-8bbd-6bcb1a634a01 of volume 29f428fb-5235-412a-98f9-1c121415ff54 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 14:40:46 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-bed9cb52-e804-4446-b3bd-384adc33197a tempest-SnapshotsActionsTest-1933512236 None] snapshot_file for this snap is: volume-29f428fb-5235-412a-98f9-1c121415ff54.9e0132d1-de38-4d07-8bbd-6bcb1a634a01 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 14:40:46 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[e003bb3c-99f0-4b27-9d27-46b2379fa8ae]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:40:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-bed9cb52-e804-4446-b3bd-384adc33197a tempest-SnapshotsActionsTest-1933512236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.9e0132d1-de38-4d07-8bbd-6bcb1a634a01 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:46 devstack sudo[97633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08e6daa8-5ce8-4cd2-8e64-4df2bbb84823_k2_98ua4devstack@QuobyteHD
Jul 09 14:40:46 devstack sudo[97633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:46 devstack sudo[97634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.9e0132d1-de38-4d07-8bbd-6bcb1a634a01
Jul 09 14:40:46 devstack sudo[97634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:46 devstack sudo[97633]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a237badd-be07-4cfb-b287-015af4bbb3b0 tempest-TestInstancesWithCinderVolumes-1507168999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08e6daa8-5ce8-4cd2-8e64-4df2bbb84823_k2_98ua4devstack@QuobyteHD" returned: 0 in 0.799s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:46 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-a237badd-be07-4cfb-b287-015af4bbb3b0 tempest-TestInstancesWithCinderVolumes-1507168999 None] 08e6daa8-5ce8-4cd2-8e64-4df2bbb84823 was qcow2, converting to raw {{(pid=87230) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 09 14:40:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a237badd-be07-4cfb-b287-015af4bbb3b0 tempest-TestInstancesWithCinderVolumes-1507168999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_08e6daa8-5ce8-4cd2-8e64-4df2bbb84823_k2_98ua4devstack@QuobyteHD /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2daa519b-cac8-4271-9ebc-dc62c34f83fb {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:46 devstack sudo[97640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_08e6daa8-5ce8-4cd2-8e64-4df2bbb84823_k2_98ua4devstack@QuobyteHD /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2daa519b-cac8-4271-9ebc-dc62c34f83fb
Jul 09 14:40:46 devstack sudo[97640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:47 devstack sudo[97634]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-bed9cb52-e804-4446-b3bd-384adc33197a tempest-SnapshotsActionsTest-1933512236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.9e0132d1-de38-4d07-8bbd-6bcb1a634a01" returned: 0 in 0.944s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:47 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-bed9cb52-e804-4446-b3bd-384adc33197a tempest-SnapshotsActionsTest-1933512236 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29f428fb-5235-412a-98f9-1c121415ff54(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 14:40:47 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[daeb2bea-12e2-4c8c-a255-d7c217fc162e]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:40:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-bed9cb52-e804-4446-b3bd-384adc33197a tempest-SnapshotsActionsTest-1933512236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:47 devstack sudo[97616]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ecd3be9d-d37c-4e3f-b759-97d3023230b6 tempest-VolumesExtendTest-1843197783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5eba314f-9adb-4fc7-aaad-9e9a3b7dae70_oy0nostsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7d17241d-9a43-49fb-ab93-138e06235f8b" returned: 0 in 2.176s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:47 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-ecd3be9d-d37c-4e3f-b759-97d3023230b6 tempest-VolumesExtendTest-1843197783 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5eba314f-9adb-4fc7-aaad-9e9a3b7dae70_oy0nostsdevstack@QuobyteHD, size 112.00 MB, duration 2.18 sec, destination /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7d17241d-9a43-49fb-ab93-138e06235f8b {{(pid=87230) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 09 14:40:47 devstack cinder-volume[87230]: INFO cinder.image.image_utils [None req-ecd3be9d-d37c-4e3f-b759-97d3023230b6 tempest-VolumesExtendTest-1843197783 None] Converted 112.00 MB image at 51.43 MB/s
Jul 09 14:40:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ecd3be9d-d37c-4e3f-b759-97d3023230b6 tempest-VolumesExtendTest-1843197783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7d17241d-9a43-49fb-ab93-138e06235f8b 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:47 devstack sudo[97646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7d17241d-9a43-49fb-ab93-138e06235f8b 1G
Jul 09 14:40:47 devstack sudo[97646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:47 devstack sudo[97645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54
Jul 09 14:40:47 devstack sudo[97645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:47 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a7fd6936-89fe-4a5e-a7aa-a6bf302db3c5 tempest-VolumeQuotasAdminTestJSON-1297134694 None] Acquiring lock "cinder-66e08687-5fb6-4a8b-bcb9-635712c07549-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:40:47 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a7fd6936-89fe-4a5e-a7aa-a6bf302db3c5 tempest-VolumeQuotasAdminTestJSON-1297134694 None] Lock "cinder-66e08687-5fb6-4a8b-bcb9-635712c07549-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:40:47 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a7fd6936-89fe-4a5e-a7aa-a6bf302db3c5 tempest-VolumeQuotasAdminTestJSON-1297134694 None] Acquiring lock "cinder-quobyte-66e08687-5fb6-4a8b-bcb9-635712c07549" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:40:47 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a7fd6936-89fe-4a5e-a7aa-a6bf302db3c5 tempest-VolumeQuotasAdminTestJSON-1297134694 None] Lock "cinder-quobyte-66e08687-5fb6-4a8b-bcb9-635712c07549" acquired by "delete_volume" :: waited 0.017s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:40:47 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b62ab3e-0b88-490d-9983-20305f0cbed3]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:40:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a7fd6936-89fe-4a5e-a7aa-a6bf302db3c5 tempest-VolumeQuotasAdminTestJSON-1297134694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-66e08687-5fb6-4a8b-bcb9-635712c07549 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:47 devstack sudo[97649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-66e08687-5fb6-4a8b-bcb9-635712c07549
Jul 09 14:40:47 devstack sudo[97649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:47 devstack sudo[97646]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ecd3be9d-d37c-4e3f-b759-97d3023230b6 tempest-VolumesExtendTest-1843197783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7d17241d-9a43-49fb-ab93-138e06235f8b 1G" returned: 0 in 0.859s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:48 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[93b34090-fe37-476b-aaef-a597c3e8b3bb]: (4, 'raw') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:40:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ecd3be9d-d37c-4e3f-b759-97d3023230b6 tempest-VolumesExtendTest-1843197783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7d17241d-9a43-49fb-ab93-138e06235f8b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:48 devstack sudo[97645]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-bed9cb52-e804-4446-b3bd-384adc33197a tempest-SnapshotsActionsTest-1933512236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54" returned: 0 in 1.006s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-bed9cb52-e804-4446-b3bd-384adc33197a tempest-SnapshotsActionsTest-1933512236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.9e0132d1-de38-4d07-8bbd-6bcb1a634a01 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:48 devstack sudo[97665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.9e0132d1-de38-4d07-8bbd-6bcb1a634a01
Jul 09 14:40:48 devstack sudo[97665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:48 devstack sudo[97664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7d17241d-9a43-49fb-ab93-138e06235f8b
Jul 09 14:40:48 devstack sudo[97664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:48 devstack sudo[97649]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a7fd6936-89fe-4a5e-a7aa-a6bf302db3c5 tempest-VolumeQuotasAdminTestJSON-1297134694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-66e08687-5fb6-4a8b-bcb9-635712c07549" returned: 0 in 1.174s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a7fd6936-89fe-4a5e-a7aa-a6bf302db3c5 tempest-VolumeQuotasAdminTestJSON-1297134694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-66e08687-5fb6-4a8b-bcb9-635712c07549 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:48 devstack sudo[97671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-66e08687-5fb6-4a8b-bcb9-635712c07549
Jul 09 14:40:48 devstack sudo[97671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:48 devstack sudo[97664]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ecd3be9d-d37c-4e3f-b759-97d3023230b6 tempest-VolumesExtendTest-1843197783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7d17241d-9a43-49fb-ab93-138e06235f8b" returned: 0 in 0.836s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ecd3be9d-d37c-4e3f-b759-97d3023230b6 tempest-VolumesExtendTest-1843197783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7d17241d-9a43-49fb-ab93-138e06235f8b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:48 devstack sudo[97665]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-bed9cb52-e804-4446-b3bd-384adc33197a tempest-SnapshotsActionsTest-1933512236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.9e0132d1-de38-4d07-8bbd-6bcb1a634a01" returned: 0 in 0.840s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-bed9cb52-e804-4446-b3bd-384adc33197a tempest-SnapshotsActionsTest-1933512236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.9e0132d1-de38-4d07-8bbd-6bcb1a634a01 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:48 devstack sudo[97679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.9e0132d1-de38-4d07-8bbd-6bcb1a634a01
Jul 09 14:40:48 devstack sudo[97679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:48 devstack sudo[97640]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a237badd-be07-4cfb-b287-015af4bbb3b0 tempest-TestInstancesWithCinderVolumes-1507168999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_08e6daa8-5ce8-4cd2-8e64-4df2bbb84823_k2_98ua4devstack@QuobyteHD /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2daa519b-cac8-4271-9ebc-dc62c34f83fb" returned: 0 in 2.257s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:48 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-a237badd-be07-4cfb-b287-015af4bbb3b0 tempest-TestInstancesWithCinderVolumes-1507168999 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_08e6daa8-5ce8-4cd2-8e64-4df2bbb84823_k2_98ua4devstack@QuobyteHD, size 112.00 MB, duration 2.26 sec, destination /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2daa519b-cac8-4271-9ebc-dc62c34f83fb {{(pid=87230) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 09 14:40:48 devstack cinder-volume[87230]: INFO cinder.image.image_utils [None req-a237badd-be07-4cfb-b287-015af4bbb3b0 tempest-TestInstancesWithCinderVolumes-1507168999 None] Converted 112.00 MB image at 49.60 MB/s
Jul 09 14:40:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a237badd-be07-4cfb-b287-015af4bbb3b0 tempest-TestInstancesWithCinderVolumes-1507168999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2daa519b-cac8-4271-9ebc-dc62c34f83fb 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:49 devstack sudo[97681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2daa519b-cac8-4271-9ebc-dc62c34f83fb 1G
Jul 09 14:40:49 devstack sudo[97681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:49 devstack sudo[97678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7d17241d-9a43-49fb-ab93-138e06235f8b
Jul 09 14:40:49 devstack sudo[97678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:49 devstack sudo[97671]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a7fd6936-89fe-4a5e-a7aa-a6bf302db3c5 tempest-VolumeQuotasAdminTestJSON-1297134694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-66e08687-5fb6-4a8b-bcb9-635712c07549" returned: 0 in 0.771s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:49 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a7fd6936-89fe-4a5e-a7aa-a6bf302db3c5 tempest-VolumeQuotasAdminTestJSON-1297134694 None] Lock "cinder-quobyte-66e08687-5fb6-4a8b-bcb9-635712c07549" released by "delete_volume" :: held 2.001s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:40:49 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-a7fd6936-89fe-4a5e-a7aa-a6bf302db3c5 tempest-VolumeQuotasAdminTestJSON-1297134694 None] Created reservations ['28ef560f-8e52-4ae9-8b89-cd1c364df890', 'ba8968bc-b634-46c3-9902-057bb1dd5f27', 'bc4b2038-b9a0-4ba0-99b7-33bdddd500ea', '32982ae3-768a-42ec-9f21-fddab33f24a7'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:40:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a7fd6936-89fe-4a5e-a7aa-a6bf302db3c5 tempest-VolumeQuotasAdminTestJSON-1297134694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:40:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a7fd6936-89fe-4a5e-a7aa-a6bf302db3c5 tempest-VolumeQuotasAdminTestJSON-1297134694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:40:49 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a7fd6936-89fe-4a5e-a7aa-a6bf302db3c5 tempest-VolumeQuotasAdminTestJSON-1297134694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:40:49 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a7fd6936-89fe-4a5e-a7aa-a6bf302db3c5 tempest-VolumeQuotasAdminTestJSON-1297134694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:40:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a7fd6936-89fe-4a5e-a7aa-a6bf302db3c5 tempest-VolumeQuotasAdminTestJSON-1297134694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:40:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a7fd6936-89fe-4a5e-a7aa-a6bf302db3c5 tempest-VolumeQuotasAdminTestJSON-1297134694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:49 devstack sudo[97685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:40:49 devstack sudo[97685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:49 devstack sudo[97679]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-bed9cb52-e804-4446-b3bd-384adc33197a tempest-SnapshotsActionsTest-1933512236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54.9e0132d1-de38-4d07-8bbd-6bcb1a634a01" returned: 0 in 0.780s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:49 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-bed9cb52-e804-4446-b3bd-384adc33197a tempest-SnapshotsActionsTest-1933512236 None] Lock "cinder-quobyte-9e0132d1-de38-4d07-8bbd-6bcb1a634a01" released by "_delete_snapshot" :: held 3.771s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:40:49 devstack sudo[97681]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a237badd-be07-4cfb-b287-015af4bbb3b0 tempest-TestInstancesWithCinderVolumes-1507168999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2daa519b-cac8-4271-9ebc-dc62c34f83fb 1G" returned: 0 in 0.786s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:49 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-bed9cb52-e804-4446-b3bd-384adc33197a tempest-SnapshotsActionsTest-1933512236 None] Lock "cinder-quobyte-29f428fb-5235-412a-98f9-1c121415ff54" released by "delete_snapshot" :: held 3.809s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:40:49 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[35adae8b-d387-4e39-8238-12e334aea1af]: (4, 'raw') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:40:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a237badd-be07-4cfb-b287-015af4bbb3b0 tempest-TestInstancesWithCinderVolumes-1507168999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2daa519b-cac8-4271-9ebc-dc62c34f83fb {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:49 devstack sudo[97678]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ecd3be9d-d37c-4e3f-b759-97d3023230b6 tempest-VolumesExtendTest-1843197783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7d17241d-9a43-49fb-ab93-138e06235f8b" returned: 1 in 1.022s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ecd3be9d-d37c-4e3f-b759-97d3023230b6 tempest-VolumesExtendTest-1843197783 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7d17241d-9a43-49fb-ab93-138e06235f8b' failed. Not Retrying. {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 09 14:40:49 devstack cinder-volume[87230]: DEBUG cinder.volume.volume_utils [None req-ecd3be9d-d37c-4e3f-b759-97d3023230b6 tempest-VolumesExtendTest-1843197783 None] Downloaded image 5eba314f-9adb-4fc7-aaad-9e9a3b7dae70 ((None, [{'url': 'file:///opt/stack/data/glance/images/5eba314f-9adb-4fc7-aaad-9e9a3b7dae70', 'metadata': {}}])) to volume 7d17241d-9a43-49fb-ab93-138e06235f8b successfully. {{(pid=87230) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 09 14:40:49 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-ecd3be9d-d37c-4e3f-b759-97d3023230b6 tempest-VolumesExtendTest-1843197783 None] Temporary image 5eba314f-9adb-4fc7-aaad-9e9a3b7dae70 for user 711195e602864fcf85875a54368e16f7 is deleted. {{(pid=87230) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 09 14:40:49 devstack cinder-volume[87230]: DEBUG cinder.volume.volume_utils [None req-ecd3be9d-d37c-4e3f-b759-97d3023230b6 tempest-VolumesExtendTest-1843197783 None] Marking volume 7d17241d-9a43-49fb-ab93-138e06235f8b as bootable. {{(pid=87230) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 09 14:40:49 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecd3be9d-d37c-4e3f-b759-97d3023230b6 tempest-VolumesExtendTest-1843197783 None] Copying metadata from image 5eba314f-9adb-4fc7-aaad-9e9a3b7dae70 to 7d17241d-9a43-49fb-ab93-138e06235f8b. {{(pid=87230) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 09 14:40:49 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecd3be9d-d37c-4e3f-b759-97d3023230b6 tempest-VolumesExtendTest-1843197783 None] Creating volume glance metadata for volume 7d17241d-9a43-49fb-ab93-138e06235f8b backed by image 5eba314f-9adb-4fc7-aaad-9e9a3b7dae70 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5eba314f-9adb-4fc7-aaad-9e9a3b7dae70', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87230) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 09 14:40:50 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-bed9cb52-e804-4446-b3bd-384adc33197a tempest-SnapshotsActionsTest-1933512236 None] Created reservations ['f5ede141-0962-4fd5-9f6e-dbffc15e8dd2', '34e65509-3c67-45cc-90f2-f0253cbcf904', '1c5982b9-2f45-4567-8d43-30f2d0621f25', '4d8ff55d-0eb1-4e9d-8018-0504c94f1bf9'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:40:50 devstack sudo[97694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2daa519b-cac8-4271-9ebc-dc62c34f83fb
Jul 09 14:40:50 devstack sudo[97694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:50 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ecd3be9d-d37c-4e3f-b759-97d3023230b6 tempest-VolumesExtendTest-1843197783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f07eac07-0c2f-450a-93dc-f30a43e18f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d17241d-9a43-49fb-ab93-138e06235f8b', 'volume_size': 1, 'image_id': '5eba314f-9adb-4fc7-aaad-9e9a3b7dae70', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5eba314f-9adb-4fc7-aaad-9e9a3b7dae70', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '10a7640b39774d00a67b2de818bf4a10', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5eba314f-9adb-4fc7-aaad-9e9a3b7dae70', 'created_at': datetime.datetime(2026, 7, 9, 12, 24, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 12, 24, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5eba314f-9adb-4fc7-aaad-9e9a3b7dae70/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x720a544bfcb0>}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:40:50 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ecd3be9d-d37c-4e3f-b759-97d3023230b6 tempest-VolumesExtendTest-1843197783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7b2f8fe-a8ed-43d8-8e50-d8c5f0ec6020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:40:50 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-ecd3be9d-d37c-4e3f-b759-97d3023230b6 tempest-VolumesExtendTest-1843197783 None] Volume volume-7d17241d-9a43-49fb-ab93-138e06235f8b (7d17241d-9a43-49fb-ab93-138e06235f8b): created successfully
Jul 09 14:40:50 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ecd3be9d-d37c-4e3f-b759-97d3023230b6 tempest-VolumesExtendTest-1843197783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7b2f8fe-a8ed-43d8-8e50-d8c5f0ec6020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:40:50 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ecd3be9d-d37c-4e3f-b759-97d3023230b6 tempest-VolumesExtendTest-1843197783 None] Flow 'volume_create_manager' (7d18c904-990d-450f-a809-c3fa07c20f0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:40:50 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-bed9cb52-e804-4446-b3bd-384adc33197a tempest-SnapshotsActionsTest-1933512236 None] Delete snapshot completed successfully.
Jul 09 14:40:50 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-bed9cb52-e804-4446-b3bd-384adc33197a tempest-SnapshotsActionsTest-1933512236 None] Lock "cinder-9e0132d1-de38-4d07-8bbd-6bcb1a634a01-delete_snapshot" released by "delete_snapshot" :: held 4.259s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:40:50 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-ecd3be9d-d37c-4e3f-b759-97d3023230b6 tempest-VolumesExtendTest-1843197783 None] Created volume successfully.
Jul 09 14:40:50 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-b737cc05-b421-4e83-9e2c-033bb6d0ba9f tempest-VolumeQuotasAdminTestJSON-1297134694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:40:50 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b737cc05-b421-4e83-9e2c-033bb6d0ba9f tempest-VolumeQuotasAdminTestJSON-1297134694 None] Flow 'volume_create_manager' (392f3334-449f-4fda-bb15-802b24c44baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:40:50 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b737cc05-b421-4e83-9e2c-033bb6d0ba9f tempest-VolumeQuotasAdminTestJSON-1297134694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2ee7aad-33c7-4872-aa23-d97c283ebd8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:40:50 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3d28a851-3990-4d82-82a8-c2f49664175c tempest-SnapshotsActionsTest-1933512236 None] Acquiring lock "cinder-29f428fb-5235-412a-98f9-1c121415ff54-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:40:50 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b737cc05-b421-4e83-9e2c-033bb6d0ba9f tempest-VolumeQuotasAdminTestJSON-1297134694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2ee7aad-33c7-4872-aa23-d97c283ebd8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:40:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1125625541',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18974c4a-5523-4ffd-8374-1f9520486058,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='775e9ad5495540f599c1dc417a08068e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:40:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:40:50Z,use_quota=True,user_id='ae34a069f26742debbeb04ce03d49836',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:40:50 devstack sudo[97685]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:50 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b737cc05-b421-4e83-9e2c-033bb6d0ba9f tempest-VolumeQuotasAdminTestJSON-1297134694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa7ce732-cbcf-4504-be4c-be58b1a96707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:40:50 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b737cc05-b421-4e83-9e2c-033bb6d0ba9f tempest-VolumeQuotasAdminTestJSON-1297134694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa7ce732-cbcf-4504-be4c-be58b1a96707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:40:50 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b737cc05-b421-4e83-9e2c-033bb6d0ba9f tempest-VolumeQuotasAdminTestJSON-1297134694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6b16107-49bf-4c94-95d3-49a0645061b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:40:50 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b737cc05-b421-4e83-9e2c-033bb6d0ba9f tempest-VolumeQuotasAdminTestJSON-1297134694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6b16107-49bf-4c94-95d3-49a0645061b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18974c4a-5523-4ffd-8374-1f9520486058', 'volume_name': 'volume-18974c4a-5523-4ffd-8374-1f9520486058', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:40:50 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b737cc05-b421-4e83-9e2c-033bb6d0ba9f tempest-VolumeQuotasAdminTestJSON-1297134694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eeb29388-a835-49e9-acd8-2a11f58436fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:40:50 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b737cc05-b421-4e83-9e2c-033bb6d0ba9f tempest-VolumeQuotasAdminTestJSON-1297134694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eeb29388-a835-49e9-acd8-2a11f58436fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:40:50 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b737cc05-b421-4e83-9e2c-033bb6d0ba9f tempest-VolumeQuotasAdminTestJSON-1297134694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d93c61e-9949-4f83-82d4-0928438797b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:40:50 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-b737cc05-b421-4e83-9e2c-033bb6d0ba9f tempest-VolumeQuotasAdminTestJSON-1297134694 None] Volume 18974c4a-5523-4ffd-8374-1f9520486058: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18974c4a-5523-4ffd-8374-1f9520486058', 'volume_size': 1}
Jul 09 14:40:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b737cc05-b421-4e83-9e2c-033bb6d0ba9f tempest-VolumeQuotasAdminTestJSON-1297134694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:40:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b737cc05-b421-4e83-9e2c-033bb6d0ba9f tempest-VolumeQuotasAdminTestJSON-1297134694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:40:50 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b737cc05-b421-4e83-9e2c-033bb6d0ba9f tempest-VolumeQuotasAdminTestJSON-1297134694 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:40:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1125625541',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18974c4a-5523-4ffd-8374-1f9520486058,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='775e9ad5495540f599c1dc417a08068e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:40:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:40:50Z,use_quota=True,user_id='ae34a069f26742debbeb04ce03d49836',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:40:50 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-b737cc05-b421-4e83-9e2c-033bb6d0ba9f tempest-VolumeQuotasAdminTestJSON-1297134694 None] Creating volume 18974c4a-5523-4ffd-8374-1f9520486058 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:40:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b737cc05-b421-4e83-9e2c-033bb6d0ba9f tempest-VolumeQuotasAdminTestJSON-1297134694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:40:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b737cc05-b421-4e83-9e2c-033bb6d0ba9f tempest-VolumeQuotasAdminTestJSON-1297134694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:40:50 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b737cc05-b421-4e83-9e2c-033bb6d0ba9f tempest-VolumeQuotasAdminTestJSON-1297134694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:40:50 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b737cc05-b421-4e83-9e2c-033bb6d0ba9f tempest-VolumeQuotasAdminTestJSON-1297134694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:40:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b737cc05-b421-4e83-9e2c-033bb6d0ba9f tempest-VolumeQuotasAdminTestJSON-1297134694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:40:50 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b737cc05-b421-4e83-9e2c-033bb6d0ba9f tempest-VolumeQuotasAdminTestJSON-1297134694 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:40:50 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-b737cc05-b421-4e83-9e2c-033bb6d0ba9f tempest-VolumeQuotasAdminTestJSON-1297134694 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:40:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b737cc05-b421-4e83-9e2c-033bb6d0ba9f tempest-VolumeQuotasAdminTestJSON-1297134694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-18974c4a-5523-4ffd-8374-1f9520486058 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:50 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3d28a851-3990-4d82-82a8-c2f49664175c tempest-SnapshotsActionsTest-1933512236 None] Lock "cinder-29f428fb-5235-412a-98f9-1c121415ff54-delete_volume" acquired by "delete_volume" :: waited 0.097s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:40:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a7fd6936-89fe-4a5e-a7aa-a6bf302db3c5 tempest-VolumeQuotasAdminTestJSON-1297134694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.983s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:50 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-a7fd6936-89fe-4a5e-a7aa-a6bf302db3c5 tempest-VolumeQuotasAdminTestJSON-1297134694 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:40:50 devstack sudo[97698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-18974c4a-5523-4ffd-8374-1f9520486058 1073741824
Jul 09 14:40:50 devstack sudo[97698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:50 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-a7fd6936-89fe-4a5e-a7aa-a6bf302db3c5 tempest-VolumeQuotasAdminTestJSON-1297134694 None] Deleted volume successfully.
Jul 09 14:40:50 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3d28a851-3990-4d82-82a8-c2f49664175c tempest-SnapshotsActionsTest-1933512236 None] Acquiring lock "cinder-quobyte-29f428fb-5235-412a-98f9-1c121415ff54" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:40:50 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a7fd6936-89fe-4a5e-a7aa-a6bf302db3c5 tempest-VolumeQuotasAdminTestJSON-1297134694 None] Lock "cinder-66e08687-5fb6-4a8b-bcb9-635712c07549-delete_volume" released by "delete_volume" :: held 3.226s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:40:50 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3d28a851-3990-4d82-82a8-c2f49664175c tempest-SnapshotsActionsTest-1933512236 None] Lock "cinder-quobyte-29f428fb-5235-412a-98f9-1c121415ff54" acquired by "delete_volume" :: waited 0.017s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:40:50 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[e18c69b9-c786-431f-aefc-47e2424c2f04]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:40:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3d28a851-3990-4d82-82a8-c2f49664175c tempest-SnapshotsActionsTest-1933512236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:50 devstack sudo[97700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54
Jul 09 14:40:50 devstack sudo[97700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:50 devstack sudo[97694]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a237badd-be07-4cfb-b287-015af4bbb3b0 tempest-TestInstancesWithCinderVolumes-1507168999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2daa519b-cac8-4271-9ebc-dc62c34f83fb" returned: 0 in 1.003s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a237badd-be07-4cfb-b287-015af4bbb3b0 tempest-TestInstancesWithCinderVolumes-1507168999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2daa519b-cac8-4271-9ebc-dc62c34f83fb {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:50 devstack sudo[97704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2daa519b-cac8-4271-9ebc-dc62c34f83fb
Jul 09 14:40:50 devstack sudo[97704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:51 devstack sudo[97698]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e43e078b-94d4-4f07-b2c8-8fadb2940b79 tempest-VolumesExtendTest-1843197783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:40:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b737cc05-b421-4e83-9e2c-033bb6d0ba9f tempest-VolumeQuotasAdminTestJSON-1297134694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-18974c4a-5523-4ffd-8374-1f9520486058 1073741824" returned: 0 in 0.955s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:51 devstack sudo[97700]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b737cc05-b421-4e83-9e2c-033bb6d0ba9f tempest-VolumeQuotasAdminTestJSON-1297134694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-18974c4a-5523-4ffd-8374-1f9520486058 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3d28a851-3990-4d82-82a8-c2f49664175c tempest-SnapshotsActionsTest-1933512236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54" returned: 0 in 0.915s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3d28a851-3990-4d82-82a8-c2f49664175c tempest-SnapshotsActionsTest-1933512236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:51 devstack sudo[97714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-18974c4a-5523-4ffd-8374-1f9520486058
Jul 09 14:40:51 devstack sudo[97714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:51 devstack sudo[97715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54
Jul 09 14:40:51 devstack sudo[97715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:51 devstack sudo[97704]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a237badd-be07-4cfb-b287-015af4bbb3b0 tempest-TestInstancesWithCinderVolumes-1507168999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2daa519b-cac8-4271-9ebc-dc62c34f83fb" returned: 1 in 0.960s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a237badd-be07-4cfb-b287-015af4bbb3b0 tempest-TestInstancesWithCinderVolumes-1507168999 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2daa519b-cac8-4271-9ebc-dc62c34f83fb' failed. Not Retrying. {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 09 14:40:51 devstack cinder-volume[87230]: DEBUG cinder.volume.volume_utils [None req-a237badd-be07-4cfb-b287-015af4bbb3b0 tempest-TestInstancesWithCinderVolumes-1507168999 None] Downloaded image 08e6daa8-5ce8-4cd2-8e64-4df2bbb84823 ((None, [{'url': 'file:///opt/stack/data/glance/images/08e6daa8-5ce8-4cd2-8e64-4df2bbb84823', 'metadata': {}}])) to volume 2daa519b-cac8-4271-9ebc-dc62c34f83fb successfully. {{(pid=87230) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 09 14:40:51 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-a237badd-be07-4cfb-b287-015af4bbb3b0 tempest-TestInstancesWithCinderVolumes-1507168999 None] Temporary image 08e6daa8-5ce8-4cd2-8e64-4df2bbb84823 for user 4ae993e4d1df42e986fb68763b0a4b66 is deleted. {{(pid=87230) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 09 14:40:51 devstack cinder-volume[87230]: DEBUG cinder.volume.volume_utils [None req-a237badd-be07-4cfb-b287-015af4bbb3b0 tempest-TestInstancesWithCinderVolumes-1507168999 None] Marking volume 2daa519b-cac8-4271-9ebc-dc62c34f83fb as bootable. {{(pid=87230) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 09 14:40:51 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-a237badd-be07-4cfb-b287-015af4bbb3b0 tempest-TestInstancesWithCinderVolumes-1507168999 None] Copying metadata from image 08e6daa8-5ce8-4cd2-8e64-4df2bbb84823 to 2daa519b-cac8-4271-9ebc-dc62c34f83fb. {{(pid=87230) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 09 14:40:51 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-a237badd-be07-4cfb-b287-015af4bbb3b0 tempest-TestInstancesWithCinderVolumes-1507168999 None] Creating volume glance metadata for volume 2daa519b-cac8-4271-9ebc-dc62c34f83fb backed by image 08e6daa8-5ce8-4cd2-8e64-4df2bbb84823 with: {'image_id': '08e6daa8-5ce8-4cd2-8e64-4df2bbb84823', 'image_name': 'tempest-scenario-img--2112186624', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87230) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 09 14:40:51 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a237badd-be07-4cfb-b287-015af4bbb3b0 tempest-TestInstancesWithCinderVolumes-1507168999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7479d7fa-96a3-49ba-ad47-ac1f5e75fcbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2daa519b-cac8-4271-9ebc-dc62c34f83fb', 'volume_size': 1, 'image_id': '08e6daa8-5ce8-4cd2-8e64-4df2bbb84823', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/08e6daa8-5ce8-4cd2-8e64-4df2bbb84823', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2112186624', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5d8059ec86374956a065be7130e3147d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '08e6daa8-5ce8-4cd2-8e64-4df2bbb84823', 'created_at': datetime.datetime(2026, 7, 9, 12, 40, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 12, 40, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/08e6daa8-5ce8-4cd2-8e64-4df2bbb84823/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x720a548afd40>}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:40:51 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a237badd-be07-4cfb-b287-015af4bbb3b0 tempest-TestInstancesWithCinderVolumes-1507168999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c4027bc-2f21-4732-be57-81d42d254ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:40:51 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-a237badd-be07-4cfb-b287-015af4bbb3b0 tempest-TestInstancesWithCinderVolumes-1507168999 None] Volume volume-2daa519b-cac8-4271-9ebc-dc62c34f83fb (2daa519b-cac8-4271-9ebc-dc62c34f83fb): created successfully
Jul 09 14:40:51 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a237badd-be07-4cfb-b287-015af4bbb3b0 tempest-TestInstancesWithCinderVolumes-1507168999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c4027bc-2f21-4732-be57-81d42d254ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:40:51 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a237badd-be07-4cfb-b287-015af4bbb3b0 tempest-TestInstancesWithCinderVolumes-1507168999 None] Flow 'volume_create_manager' (ff9cb0ac-8e30-4b27-99f0-f0a98d4df900) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:40:51 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-a237badd-be07-4cfb-b287-015af4bbb3b0 tempest-TestInstancesWithCinderVolumes-1507168999 None] Created volume successfully.
Jul 09 14:40:52 devstack sudo[97715]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3d28a851-3990-4d82-82a8-c2f49664175c tempest-SnapshotsActionsTest-1933512236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29f428fb-5235-412a-98f9-1c121415ff54" returned: 0 in 0.678s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:52 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3d28a851-3990-4d82-82a8-c2f49664175c tempest-SnapshotsActionsTest-1933512236 None] Lock "cinder-quobyte-29f428fb-5235-412a-98f9-1c121415ff54" released by "delete_volume" :: held 1.647s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:40:52 devstack sudo[97714]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b737cc05-b421-4e83-9e2c-033bb6d0ba9f tempest-VolumeQuotasAdminTestJSON-1297134694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-18974c4a-5523-4ffd-8374-1f9520486058" returned: 0 in 0.744s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:52 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b737cc05-b421-4e83-9e2c-033bb6d0ba9f tempest-VolumeQuotasAdminTestJSON-1297134694 None] <== create_volume: return (1763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:40:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b737cc05-b421-4e83-9e2c-033bb6d0ba9f tempest-VolumeQuotasAdminTestJSON-1297134694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.766s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:40:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e43e078b-94d4-4f07-b2c8-8fadb2940b79 tempest-VolumesExtendTest-1843197783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.808s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:40:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b737cc05-b421-4e83-9e2c-033bb6d0ba9f tempest-VolumeQuotasAdminTestJSON-1297134694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d93c61e-9949-4f83-82d4-0928438797b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18974c4a-5523-4ffd-8374-1f9520486058', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:40:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b737cc05-b421-4e83-9e2c-033bb6d0ba9f tempest-VolumeQuotasAdminTestJSON-1297134694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c406b83-961c-460e-b9cd-8f80917242f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:40:52 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[4504afa8-7c4d-48ef-b311-0ba4a34367a7]: (4, 'raw') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:40:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e43e078b-94d4-4f07-b2c8-8fadb2940b79 tempest-VolumesExtendTest-1843197783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7d17241d-9a43-49fb-ab93-138e06235f8b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:52 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-3d28a851-3990-4d82-82a8-c2f49664175c tempest-SnapshotsActionsTest-1933512236 None] Created reservations ['46290888-3cfa-443c-a6c2-c74f195b96d6', '3804f445-0536-418a-beed-eb21d84fd672', 'be75cea3-78b4-40a0-a6f8-8ce053813e1d', '492107aa-ce33-4653-9a00-bd09c58e0676'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:40:52 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-b737cc05-b421-4e83-9e2c-033bb6d0ba9f tempest-VolumeQuotasAdminTestJSON-1297134694 None] Volume volume-18974c4a-5523-4ffd-8374-1f9520486058 (18974c4a-5523-4ffd-8374-1f9520486058): created successfully
Jul 09 14:40:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b737cc05-b421-4e83-9e2c-033bb6d0ba9f tempest-VolumeQuotasAdminTestJSON-1297134694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c406b83-961c-460e-b9cd-8f80917242f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:40:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b737cc05-b421-4e83-9e2c-033bb6d0ba9f tempest-VolumeQuotasAdminTestJSON-1297134694 None] Flow 'volume_create_manager' (392f3334-449f-4fda-bb15-802b24c44baf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:40:52 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-b737cc05-b421-4e83-9e2c-033bb6d0ba9f tempest-VolumeQuotasAdminTestJSON-1297134694 None] Created volume successfully.
Jul 09 14:40:52 devstack sudo[97723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7d17241d-9a43-49fb-ab93-138e06235f8b
Jul 09 14:40:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3d28a851-3990-4d82-82a8-c2f49664175c tempest-SnapshotsActionsTest-1933512236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:40:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3d28a851-3990-4d82-82a8-c2f49664175c tempest-SnapshotsActionsTest-1933512236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:40:52 devstack sudo[97723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:52 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3d28a851-3990-4d82-82a8-c2f49664175c tempest-SnapshotsActionsTest-1933512236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:40:52 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3d28a851-3990-4d82-82a8-c2f49664175c tempest-SnapshotsActionsTest-1933512236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:40:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3d28a851-3990-4d82-82a8-c2f49664175c tempest-SnapshotsActionsTest-1933512236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:40:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3d28a851-3990-4d82-82a8-c2f49664175c tempest-SnapshotsActionsTest-1933512236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:52 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 14:40:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:40:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:40:52 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:40:52 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:40:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:40:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:52 devstack sudo[97725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:40:52 devstack sudo[97725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:52 devstack sudo[97727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:40:52 devstack sudo[97727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:53 devstack sudo[97725]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3d28a851-3990-4d82-82a8-c2f49664175c tempest-SnapshotsActionsTest-1933512236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.859s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:53 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-3d28a851-3990-4d82-82a8-c2f49664175c tempest-SnapshotsActionsTest-1933512236 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:40:53 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-3d28a851-3990-4d82-82a8-c2f49664175c tempest-SnapshotsActionsTest-1933512236 None] Deleted volume successfully.
Jul 09 14:40:53 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3d28a851-3990-4d82-82a8-c2f49664175c tempest-SnapshotsActionsTest-1933512236 None] Lock "cinder-29f428fb-5235-412a-98f9-1c121415ff54-delete_volume" released by "delete_volume" :: held 2.837s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:40:53 devstack sudo[97727]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 1.005s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:53 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:40:53 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Running periodic task VolumeManager._thread_info {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 14:40:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] thread count: 28 {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 09 14:40:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] thread info: [<_MainThread(MainThread, started 125388812103808)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125388713797504)>, <Thread(Thread-3 (stat_writer), started daemon 125388699995392)>, <Thread(Rabbit-heartbeat, started daemon 125388700522560)>, <Thread(Thread-5 (_runner), started daemon 125388698545216)>, <Thread(Thread-7 (_runner), started daemon 125388698611264)>, <Thread(fd_logger, started daemon 125388703020672)>, <Thread(privsep_reader, started daemon 125388696441088)>, <Thread(tpool_thread_0, started daemon 125388687943360)>, <Thread(tpool_thread_1, started daemon 125388679550656)>, <Thread(tpool_thread_2, started daemon 125388671141568)>, <Thread(tpool_thread_3, started daemon 125388662732480)>, <Thread(tpool_thread_4, started daemon 125388654323392)>, <Thread(tpool_thread_5, started daemon 125388645914304)>, <Thread(tpool_thread_6, started daemon 125388637505216)>, <Thread(tpool_thread_7, started daemon 125388629096128)>, <Thread(tpool_thread_8, started daemon 125388620687040)>, <Thread(tpool_thread_9, started daemon 125388612277952)>, <Thread(tpool_thread_10, started daemon 125388603868864)>, <Thread(tpool_thread_11, started daemon 125388595459776)>, <Thread(tpool_thread_12, started daemon 125388587050688)>, <Thread(tpool_thread_13, started daemon 125388578641600)>, <Thread(tpool_thread_14, started daemon 125388570232512)>, <Thread(tpool_thread_15, started daemon 125388561823424)>, <Thread(tpool_thread_16, started daemon 125388553414336)>, <Thread(tpool_thread_17, started daemon 125388545005248)>, <Thread(tpool_thread_18, started daemon 125388536596160)>, <Thread(tpool_thread_19, started daemon 125388528187072)>] {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 09 14:40:53 devstack sudo[97723]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e43e078b-94d4-4f07-b2c8-8fadb2940b79 tempest-VolumesExtendTest-1843197783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7d17241d-9a43-49fb-ab93-138e06235f8b" returned: 0 in 1.230s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e43e078b-94d4-4f07-b2c8-8fadb2940b79 tempest-VolumesExtendTest-1843197783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7d17241d-9a43-49fb-ab93-138e06235f8b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:53 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-036f3cf8-aae1-4252-864b-388c783e6b51 tempest-VolumeQuotasAdminTestJSON-1650948601 None] Transfer volume completed successfully.
Jul 09 14:40:53 devstack sudo[97734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7d17241d-9a43-49fb-ab93-138e06235f8b
Jul 09 14:40:53 devstack sudo[97734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:54 devstack sudo[97734]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e43e078b-94d4-4f07-b2c8-8fadb2940b79 tempest-VolumesExtendTest-1843197783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7d17241d-9a43-49fb-ab93-138e06235f8b" returned: 1 in 1.010s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e43e078b-94d4-4f07-b2c8-8fadb2940b79 tempest-VolumesExtendTest-1843197783 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7d17241d-9a43-49fb-ab93-138e06235f8b' failed. Not Retrying. {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 09 14:40:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e43e078b-94d4-4f07-b2c8-8fadb2940b79 tempest-VolumesExtendTest-1843197783 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7d17241d-9a43-49fb-ab93-138e06235f8b 2G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e43e078b-94d4-4f07-b2c8-8fadb2940b79 tempest-VolumesExtendTest-1843197783 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7d17241d-9a43-49fb-ab93-138e06235f8b 2G" returned: 0 in 0.106s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e43e078b-94d4-4f07-b2c8-8fadb2940b79 tempest-VolumesExtendTest-1843197783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 2.400s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:40:54 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-e43e078b-94d4-4f07-b2c8-8fadb2940b79 tempest-VolumesExtendTest-1843197783 None] Extend volume completed successfully.
Jul 09 14:40:54 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3bf99c91-f03d-4a03-a005-728ae168aaf4 tempest-VolumeQuotasAdminTestJSON-1151044469 None] Acquiring lock "cinder-18974c4a-5523-4ffd-8374-1f9520486058-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:40:54 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3bf99c91-f03d-4a03-a005-728ae168aaf4 tempest-VolumeQuotasAdminTestJSON-1151044469 None] Lock "cinder-18974c4a-5523-4ffd-8374-1f9520486058-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:40:54 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3bf99c91-f03d-4a03-a005-728ae168aaf4 tempest-VolumeQuotasAdminTestJSON-1151044469 None] Acquiring lock "cinder-quobyte-18974c4a-5523-4ffd-8374-1f9520486058" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:40:54 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3bf99c91-f03d-4a03-a005-728ae168aaf4 tempest-VolumeQuotasAdminTestJSON-1151044469 None] Lock "cinder-quobyte-18974c4a-5523-4ffd-8374-1f9520486058" acquired by "delete_volume" :: waited 0.020s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:40:54 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d897f4-b20e-4ef2-b83e-a9a216958d9a]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:40:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3bf99c91-f03d-4a03-a005-728ae168aaf4 tempest-VolumeQuotasAdminTestJSON-1151044469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-18974c4a-5523-4ffd-8374-1f9520486058 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:55 devstack sudo[97748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-18974c4a-5523-4ffd-8374-1f9520486058
Jul 09 14:40:55 devstack sudo[97748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:55 devstack sudo[97748]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3bf99c91-f03d-4a03-a005-728ae168aaf4 tempest-VolumeQuotasAdminTestJSON-1151044469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-18974c4a-5523-4ffd-8374-1f9520486058" returned: 0 in 0.901s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3bf99c91-f03d-4a03-a005-728ae168aaf4 tempest-VolumeQuotasAdminTestJSON-1151044469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-18974c4a-5523-4ffd-8374-1f9520486058 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:55 devstack sudo[97756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-18974c4a-5523-4ffd-8374-1f9520486058
Jul 09 14:40:55 devstack sudo[97756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:55 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-50d2c608-c4aa-4c2d-ad5c-feec06ed394e tempest-VolumesExtendTest-1843197783 None] Acquiring lock "cinder-7d17241d-9a43-49fb-ab93-138e06235f8b-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:40:56 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-50d2c608-c4aa-4c2d-ad5c-feec06ed394e tempest-VolumesExtendTest-1843197783 None] Lock "cinder-7d17241d-9a43-49fb-ab93-138e06235f8b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:40:56 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-50d2c608-c4aa-4c2d-ad5c-feec06ed394e tempest-VolumesExtendTest-1843197783 None] Acquiring lock "cinder-quobyte-7d17241d-9a43-49fb-ab93-138e06235f8b" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:40:56 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-50d2c608-c4aa-4c2d-ad5c-feec06ed394e tempest-VolumesExtendTest-1843197783 None] Lock "cinder-quobyte-7d17241d-9a43-49fb-ab93-138e06235f8b" acquired by "delete_volume" :: waited 0.020s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:40:56 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[274f548d-d971-4f98-9188-810459d90790]: (4, 'raw') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:40:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-50d2c608-c4aa-4c2d-ad5c-feec06ed394e tempest-VolumesExtendTest-1843197783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7d17241d-9a43-49fb-ab93-138e06235f8b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:56 devstack sudo[97758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7d17241d-9a43-49fb-ab93-138e06235f8b
Jul 09 14:40:56 devstack sudo[97758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:56 devstack sudo[97756]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3bf99c91-f03d-4a03-a005-728ae168aaf4 tempest-VolumeQuotasAdminTestJSON-1151044469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-18974c4a-5523-4ffd-8374-1f9520486058" returned: 0 in 0.811s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:56 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3bf99c91-f03d-4a03-a005-728ae168aaf4 tempest-VolumeQuotasAdminTestJSON-1151044469 None] Lock "cinder-quobyte-18974c4a-5523-4ffd-8374-1f9520486058" released by "delete_volume" :: held 1.767s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:40:56 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-3bf99c91-f03d-4a03-a005-728ae168aaf4 tempest-VolumeQuotasAdminTestJSON-1151044469 None] Created reservations ['f1552878-4bbb-43eb-ab04-db655800cffa', 'e66d2daf-5b04-47af-a072-e7472eb9bc23', '83dfbda2-b0ac-47bc-86fd-cfe72c073880', 'dc4324d6-ff1e-4f0a-aba3-6f4ce5387a78'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:40:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3bf99c91-f03d-4a03-a005-728ae168aaf4 tempest-VolumeQuotasAdminTestJSON-1151044469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:40:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3bf99c91-f03d-4a03-a005-728ae168aaf4 tempest-VolumeQuotasAdminTestJSON-1151044469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:40:56 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3bf99c91-f03d-4a03-a005-728ae168aaf4 tempest-VolumeQuotasAdminTestJSON-1151044469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:40:56 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3bf99c91-f03d-4a03-a005-728ae168aaf4 tempest-VolumeQuotasAdminTestJSON-1151044469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:40:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3bf99c91-f03d-4a03-a005-728ae168aaf4 tempest-VolumeQuotasAdminTestJSON-1151044469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:40:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3bf99c91-f03d-4a03-a005-728ae168aaf4 tempest-VolumeQuotasAdminTestJSON-1151044469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:56 devstack sudo[97761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:40:56 devstack sudo[97761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:56 devstack sudo[97758]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-50d2c608-c4aa-4c2d-ad5c-feec06ed394e tempest-VolumesExtendTest-1843197783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7d17241d-9a43-49fb-ab93-138e06235f8b" returned: 0 in 0.859s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-50d2c608-c4aa-4c2d-ad5c-feec06ed394e tempest-VolumesExtendTest-1843197783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7d17241d-9a43-49fb-ab93-138e06235f8b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:57 devstack sudo[97765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7d17241d-9a43-49fb-ab93-138e06235f8b
Jul 09 14:40:57 devstack sudo[97765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:57 devstack sudo[97761]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3bf99c91-f03d-4a03-a005-728ae168aaf4 tempest-VolumeQuotasAdminTestJSON-1151044469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.797s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:57 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-3bf99c91-f03d-4a03-a005-728ae168aaf4 tempest-VolumeQuotasAdminTestJSON-1151044469 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:40:57 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-3bf99c91-f03d-4a03-a005-728ae168aaf4 tempest-VolumeQuotasAdminTestJSON-1151044469 None] Deleted volume successfully.
Jul 09 14:40:57 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3bf99c91-f03d-4a03-a005-728ae168aaf4 tempest-VolumeQuotasAdminTestJSON-1151044469 None] Lock "cinder-18974c4a-5523-4ffd-8374-1f9520486058-delete_volume" released by "delete_volume" :: held 2.827s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:40:57 devstack sudo[97765]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-50d2c608-c4aa-4c2d-ad5c-feec06ed394e tempest-VolumesExtendTest-1843197783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7d17241d-9a43-49fb-ab93-138e06235f8b" returned: 1 in 0.926s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-50d2c608-c4aa-4c2d-ad5c-feec06ed394e tempest-VolumesExtendTest-1843197783 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7d17241d-9a43-49fb-ab93-138e06235f8b' failed. Not Retrying. {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 09 14:40:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-50d2c608-c4aa-4c2d-ad5c-feec06ed394e tempest-VolumesExtendTest-1843197783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7d17241d-9a43-49fb-ab93-138e06235f8b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:57 devstack sudo[97771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7d17241d-9a43-49fb-ab93-138e06235f8b
Jul 09 14:40:57 devstack sudo[97771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:58 devstack sudo[97771]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-50d2c608-c4aa-4c2d-ad5c-feec06ed394e tempest-VolumesExtendTest-1843197783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7d17241d-9a43-49fb-ab93-138e06235f8b" returned: 0 in 0.694s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:58 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-50d2c608-c4aa-4c2d-ad5c-feec06ed394e tempest-VolumesExtendTest-1843197783 None] Lock "cinder-quobyte-7d17241d-9a43-49fb-ab93-138e06235f8b" released by "delete_volume" :: held 2.554s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:40:58 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-50d2c608-c4aa-4c2d-ad5c-feec06ed394e tempest-VolumesExtendTest-1843197783 None] Created reservations ['aa6cea0c-a798-4307-8ae9-693874f45118', '96e93b6d-7ccb-4142-82a0-25cfffbc363e', '58311c13-4ab1-4cba-b687-f11602499d2a', 'a9efa71c-858f-4f01-a3aa-e3773b7f4427'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:40:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-50d2c608-c4aa-4c2d-ad5c-feec06ed394e tempest-VolumesExtendTest-1843197783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:40:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-50d2c608-c4aa-4c2d-ad5c-feec06ed394e tempest-VolumesExtendTest-1843197783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:40:58 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-50d2c608-c4aa-4c2d-ad5c-feec06ed394e tempest-VolumesExtendTest-1843197783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:40:58 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-50d2c608-c4aa-4c2d-ad5c-feec06ed394e tempest-VolumesExtendTest-1843197783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:40:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-50d2c608-c4aa-4c2d-ad5c-feec06ed394e tempest-VolumesExtendTest-1843197783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:40:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-50d2c608-c4aa-4c2d-ad5c-feec06ed394e tempest-VolumesExtendTest-1843197783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:40:58 devstack sudo[97774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:40:58 devstack sudo[97774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:40:59 devstack sudo[97774]: pam_unix(sudo:session): session closed for user root
Jul 09 14:40:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-50d2c608-c4aa-4c2d-ad5c-feec06ed394e tempest-VolumesExtendTest-1843197783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.936s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:40:59 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-50d2c608-c4aa-4c2d-ad5c-feec06ed394e tempest-VolumesExtendTest-1843197783 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:40:59 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-50d2c608-c4aa-4c2d-ad5c-feec06ed394e tempest-VolumesExtendTest-1843197783 None] Deleted volume successfully.
Jul 09 14:40:59 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-50d2c608-c4aa-4c2d-ad5c-feec06ed394e tempest-VolumesExtendTest-1843197783 None] Lock "cinder-7d17241d-9a43-49fb-ab93-138e06235f8b-delete_volume" released by "delete_volume" :: held 3.738s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:41:00 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-03f9334e-50cf-4001-a360-95465af10da7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:41:00 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-03f9334e-50cf-4001-a360-95465af10da7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] Flow 'volume_create_manager' (10378370-7a5b-4ad3-971c-1415b819ad55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:41:00 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-03f9334e-50cf-4001-a360-95465af10da7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e2b1e74-3878-4397-9820-e3c04c317357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:41:00 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-03f9334e-50cf-4001-a360-95465af10da7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e2b1e74-3878-4397-9820-e3c04c317357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:41:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1744797907',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de552d1b-36d4-4775-9cca-e6a8c473fa56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98122150e4df4f7b9bfe1a80ba2964aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:41:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:41:00Z,use_quota=True,user_id='bf3eb4aca0cb493aaa6261b0d71578c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:41:00 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-03f9334e-50cf-4001-a360-95465af10da7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c7dd6fe-49e5-4fdb-b62d-a7ee8c1de150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:41:00 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-03f9334e-50cf-4001-a360-95465af10da7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c7dd6fe-49e5-4fdb-b62d-a7ee8c1de150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:41:00 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-03f9334e-50cf-4001-a360-95465af10da7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c8488b5-e7ae-4265-a81a-f5bebacf6449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:41:00 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-03f9334e-50cf-4001-a360-95465af10da7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c8488b5-e7ae-4265-a81a-f5bebacf6449) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de552d1b-36d4-4775-9cca-e6a8c473fa56', 'volume_name': 'volume-de552d1b-36d4-4775-9cca-e6a8c473fa56', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:41:00 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-03f9334e-50cf-4001-a360-95465af10da7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36f7e3ee-2734-469c-8735-e5f982746672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:41:00 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-03f9334e-50cf-4001-a360-95465af10da7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36f7e3ee-2734-469c-8735-e5f982746672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:41:00 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-03f9334e-50cf-4001-a360-95465af10da7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77ca0931-120d-4e46-b2d5-62282ea8ff8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:41:00 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-03f9334e-50cf-4001-a360-95465af10da7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] Volume de552d1b-36d4-4775-9cca-e6a8c473fa56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de552d1b-36d4-4775-9cca-e6a8c473fa56', 'volume_size': 1}
Jul 09 14:41:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-03f9334e-50cf-4001-a360-95465af10da7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:41:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-03f9334e-50cf-4001-a360-95465af10da7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:41:00 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-03f9334e-50cf-4001-a360-95465af10da7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:41:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1744797907',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de552d1b-36d4-4775-9cca-e6a8c473fa56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98122150e4df4f7b9bfe1a80ba2964aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:41:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:41:00Z,use_quota=True,user_id='bf3eb4aca0cb493aaa6261b0d71578c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:41:00 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-03f9334e-50cf-4001-a360-95465af10da7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] Creating volume de552d1b-36d4-4775-9cca-e6a8c473fa56 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:41:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-03f9334e-50cf-4001-a360-95465af10da7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:41:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-03f9334e-50cf-4001-a360-95465af10da7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:41:00 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-03f9334e-50cf-4001-a360-95465af10da7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:41:00 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-03f9334e-50cf-4001-a360-95465af10da7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:41:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-03f9334e-50cf-4001-a360-95465af10da7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:41:00 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-03f9334e-50cf-4001-a360-95465af10da7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:41:00 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-03f9334e-50cf-4001-a360-95465af10da7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:41:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-03f9334e-50cf-4001-a360-95465af10da7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-de552d1b-36d4-4775-9cca-e6a8c473fa56 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:41:00 devstack sudo[97778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-de552d1b-36d4-4775-9cca-e6a8c473fa56 1073741824
Jul 09 14:41:00 devstack sudo[97778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:41:00 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-e53130f9-ee60-436b-87ea-07952d735736 tempest-VolumesExtendTest-1843197783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:41:00 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e53130f9-ee60-436b-87ea-07952d735736 tempest-VolumesExtendTest-1843197783 None] Flow 'volume_create_manager' (af059c0a-650f-4010-bd72-ead029e4837f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:41:00 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e53130f9-ee60-436b-87ea-07952d735736 tempest-VolumesExtendTest-1843197783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (051fd46a-7fa1-4596-89a4-a2b202d83df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:41:00 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e53130f9-ee60-436b-87ea-07952d735736 tempest-VolumesExtendTest-1843197783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (051fd46a-7fa1-4596-89a4-a2b202d83df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:41:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1704067649',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc467fe4-e46a-4bad-a393-0db82f3dc296,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f52ae6a0dc4b45fab3ce8a7f7a8dcee3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:41:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:41:00Z,use_quota=True,user_id='711195e602864fcf85875a54368e16f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:41:00 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e53130f9-ee60-436b-87ea-07952d735736 tempest-VolumesExtendTest-1843197783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2de9cf5-977a-4e27-b49a-a8a4c1dc2d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:41:00 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e53130f9-ee60-436b-87ea-07952d735736 tempest-VolumesExtendTest-1843197783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2de9cf5-977a-4e27-b49a-a8a4c1dc2d19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:41:00 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e53130f9-ee60-436b-87ea-07952d735736 tempest-VolumesExtendTest-1843197783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11ebf037-2631-4480-886b-a8e474c2f833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:41:00 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e53130f9-ee60-436b-87ea-07952d735736 tempest-VolumesExtendTest-1843197783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11ebf037-2631-4480-886b-a8e474c2f833) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc467fe4-e46a-4bad-a393-0db82f3dc296', 'volume_name': 'volume-bc467fe4-e46a-4bad-a393-0db82f3dc296', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:41:00 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e53130f9-ee60-436b-87ea-07952d735736 tempest-VolumesExtendTest-1843197783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b10c174d-9fae-48ab-ad95-9bebd29b6f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:41:00 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e53130f9-ee60-436b-87ea-07952d735736 tempest-VolumesExtendTest-1843197783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b10c174d-9fae-48ab-ad95-9bebd29b6f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:41:00 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e53130f9-ee60-436b-87ea-07952d735736 tempest-VolumesExtendTest-1843197783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e24350e8-0ad9-4930-89bb-186816b36449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:41:00 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-e53130f9-ee60-436b-87ea-07952d735736 tempest-VolumesExtendTest-1843197783 None] Volume bc467fe4-e46a-4bad-a393-0db82f3dc296: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc467fe4-e46a-4bad-a393-0db82f3dc296', 'volume_size': 1}
Jul 09 14:41:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e53130f9-ee60-436b-87ea-07952d735736 tempest-VolumesExtendTest-1843197783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:41:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-dd8e8796-f9c9-4ec6-bba3-004c510fdeed req-d46e5371-8c2b-4173-93bb-1420fa2ea75a tempest-TestInstancesWithCinderVolumes-1507168999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:41:01 devstack sudo[97778]: pam_unix(sudo:session): session closed for user root
Jul 09 14:41:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-03f9334e-50cf-4001-a360-95465af10da7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-de552d1b-36d4-4775-9cca-e6a8c473fa56 1073741824" returned: 0 in 1.124s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:41:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-03f9334e-50cf-4001-a360-95465af10da7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-de552d1b-36d4-4775-9cca-e6a8c473fa56 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:41:01 devstack sudo[97792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-de552d1b-36d4-4775-9cca-e6a8c473fa56
Jul 09 14:41:01 devstack sudo[97792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:41:02 devstack sudo[97792]: pam_unix(sudo:session): session closed for user root
Jul 09 14:41:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-03f9334e-50cf-4001-a360-95465af10da7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-de552d1b-36d4-4775-9cca-e6a8c473fa56" returned: 0 in 0.784s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:41:02 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-03f9334e-50cf-4001-a360-95465af10da7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] <== create_volume: return (1968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:41:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-03f9334e-50cf-4001-a360-95465af10da7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.971s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:41:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e53130f9-ee60-436b-87ea-07952d735736 tempest-VolumesExtendTest-1843197783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.731s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:41:02 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-e53130f9-ee60-436b-87ea-07952d735736 tempest-VolumesExtendTest-1843197783 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:41:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1704067649',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc467fe4-e46a-4bad-a393-0db82f3dc296,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f52ae6a0dc4b45fab3ce8a7f7a8dcee3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:41:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:41:00Z,use_quota=True,user_id='711195e602864fcf85875a54368e16f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:41:02 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-e53130f9-ee60-436b-87ea-07952d735736 tempest-VolumesExtendTest-1843197783 None] Creating volume bc467fe4-e46a-4bad-a393-0db82f3dc296 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:41:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e53130f9-ee60-436b-87ea-07952d735736 tempest-VolumesExtendTest-1843197783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:41:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e53130f9-ee60-436b-87ea-07952d735736 tempest-VolumesExtendTest-1843197783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:41:02 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-e53130f9-ee60-436b-87ea-07952d735736 tempest-VolumesExtendTest-1843197783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:41:02 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-e53130f9-ee60-436b-87ea-07952d735736 tempest-VolumesExtendTest-1843197783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:41:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e53130f9-ee60-436b-87ea-07952d735736 tempest-VolumesExtendTest-1843197783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:41:02 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-e53130f9-ee60-436b-87ea-07952d735736 tempest-VolumesExtendTest-1843197783 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:41:02 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-e53130f9-ee60-436b-87ea-07952d735736 tempest-VolumesExtendTest-1843197783 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:41:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e53130f9-ee60-436b-87ea-07952d735736 tempest-VolumesExtendTest-1843197783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bc467fe4-e46a-4bad-a393-0db82f3dc296 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:41:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-03f9334e-50cf-4001-a360-95465af10da7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77ca0931-120d-4e46-b2d5-62282ea8ff8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de552d1b-36d4-4775-9cca-e6a8c473fa56', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:41:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-03f9334e-50cf-4001-a360-95465af10da7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (433c82cb-b971-49a9-95d3-ed33ab25eb44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:41:02 devstack sudo[97796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bc467fe4-e46a-4bad-a393-0db82f3dc296 1073741824
Jul 09 14:41:02 devstack sudo[97796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:41:02 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-03f9334e-50cf-4001-a360-95465af10da7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] Volume volume-de552d1b-36d4-4775-9cca-e6a8c473fa56 (de552d1b-36d4-4775-9cca-e6a8c473fa56): created successfully
Jul 09 14:41:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-03f9334e-50cf-4001-a360-95465af10da7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (433c82cb-b971-49a9-95d3-ed33ab25eb44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:41:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-03f9334e-50cf-4001-a360-95465af10da7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] Flow 'volume_create_manager' (10378370-7a5b-4ad3-971c-1415b819ad55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:41:02 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-03f9334e-50cf-4001-a360-95465af10da7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] Created volume successfully.
Jul 09 14:41:03 devstack sudo[97796]: pam_unix(sudo:session): session closed for user root
Jul 09 14:41:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e53130f9-ee60-436b-87ea-07952d735736 tempest-VolumesExtendTest-1843197783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bc467fe4-e46a-4bad-a393-0db82f3dc296 1073741824" returned: 0 in 1.054s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:41:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-af36aca9-dbb1-42c7-bb95-bb26716add43 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:41:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e53130f9-ee60-436b-87ea-07952d735736 tempest-VolumesExtendTest-1843197783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bc467fe4-e46a-4bad-a393-0db82f3dc296 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:41:03 devstack sudo[97802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bc467fe4-e46a-4bad-a393-0db82f3dc296
Jul 09 14:41:03 devstack sudo[97802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:41:04 devstack sudo[97802]: pam_unix(sudo:session): session closed for user root
Jul 09 14:41:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e53130f9-ee60-436b-87ea-07952d735736 tempest-VolumesExtendTest-1843197783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bc467fe4-e46a-4bad-a393-0db82f3dc296" returned: 0 in 0.695s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:41:04 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-e53130f9-ee60-436b-87ea-07952d735736 tempest-VolumesExtendTest-1843197783 None] <== create_volume: return (1814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:41:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e53130f9-ee60-436b-87ea-07952d735736 tempest-VolumesExtendTest-1843197783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.818s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:41:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-dd8e8796-f9c9-4ec6-bba3-004c510fdeed req-d46e5371-8c2b-4173-93bb-1420fa2ea75a tempest-TestInstancesWithCinderVolumes-1507168999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.251s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:41:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e53130f9-ee60-436b-87ea-07952d735736 tempest-VolumesExtendTest-1843197783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e24350e8-0ad9-4930-89bb-186816b36449) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc467fe4-e46a-4bad-a393-0db82f3dc296', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:41:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e53130f9-ee60-436b-87ea-07952d735736 tempest-VolumesExtendTest-1843197783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02fd1675-857e-420d-9897-c2571a58a7dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:41:04 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-e53130f9-ee60-436b-87ea-07952d735736 tempest-VolumesExtendTest-1843197783 None] Volume volume-bc467fe4-e46a-4bad-a393-0db82f3dc296 (bc467fe4-e46a-4bad-a393-0db82f3dc296): created successfully
Jul 09 14:41:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e53130f9-ee60-436b-87ea-07952d735736 tempest-VolumesExtendTest-1843197783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02fd1675-857e-420d-9897-c2571a58a7dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:41:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e53130f9-ee60-436b-87ea-07952d735736 tempest-VolumesExtendTest-1843197783 None] Flow 'volume_create_manager' (af059c0a-650f-4010-bd72-ead029e4837f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:41:04 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[a27e0c8c-697e-477b-af3c-1abe9b399f37]: (4, 'raw') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:41:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-dd8e8796-f9c9-4ec6-bba3-004c510fdeed req-d46e5371-8c2b-4173-93bb-1420fa2ea75a tempest-TestInstancesWithCinderVolumes-1507168999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2daa519b-cac8-4271-9ebc-dc62c34f83fb {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:41:04 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-e53130f9-ee60-436b-87ea-07952d735736 tempest-VolumesExtendTest-1843197783 None] Created volume successfully.
Jul 09 14:41:04 devstack sudo[97805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2daa519b-cac8-4271-9ebc-dc62c34f83fb
Jul 09 14:41:04 devstack sudo[97805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:41:05 devstack sudo[97805]: pam_unix(sudo:session): session closed for user root
Jul 09 14:41:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-dd8e8796-f9c9-4ec6-bba3-004c510fdeed req-d46e5371-8c2b-4173-93bb-1420fa2ea75a tempest-TestInstancesWithCinderVolumes-1507168999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2daa519b-cac8-4271-9ebc-dc62c34f83fb" returned: 0 in 0.881s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:41:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-dd8e8796-f9c9-4ec6-bba3-004c510fdeed req-d46e5371-8c2b-4173-93bb-1420fa2ea75a tempest-TestInstancesWithCinderVolumes-1507168999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2daa519b-cac8-4271-9ebc-dc62c34f83fb {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:41:05 devstack sudo[97809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2daa519b-cac8-4271-9ebc-dc62c34f83fb
Jul 09 14:41:05 devstack sudo[97809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:41:05 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-738cf501-96c3-413a-88b6-81580becced4 tempest-VolumeQuotasNegativeTestJSON-1786289302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:41:05 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-738cf501-96c3-413a-88b6-81580becced4 tempest-VolumeQuotasNegativeTestJSON-1786289302 None] Flow 'volume_create_manager' (a6b265dc-1cf9-4b5a-b059-f516804cdfdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:41:05 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-738cf501-96c3-413a-88b6-81580becced4 tempest-VolumeQuotasNegativeTestJSON-1786289302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b805f54-645d-4d0a-b9ed-15872733aea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:41:05 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-738cf501-96c3-413a-88b6-81580becced4 tempest-VolumeQuotasNegativeTestJSON-1786289302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b805f54-645d-4d0a-b9ed-15872733aea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:41:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-790211688',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5dfefe7-688f-4085-ab97-313836c746f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7f564861f074262855126fe00b2304d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:41:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:41:06Z,use_quota=True,user_id='66363c11ce264f78afe5fe5adc812a9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:41:05 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-738cf501-96c3-413a-88b6-81580becced4 tempest-VolumeQuotasNegativeTestJSON-1786289302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49404241-e20a-4a35-b85b-bf7e80f57bb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:41:05 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-738cf501-96c3-413a-88b6-81580becced4 tempest-VolumeQuotasNegativeTestJSON-1786289302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49404241-e20a-4a35-b85b-bf7e80f57bb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:41:05 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-738cf501-96c3-413a-88b6-81580becced4 tempest-VolumeQuotasNegativeTestJSON-1786289302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4483e94-1045-4518-9763-788fb498f40e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:41:05 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-738cf501-96c3-413a-88b6-81580becced4 tempest-VolumeQuotasNegativeTestJSON-1786289302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4483e94-1045-4518-9763-788fb498f40e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5dfefe7-688f-4085-ab97-313836c746f8', 'volume_name': 'volume-b5dfefe7-688f-4085-ab97-313836c746f8', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:41:05 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-738cf501-96c3-413a-88b6-81580becced4 tempest-VolumeQuotasNegativeTestJSON-1786289302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (845a51f3-c027-4d26-be37-ea0b9491f66b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:41:05 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-738cf501-96c3-413a-88b6-81580becced4 tempest-VolumeQuotasNegativeTestJSON-1786289302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (845a51f3-c027-4d26-be37-ea0b9491f66b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:41:05 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-738cf501-96c3-413a-88b6-81580becced4 tempest-VolumeQuotasNegativeTestJSON-1786289302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b46dbae-bb1b-468a-8bec-6b10b8c3abe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:41:05 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-738cf501-96c3-413a-88b6-81580becced4 tempest-VolumeQuotasNegativeTestJSON-1786289302 None] Volume b5dfefe7-688f-4085-ab97-313836c746f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5dfefe7-688f-4085-ab97-313836c746f8', 'volume_size': 1}
Jul 09 14:41:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-738cf501-96c3-413a-88b6-81580becced4 tempest-VolumeQuotasNegativeTestJSON-1786289302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:41:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e6342174-ddf3-47e5-9ee4-65119df8f906 tempest-VolumesExtendTest-1843197783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:41:05 devstack sudo[97809]: pam_unix(sudo:session): session closed for user root
Jul 09 14:41:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-dd8e8796-f9c9-4ec6-bba3-004c510fdeed req-d46e5371-8c2b-4173-93bb-1420fa2ea75a tempest-TestInstancesWithCinderVolumes-1507168999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2daa519b-cac8-4271-9ebc-dc62c34f83fb" returned: 1 in 0.793s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:41:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-dd8e8796-f9c9-4ec6-bba3-004c510fdeed req-d46e5371-8c2b-4173-93bb-1420fa2ea75a tempest-TestInstancesWithCinderVolumes-1507168999 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2daa519b-cac8-4271-9ebc-dc62c34f83fb' failed. Not Retrying. {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 09 14:41:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-dd8e8796-f9c9-4ec6-bba3-004c510fdeed req-d46e5371-8c2b-4173-93bb-1420fa2ea75a tempest-TestInstancesWithCinderVolumes-1507168999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.741s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:41:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-af36aca9-dbb1-42c7-bb95-bb26716add43 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.454s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:41:05 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-af36aca9-dbb1-42c7-bb95-bb26716add43 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] Creating offline snapshot f7119975-7ec8-4106-9c6d-8ed7c3cead88 of volume de552d1b-36d4-4775-9cca-e6a8c473fa56 {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 14:41:05 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[d32e1a1c-f67e-43dd-82ab-a7ea598e8166]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:41:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-af36aca9-dbb1-42c7-bb95-bb26716add43 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-de552d1b-36d4-4775-9cca-e6a8c473fa56 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:41:05 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-dd8e8796-f9c9-4ec6-bba3-004c510fdeed req-d46e5371-8c2b-4173-93bb-1420fa2ea75a tempest-TestInstancesWithCinderVolumes-1507168999 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653', 'name': 'volume-2daa519b-cac8-4271-9ebc-dc62c34f83fb', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b6cb2ed8-6148-4288-9a2a-fb014035743c', 'enforce_multipath': True} {{(pid=87230) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 09 14:41:06 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-dd8e8796-f9c9-4ec6-bba3-004c510fdeed req-d46e5371-8c2b-4173-93bb-1420fa2ea75a tempest-TestInstancesWithCinderVolumes-1507168999 None] attachment_update completed successfully.
Jul 09 14:41:06 devstack sudo[97814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-de552d1b-36d4-4775-9cca-e6a8c473fa56
Jul 09 14:41:06 devstack sudo[97814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:41:06 devstack sudo[97814]: pam_unix(sudo:session): session closed for user root
Jul 09 14:41:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-af36aca9-dbb1-42c7-bb95-bb26716add43 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-de552d1b-36d4-4775-9cca-e6a8c473fa56" returned: 0 in 0.795s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:41:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-af36aca9-dbb1-42c7-bb95-bb26716add43 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-de552d1b-36d4-4775-9cca-e6a8c473fa56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-de552d1b-36d4-4775-9cca-e6a8c473fa56.f7119975-7ec8-4106-9c6d-8ed7c3cead88 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:41:06 devstack sudo[97819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-de552d1b-36d4-4775-9cca-e6a8c473fa56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-de552d1b-36d4-4775-9cca-e6a8c473fa56.f7119975-7ec8-4106-9c6d-8ed7c3cead88 1G
Jul 09 14:41:06 devstack sudo[97819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:41:07 devstack sudo[97819]: pam_unix(sudo:session): session closed for user root
Jul 09 14:41:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-af36aca9-dbb1-42c7-bb95-bb26716add43 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-de552d1b-36d4-4775-9cca-e6a8c473fa56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-de552d1b-36d4-4775-9cca-e6a8c473fa56.f7119975-7ec8-4106-9c6d-8ed7c3cead88 1G" returned: 0 in 0.815s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:41:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-af36aca9-dbb1-42c7-bb95-bb26716add43 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de552d1b-36d4-4775-9cca-e6a8c473fa56 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-de552d1b-36d4-4775-9cca-e6a8c473fa56.f7119975-7ec8-4106-9c6d-8ed7c3cead88 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:41:07 devstack sudo[97824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de552d1b-36d4-4775-9cca-e6a8c473fa56 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-de552d1b-36d4-4775-9cca-e6a8c473fa56.f7119975-7ec8-4106-9c6d-8ed7c3cead88
Jul 09 14:41:07 devstack sudo[97824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:41:08 devstack sudo[97824]: pam_unix(sudo:session): session closed for user root
Jul 09 14:41:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-af36aca9-dbb1-42c7-bb95-bb26716add43 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de552d1b-36d4-4775-9cca-e6a8c473fa56 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-de552d1b-36d4-4775-9cca-e6a8c473fa56.f7119975-7ec8-4106-9c6d-8ed7c3cead88" returned: 0 in 0.743s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:41:08 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-af36aca9-dbb1-42c7-bb95-bb26716add43 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-de552d1b-36d4-4775-9cca-e6a8c473fa56.f7119975-7ec8-4106-9c6d-8ed7c3cead88 is being set with open permissions: ugo+rw
Jul 09 14:41:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-af36aca9-dbb1-42c7-bb95-bb26716add43 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-de552d1b-36d4-4775-9cca-e6a8c473fa56.f7119975-7ec8-4106-9c6d-8ed7c3cead88 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:41:08 devstack sudo[97897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-de552d1b-36d4-4775-9cca-e6a8c473fa56.f7119975-7ec8-4106-9c6d-8ed7c3cead88
Jul 09 14:41:08 devstack sudo[97897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:41:08 devstack sudo[97897]: pam_unix(sudo:session): session closed for user root
Jul 09 14:41:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-af36aca9-dbb1-42c7-bb95-bb26716add43 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-de552d1b-36d4-4775-9cca-e6a8c473fa56.f7119975-7ec8-4106-9c6d-8ed7c3cead88" returned: 0 in 0.652s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:41:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-af36aca9-dbb1-42c7-bb95-bb26716add43 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-de552d1b-36d4-4775-9cca-e6a8c473fa56.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:41:09 devstack sudo[97901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-de552d1b-36d4-4775-9cca-e6a8c473fa56.info
Jul 09 14:41:09 devstack sudo[97901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:41:09 devstack sudo[97901]: pam_unix(sudo:session): session closed for user root
Jul 09 14:41:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-af36aca9-dbb1-42c7-bb95-bb26716add43 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-de552d1b-36d4-4775-9cca-e6a8c473fa56.info" returned: 0 in 0.757s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:41:09 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-af36aca9-dbb1-42c7-bb95-bb26716add43 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-de552d1b-36d4-4775-9cca-e6a8c473fa56.info is being set with open permissions: ugo+rw
Jul 09 14:41:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-af36aca9-dbb1-42c7-bb95-bb26716add43 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-de552d1b-36d4-4775-9cca-e6a8c473fa56.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:41:09 devstack sudo[97935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-de552d1b-36d4-4775-9cca-e6a8c473fa56.info
Jul 09 14:41:09 devstack sudo[97935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:41:10 devstack sudo[97935]: pam_unix(sudo:session): session closed for user root
Jul 09 14:41:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-af36aca9-dbb1-42c7-bb95-bb26716add43 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-de552d1b-36d4-4775-9cca-e6a8c473fa56.info" returned: 0 in 0.767s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:41:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-af36aca9-dbb1-42c7-bb95-bb26716add43 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.614s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:41:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-738cf501-96c3-413a-88b6-81580becced4 tempest-VolumeQuotasNegativeTestJSON-1786289302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.692s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:41:10 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-738cf501-96c3-413a-88b6-81580becced4 tempest-VolumeQuotasNegativeTestJSON-1786289302 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:41:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-790211688',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5dfefe7-688f-4085-ab97-313836c746f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7f564861f074262855126fe00b2304d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:41:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:41:06Z,use_quota=True,user_id='66363c11ce264f78afe5fe5adc812a9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:41:10 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-738cf501-96c3-413a-88b6-81580becced4 tempest-VolumeQuotasNegativeTestJSON-1786289302 None] Creating volume b5dfefe7-688f-4085-ab97-313836c746f8 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:41:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-738cf501-96c3-413a-88b6-81580becced4 tempest-VolumeQuotasNegativeTestJSON-1786289302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:41:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-738cf501-96c3-413a-88b6-81580becced4 tempest-VolumeQuotasNegativeTestJSON-1786289302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:41:10 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-738cf501-96c3-413a-88b6-81580becced4 tempest-VolumeQuotasNegativeTestJSON-1786289302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:41:10 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-738cf501-96c3-413a-88b6-81580becced4 tempest-VolumeQuotasNegativeTestJSON-1786289302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:41:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-738cf501-96c3-413a-88b6-81580becced4 tempest-VolumeQuotasNegativeTestJSON-1786289302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:41:10 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-738cf501-96c3-413a-88b6-81580becced4 tempest-VolumeQuotasNegativeTestJSON-1786289302 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:41:10 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-738cf501-96c3-413a-88b6-81580becced4 tempest-VolumeQuotasNegativeTestJSON-1786289302 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:41:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-738cf501-96c3-413a-88b6-81580becced4 tempest-VolumeQuotasNegativeTestJSON-1786289302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b5dfefe7-688f-4085-ab97-313836c746f8 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:41:10 devstack sudo[97952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b5dfefe7-688f-4085-ab97-313836c746f8 1073741824
Jul 09 14:41:10 devstack sudo[97952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:41:10 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-af36aca9-dbb1-42c7-bb95-bb26716add43 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] Create snapshot completed successfully
Jul 09 14:41:11 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3aff614f-73f8-41d7-93e3-daa03ce76398 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] Acquiring lock "cinder-f7119975-7ec8-4106-9c6d-8ed7c3cead88-delete_snapshot" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:41:11 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3aff614f-73f8-41d7-93e3-daa03ce76398 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] Lock "cinder-f7119975-7ec8-4106-9c6d-8ed7c3cead88-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:41:11 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3aff614f-73f8-41d7-93e3-daa03ce76398 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] Acquiring lock "cinder-quobyte-de552d1b-36d4-4775-9cca-e6a8c473fa56" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:41:11 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3aff614f-73f8-41d7-93e3-daa03ce76398 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] Lock "cinder-quobyte-de552d1b-36d4-4775-9cca-e6a8c473fa56" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:41:11 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3aff614f-73f8-41d7-93e3-daa03ce76398 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] Acquiring lock "cinder-quobyte-f7119975-7ec8-4106-9c6d-8ed7c3cead88" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:41:11 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3aff614f-73f8-41d7-93e3-daa03ce76398 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] Lock "cinder-quobyte-f7119975-7ec8-4106-9c6d-8ed7c3cead88" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:41:11 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-3aff614f-73f8-41d7-93e3-daa03ce76398 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] Deleting offline snapshot f7119975-7ec8-4106-9c6d-8ed7c3cead88 of volume de552d1b-36d4-4775-9cca-e6a8c473fa56 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 14:41:11 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-3aff614f-73f8-41d7-93e3-daa03ce76398 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] snapshot_file for this snap is: volume-de552d1b-36d4-4775-9cca-e6a8c473fa56.f7119975-7ec8-4106-9c6d-8ed7c3cead88 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 14:41:11 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f7d93a6-7c1f-417b-8e69-f746729f769a]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:41:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3aff614f-73f8-41d7-93e3-daa03ce76398 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-de552d1b-36d4-4775-9cca-e6a8c473fa56.f7119975-7ec8-4106-9c6d-8ed7c3cead88 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:41:11 devstack sudo[98289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-de552d1b-36d4-4775-9cca-e6a8c473fa56.f7119975-7ec8-4106-9c6d-8ed7c3cead88
Jul 09 14:41:11 devstack sudo[97952]: pam_unix(sudo:session): session closed for user root
Jul 09 14:41:11 devstack sudo[98289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:41:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-738cf501-96c3-413a-88b6-81580becced4 tempest-VolumeQuotasNegativeTestJSON-1786289302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b5dfefe7-688f-4085-ab97-313836c746f8 1073741824" returned: 0 in 0.987s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:41:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-738cf501-96c3-413a-88b6-81580becced4 tempest-VolumeQuotasNegativeTestJSON-1786289302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b5dfefe7-688f-4085-ab97-313836c746f8 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:41:11 devstack sudo[98291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b5dfefe7-688f-4085-ab97-313836c746f8
Jul 09 14:41:11 devstack sudo[98291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:41:12 devstack sudo[98289]: pam_unix(sudo:session): session closed for user root
Jul 09 14:41:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3aff614f-73f8-41d7-93e3-daa03ce76398 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-de552d1b-36d4-4775-9cca-e6a8c473fa56.f7119975-7ec8-4106-9c6d-8ed7c3cead88" returned: 0 in 0.816s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:41:12 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-3aff614f-73f8-41d7-93e3-daa03ce76398 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de552d1b-36d4-4775-9cca-e6a8c473fa56(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 14:41:12 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[29872c17-9321-4b3e-ae3d-9ade3c26f56f]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:41:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3aff614f-73f8-41d7-93e3-daa03ce76398 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-de552d1b-36d4-4775-9cca-e6a8c473fa56 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:41:12 devstack sudo[98291]: pam_unix(sudo:session): session closed for user root
Jul 09 14:41:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-738cf501-96c3-413a-88b6-81580becced4 tempest-VolumeQuotasNegativeTestJSON-1786289302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b5dfefe7-688f-4085-ab97-313836c746f8" returned: 0 in 0.721s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:41:12 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-738cf501-96c3-413a-88b6-81580becced4 tempest-VolumeQuotasNegativeTestJSON-1786289302 None] <== create_volume: return (1757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:41:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-738cf501-96c3-413a-88b6-81580becced4 tempest-VolumeQuotasNegativeTestJSON-1786289302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.759s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:41:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e6342174-ddf3-47e5-9ee4-65119df8f906 tempest-VolumesExtendTest-1843197783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.405s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:41:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-738cf501-96c3-413a-88b6-81580becced4 tempest-VolumeQuotasNegativeTestJSON-1786289302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b46dbae-bb1b-468a-8bec-6b10b8c3abe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5dfefe7-688f-4085-ab97-313836c746f8', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:41:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-738cf501-96c3-413a-88b6-81580becced4 tempest-VolumeQuotasNegativeTestJSON-1786289302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2777290-e6bd-42a4-816c-b176f154ac54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:41:12 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-e6342174-ddf3-47e5-9ee4-65119df8f906 tempest-VolumesExtendTest-1843197783 None] Creating offline snapshot 0930ba3b-361f-46ec-8e1b-c0ffb560304b of volume bc467fe4-e46a-4bad-a393-0db82f3dc296 {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 14:41:12 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-738cf501-96c3-413a-88b6-81580becced4 tempest-VolumeQuotasNegativeTestJSON-1786289302 None] Volume volume-b5dfefe7-688f-4085-ab97-313836c746f8 (b5dfefe7-688f-4085-ab97-313836c746f8): created successfully
Jul 09 14:41:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-738cf501-96c3-413a-88b6-81580becced4 tempest-VolumeQuotasNegativeTestJSON-1786289302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2777290-e6bd-42a4-816c-b176f154ac54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:41:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-738cf501-96c3-413a-88b6-81580becced4 tempest-VolumeQuotasNegativeTestJSON-1786289302 None] Flow 'volume_create_manager' (a6b265dc-1cf9-4b5a-b059-f516804cdfdb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:41:12 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2233d47-89c1-469a-8a89-c705e1e1297a]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:41:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e6342174-ddf3-47e5-9ee4-65119df8f906 tempest-VolumesExtendTest-1843197783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bc467fe4-e46a-4bad-a393-0db82f3dc296 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:41:12 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-738cf501-96c3-413a-88b6-81580becced4 tempest-VolumeQuotasNegativeTestJSON-1786289302 None] Created volume successfully.
Jul 09 14:41:12 devstack sudo[98300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-de552d1b-36d4-4775-9cca-e6a8c473fa56
Jul 09 14:41:12 devstack sudo[98300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:41:12 devstack sudo[98301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bc467fe4-e46a-4bad-a393-0db82f3dc296
Jul 09 14:41:12 devstack sudo[98301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:41:13 devstack sudo[98300]: pam_unix(sudo:session): session closed for user root
Jul 09 14:41:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3aff614f-73f8-41d7-93e3-daa03ce76398 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-de552d1b-36d4-4775-9cca-e6a8c473fa56" returned: 0 in 0.930s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:41:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3aff614f-73f8-41d7-93e3-daa03ce76398 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-de552d1b-36d4-4775-9cca-e6a8c473fa56.f7119975-7ec8-4106-9c6d-8ed7c3cead88 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:41:13 devstack sudo[98310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-de552d1b-36d4-4775-9cca-e6a8c473fa56.f7119975-7ec8-4106-9c6d-8ed7c3cead88
Jul 09 14:41:13 devstack sudo[98310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:41:13 devstack sudo[98301]: pam_unix(sudo:session): session closed for user root
Jul 09 14:41:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e6342174-ddf3-47e5-9ee4-65119df8f906 tempest-VolumesExtendTest-1843197783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bc467fe4-e46a-4bad-a393-0db82f3dc296" returned: 0 in 0.931s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:41:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e6342174-ddf3-47e5-9ee4-65119df8f906 tempest-VolumesExtendTest-1843197783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bc467fe4-e46a-4bad-a393-0db82f3dc296,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bc467fe4-e46a-4bad-a393-0db82f3dc296.0930ba3b-361f-46ec-8e1b-c0ffb560304b 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:41:13 devstack sudo[98312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bc467fe4-e46a-4bad-a393-0db82f3dc296,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bc467fe4-e46a-4bad-a393-0db82f3dc296.0930ba3b-361f-46ec-8e1b-c0ffb560304b 1G
Jul 09 14:41:13 devstack sudo[98312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:41:14 devstack sudo[98310]: pam_unix(sudo:session): session closed for user root
Jul 09 14:41:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3aff614f-73f8-41d7-93e3-daa03ce76398 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-de552d1b-36d4-4775-9cca-e6a8c473fa56.f7119975-7ec8-4106-9c6d-8ed7c3cead88" returned: 0 in 1.158s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:41:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3aff614f-73f8-41d7-93e3-daa03ce76398 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-de552d1b-36d4-4775-9cca-e6a8c473fa56.f7119975-7ec8-4106-9c6d-8ed7c3cead88 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:41:14 devstack sudo[98321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-de552d1b-36d4-4775-9cca-e6a8c473fa56.f7119975-7ec8-4106-9c6d-8ed7c3cead88
Jul 09 14:41:14 devstack sudo[98321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:41:14 devstack sudo[98312]: pam_unix(sudo:session): session closed for user root
Jul 09 14:41:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e6342174-ddf3-47e5-9ee4-65119df8f906 tempest-VolumesExtendTest-1843197783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bc467fe4-e46a-4bad-a393-0db82f3dc296,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bc467fe4-e46a-4bad-a393-0db82f3dc296.0930ba3b-361f-46ec-8e1b-c0ffb560304b 1G" returned: 0 in 1.188s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:41:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e6342174-ddf3-47e5-9ee4-65119df8f906 tempest-VolumesExtendTest-1843197783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc467fe4-e46a-4bad-a393-0db82f3dc296 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bc467fe4-e46a-4bad-a393-0db82f3dc296.0930ba3b-361f-46ec-8e1b-c0ffb560304b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:41:14 devstack sudo[98323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc467fe4-e46a-4bad-a393-0db82f3dc296 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bc467fe4-e46a-4bad-a393-0db82f3dc296.0930ba3b-361f-46ec-8e1b-c0ffb560304b
Jul 09 14:41:14 devstack sudo[98323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:41:15 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-468ca8d9-c186-4e19-837c-7e37cd85f038 tempest-VolumeQuotasNegativeTestJSON-1786289302 None] Acquiring lock "cinder-b5dfefe7-688f-4085-ab97-313836c746f8-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:41:15 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-468ca8d9-c186-4e19-837c-7e37cd85f038 tempest-VolumeQuotasNegativeTestJSON-1786289302 None] Lock "cinder-b5dfefe7-688f-4085-ab97-313836c746f8-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:41:15 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-468ca8d9-c186-4e19-837c-7e37cd85f038 tempest-VolumeQuotasNegativeTestJSON-1786289302 None] Acquiring lock "cinder-quobyte-b5dfefe7-688f-4085-ab97-313836c746f8" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:41:15 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-468ca8d9-c186-4e19-837c-7e37cd85f038 tempest-VolumeQuotasNegativeTestJSON-1786289302 None] Lock "cinder-quobyte-b5dfefe7-688f-4085-ab97-313836c746f8" acquired by "delete_volume" :: waited 0.045s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:41:15 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[58126b2f-257d-4643-ac74-7c749760bd7e]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:41:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-468ca8d9-c186-4e19-837c-7e37cd85f038 tempest-VolumeQuotasNegativeTestJSON-1786289302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b5dfefe7-688f-4085-ab97-313836c746f8 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:41:15 devstack sudo[98325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b5dfefe7-688f-4085-ab97-313836c746f8
Jul 09 14:41:15 devstack sudo[98325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:41:15 devstack sudo[98321]: pam_unix(sudo:session): session closed for user root
Jul 09 14:41:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3aff614f-73f8-41d7-93e3-daa03ce76398 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-de552d1b-36d4-4775-9cca-e6a8c473fa56.f7119975-7ec8-4106-9c6d-8ed7c3cead88" returned: 0 in 1.375s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:41:15 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3aff614f-73f8-41d7-93e3-daa03ce76398 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] Lock "cinder-quobyte-f7119975-7ec8-4106-9c6d-8ed7c3cead88" released by "_delete_snapshot" :: held 4.467s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:41:15 devstack sudo[98323]: pam_unix(sudo:session): session closed for user root
Jul 09 14:41:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e6342174-ddf3-47e5-9ee4-65119df8f906 tempest-VolumesExtendTest-1843197783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc467fe4-e46a-4bad-a393-0db82f3dc296 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bc467fe4-e46a-4bad-a393-0db82f3dc296.0930ba3b-361f-46ec-8e1b-c0ffb560304b" returned: 0 in 1.361s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:41:15 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-e6342174-ddf3-47e5-9ee4-65119df8f906 tempest-VolumesExtendTest-1843197783 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bc467fe4-e46a-4bad-a393-0db82f3dc296.0930ba3b-361f-46ec-8e1b-c0ffb560304b is being set with open permissions: ugo+rw
Jul 09 14:41:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e6342174-ddf3-47e5-9ee4-65119df8f906 tempest-VolumesExtendTest-1843197783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bc467fe4-e46a-4bad-a393-0db82f3dc296.0930ba3b-361f-46ec-8e1b-c0ffb560304b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:41:15 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3aff614f-73f8-41d7-93e3-daa03ce76398 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] Lock "cinder-quobyte-de552d1b-36d4-4775-9cca-e6a8c473fa56" released by "delete_snapshot" :: held 4.529s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:41:15 devstack sudo[98331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bc467fe4-e46a-4bad-a393-0db82f3dc296.0930ba3b-361f-46ec-8e1b-c0ffb560304b
Jul 09 14:41:15 devstack sudo[98331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:41:16 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-3aff614f-73f8-41d7-93e3-daa03ce76398 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] Created reservations ['ebe0677b-617e-4376-97b1-97b9c73db7c6', 'de91c957-cb6a-4114-a1db-f5f9ed739576', '6d5e5ea8-886c-4bf3-8efb-1b37dbb561c7', 'a58df22f-9d82-40db-850d-b067242b245c'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:41:16 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-3aff614f-73f8-41d7-93e3-daa03ce76398 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] Delete snapshot completed successfully.
Jul 09 14:41:16 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3aff614f-73f8-41d7-93e3-daa03ce76398 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] Lock "cinder-f7119975-7ec8-4106-9c6d-8ed7c3cead88-delete_snapshot" released by "delete_snapshot" :: held 4.826s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:41:16 devstack sudo[98325]: pam_unix(sudo:session): session closed for user root
Jul 09 14:41:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-468ca8d9-c186-4e19-837c-7e37cd85f038 tempest-VolumeQuotasNegativeTestJSON-1786289302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b5dfefe7-688f-4085-ab97-313836c746f8" returned: 0 in 1.227s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:41:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-468ca8d9-c186-4e19-837c-7e37cd85f038 tempest-VolumeQuotasNegativeTestJSON-1786289302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b5dfefe7-688f-4085-ab97-313836c746f8 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:41:16 devstack sudo[98336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b5dfefe7-688f-4085-ab97-313836c746f8
Jul 09 14:41:16 devstack sudo[98336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:41:16 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-49cc6716-e19c-41c5-bb64-7e833690f9a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] Acquiring lock "cinder-de552d1b-36d4-4775-9cca-e6a8c473fa56-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:41:16 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-49cc6716-e19c-41c5-bb64-7e833690f9a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] Lock "cinder-de552d1b-36d4-4775-9cca-e6a8c473fa56-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:41:16 devstack sudo[98331]: pam_unix(sudo:session): session closed for user root
Jul 09 14:41:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e6342174-ddf3-47e5-9ee4-65119df8f906 tempest-VolumesExtendTest-1843197783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bc467fe4-e46a-4bad-a393-0db82f3dc296.0930ba3b-361f-46ec-8e1b-c0ffb560304b" returned: 0 in 1.129s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:41:17 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-49cc6716-e19c-41c5-bb64-7e833690f9a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] Acquiring lock "cinder-quobyte-de552d1b-36d4-4775-9cca-e6a8c473fa56" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:41:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e6342174-ddf3-47e5-9ee4-65119df8f906 tempest-VolumesExtendTest-1843197783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bc467fe4-e46a-4bad-a393-0db82f3dc296.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:41:17 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-49cc6716-e19c-41c5-bb64-7e833690f9a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] Lock "cinder-quobyte-de552d1b-36d4-4775-9cca-e6a8c473fa56" acquired by "delete_volume" :: waited 0.047s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:41:17 devstack sudo[98340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bc467fe4-e46a-4bad-a393-0db82f3dc296.info
Jul 09 14:41:17 devstack sudo[98340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:41:17 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6705110-734c-4ef6-8e60-05ca1c28b1b8]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:41:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-49cc6716-e19c-41c5-bb64-7e833690f9a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-de552d1b-36d4-4775-9cca-e6a8c473fa56 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:41:17 devstack sudo[98342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-de552d1b-36d4-4775-9cca-e6a8c473fa56
Jul 09 14:41:17 devstack sudo[98342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:41:17 devstack sudo[98336]: pam_unix(sudo:session): session closed for user root
Jul 09 14:41:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-468ca8d9-c186-4e19-837c-7e37cd85f038 tempest-VolumeQuotasNegativeTestJSON-1786289302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b5dfefe7-688f-4085-ab97-313836c746f8" returned: 0 in 1.269s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:41:17 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-468ca8d9-c186-4e19-837c-7e37cd85f038 tempest-VolumeQuotasNegativeTestJSON-1786289302 None] Lock "cinder-quobyte-b5dfefe7-688f-4085-ab97-313836c746f8" released by "delete_volume" :: held 2.585s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:41:17 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-468ca8d9-c186-4e19-837c-7e37cd85f038 tempest-VolumeQuotasNegativeTestJSON-1786289302 None] Created reservations ['64dde4ed-c747-4067-ba10-cfb24ae3bf29', 'b42395b6-ab51-4b81-835e-451bfa4538f8', 'fadad15a-0035-4547-9d59-103b3dd6701e', 'babcbbc1-e194-4401-a3e8-df5329d60629'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:41:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-468ca8d9-c186-4e19-837c-7e37cd85f038 tempest-VolumeQuotasNegativeTestJSON-1786289302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:41:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-468ca8d9-c186-4e19-837c-7e37cd85f038 tempest-VolumeQuotasNegativeTestJSON-1786289302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:41:18 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-468ca8d9-c186-4e19-837c-7e37cd85f038 tempest-VolumeQuotasNegativeTestJSON-1786289302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:41:18 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-468ca8d9-c186-4e19-837c-7e37cd85f038 tempest-VolumeQuotasNegativeTestJSON-1786289302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:41:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-468ca8d9-c186-4e19-837c-7e37cd85f038 tempest-VolumeQuotasNegativeTestJSON-1786289302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:41:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-468ca8d9-c186-4e19-837c-7e37cd85f038 tempest-VolumeQuotasNegativeTestJSON-1786289302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:41:18 devstack sudo[98340]: pam_unix(sudo:session): session closed for user root
Jul 09 14:41:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e6342174-ddf3-47e5-9ee4-65119df8f906 tempest-VolumesExtendTest-1843197783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bc467fe4-e46a-4bad-a393-0db82f3dc296.info" returned: 0 in 1.115s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:41:18 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-e6342174-ddf3-47e5-9ee4-65119df8f906 tempest-VolumesExtendTest-1843197783 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bc467fe4-e46a-4bad-a393-0db82f3dc296.info is being set with open permissions: ugo+rw
Jul 09 14:41:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e6342174-ddf3-47e5-9ee4-65119df8f906 tempest-VolumesExtendTest-1843197783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bc467fe4-e46a-4bad-a393-0db82f3dc296.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:41:18 devstack sudo[98347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:41:18 devstack sudo[98347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:41:18 devstack sudo[98348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bc467fe4-e46a-4bad-a393-0db82f3dc296.info
Jul 09 14:41:18 devstack sudo[98348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:41:18 devstack sudo[98342]: pam_unix(sudo:session): session closed for user root
Jul 09 14:41:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-49cc6716-e19c-41c5-bb64-7e833690f9a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-de552d1b-36d4-4775-9cca-e6a8c473fa56" returned: 0 in 1.523s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:41:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-49cc6716-e19c-41c5-bb64-7e833690f9a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-de552d1b-36d4-4775-9cca-e6a8c473fa56 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:41:18 devstack sudo[98354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-de552d1b-36d4-4775-9cca-e6a8c473fa56
Jul 09 14:41:18 devstack sudo[98354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:41:19 devstack sudo[98347]: pam_unix(sudo:session): session closed for user root
Jul 09 14:41:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-468ca8d9-c186-4e19-837c-7e37cd85f038 tempest-VolumeQuotasNegativeTestJSON-1786289302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 1.324s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:41:19 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-468ca8d9-c186-4e19-837c-7e37cd85f038 tempest-VolumeQuotasNegativeTestJSON-1786289302 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:41:19 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-468ca8d9-c186-4e19-837c-7e37cd85f038 tempest-VolumeQuotasNegativeTestJSON-1786289302 None] Deleted volume successfully.
Jul 09 14:41:19 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-468ca8d9-c186-4e19-837c-7e37cd85f038 tempest-VolumeQuotasNegativeTestJSON-1786289302 None] Lock "cinder-b5dfefe7-688f-4085-ab97-313836c746f8-delete_volume" released by "delete_volume" :: held 4.399s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:41:19 devstack sudo[98348]: pam_unix(sudo:session): session closed for user root
Jul 09 14:41:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e6342174-ddf3-47e5-9ee4-65119df8f906 tempest-VolumesExtendTest-1843197783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bc467fe4-e46a-4bad-a393-0db82f3dc296.info" returned: 0 in 1.511s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:41:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e6342174-ddf3-47e5-9ee4-65119df8f906 tempest-VolumesExtendTest-1843197783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.400s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:41:19 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=108,cinder:UPDATE=117,cinder:INSERT=39,cinder:DELETE=11 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 14:41:19 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-e6342174-ddf3-47e5-9ee4-65119df8f906 tempest-VolumesExtendTest-1843197783 None] Create snapshot completed successfully
Jul 09 14:41:20 devstack sudo[98354]: pam_unix(sudo:session): session closed for user root
Jul 09 14:41:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-49cc6716-e19c-41c5-bb64-7e833690f9a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-de552d1b-36d4-4775-9cca-e6a8c473fa56" returned: 0 in 1.456s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:41:20 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-49cc6716-e19c-41c5-bb64-7e833690f9a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] Lock "cinder-quobyte-de552d1b-36d4-4775-9cca-e6a8c473fa56" released by "delete_volume" :: held 3.107s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:41:20 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-49cc6716-e19c-41c5-bb64-7e833690f9a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] Created reservations ['fe8bbe09-453a-4e69-a537-f6f5398ad234', '10a8e765-4372-4ed9-a2c1-05a870859f75', 'efcac239-f75f-490c-bfda-bd976fb91470', 'e32f0bb2-54b8-41ce-a630-8d235464687f'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:41:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-49cc6716-e19c-41c5-bb64-7e833690f9a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:41:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-49cc6716-e19c-41c5-bb64-7e833690f9a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:41:20 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-49cc6716-e19c-41c5-bb64-7e833690f9a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:41:20 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-49cc6716-e19c-41c5-bb64-7e833690f9a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:41:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-49cc6716-e19c-41c5-bb64-7e833690f9a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:41:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-49cc6716-e19c-41c5-bb64-7e833690f9a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:41:20 devstack sudo[98362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:41:20 devstack sudo[98362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:41:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-2b3a2f9b-a8c0-4d50-bdbf-3aa8a36741fd tempest-VolumesExtendTest-1843197783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:41:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-2b3a2f9b-a8c0-4d50-bdbf-3aa8a36741fd tempest-VolumesExtendTest-1843197783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.005s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:41:20 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e2be79-42ac-42d4-a7b5-e3e020915151]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:41:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2b3a2f9b-a8c0-4d50-bdbf-3aa8a36741fd tempest-VolumesExtendTest-1843197783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bc467fe4-e46a-4bad-a393-0db82f3dc296 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:41:21 devstack sudo[98364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bc467fe4-e46a-4bad-a393-0db82f3dc296
Jul 09 14:41:21 devstack sudo[98364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:41:21 devstack sudo[98362]: pam_unix(sudo:session): session closed for user root
Jul 09 14:41:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-49cc6716-e19c-41c5-bb64-7e833690f9a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 1.282s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:41:21 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-49cc6716-e19c-41c5-bb64-7e833690f9a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:41:21 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-49cc6716-e19c-41c5-bb64-7e833690f9a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] Deleted volume successfully.
Jul 09 14:41:21 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-49cc6716-e19c-41c5-bb64-7e833690f9a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1541606042 None] Lock "cinder-de552d1b-36d4-4775-9cca-e6a8c473fa56-delete_volume" released by "delete_volume" :: held 4.791s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:41:22 devstack sudo[98364]: pam_unix(sudo:session): session closed for user root
Jul 09 14:41:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2b3a2f9b-a8c0-4d50-bdbf-3aa8a36741fd tempest-VolumesExtendTest-1843197783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bc467fe4-e46a-4bad-a393-0db82f3dc296" returned: 0 in 1.612s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:41:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2b3a2f9b-a8c0-4d50-bdbf-3aa8a36741fd tempest-VolumesExtendTest-1843197783 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bc467fe4-e46a-4bad-a393-0db82f3dc296.0930ba3b-361f-46ec-8e1b-c0ffb560304b 2G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:41:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2b3a2f9b-a8c0-4d50-bdbf-3aa8a36741fd tempest-VolumesExtendTest-1843197783 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bc467fe4-e46a-4bad-a393-0db82f3dc296.0930ba3b-361f-46ec-8e1b-c0ffb560304b 2G" returned: 0 in 0.186s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:41:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-2b3a2f9b-a8c0-4d50-bdbf-3aa8a36741fd tempest-VolumesExtendTest-1843197783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.864s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:41:22 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-2b3a2f9b-a8c0-4d50-bdbf-3aa8a36741fd tempest-VolumesExtendTest-1843197783 None] Extend volume completed successfully.
Jul 09 14:41:23 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-667976df-086c-420e-8693-452f0ea20b8c tempest-VolumesExtendTest-1843197783 None] Acquiring lock "cinder-0930ba3b-361f-46ec-8e1b-c0ffb560304b-delete_snapshot" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:41:23 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-667976df-086c-420e-8693-452f0ea20b8c tempest-VolumesExtendTest-1843197783 None] Lock "cinder-0930ba3b-361f-46ec-8e1b-c0ffb560304b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:41:23 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-667976df-086c-420e-8693-452f0ea20b8c tempest-VolumesExtendTest-1843197783 None] Acquiring lock "cinder-quobyte-bc467fe4-e46a-4bad-a393-0db82f3dc296" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:41:23 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-667976df-086c-420e-8693-452f0ea20b8c tempest-VolumesExtendTest-1843197783 None] Lock "cinder-quobyte-bc467fe4-e46a-4bad-a393-0db82f3dc296" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:41:23 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-667976df-086c-420e-8693-452f0ea20b8c tempest-VolumesExtendTest-1843197783 None] Acquiring lock "cinder-quobyte-0930ba3b-361f-46ec-8e1b-c0ffb560304b" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:41:23 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-667976df-086c-420e-8693-452f0ea20b8c tempest-VolumesExtendTest-1843197783 None] Lock "cinder-quobyte-0930ba3b-361f-46ec-8e1b-c0ffb560304b" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:41:23 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-667976df-086c-420e-8693-452f0ea20b8c tempest-VolumesExtendTest-1843197783 None] Deleting offline snapshot 0930ba3b-361f-46ec-8e1b-c0ffb560304b of volume bc467fe4-e46a-4bad-a393-0db82f3dc296 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 14:41:23 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-667976df-086c-420e-8693-452f0ea20b8c tempest-VolumesExtendTest-1843197783 None] snapshot_file for this snap is: volume-bc467fe4-e46a-4bad-a393-0db82f3dc296.0930ba3b-361f-46ec-8e1b-c0ffb560304b {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 14:41:23 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[10e3ae49-74d7-4433-acb3-f27d08aaea8f]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:41:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-667976df-086c-420e-8693-452f0ea20b8c tempest-VolumesExtendTest-1843197783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bc467fe4-e46a-4bad-a393-0db82f3dc296.0930ba3b-361f-46ec-8e1b-c0ffb560304b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:41:23 devstack sudo[98377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bc467fe4-e46a-4bad-a393-0db82f3dc296.0930ba3b-361f-46ec-8e1b-c0ffb560304b
Jul 09 14:41:23 devstack sudo[98377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:41:24 devstack sudo[98377]: pam_unix(sudo:session): session closed for user root
Jul 09 14:41:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-667976df-086c-420e-8693-452f0ea20b8c tempest-VolumesExtendTest-1843197783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bc467fe4-e46a-4bad-a393-0db82f3dc296.0930ba3b-361f-46ec-8e1b-c0ffb560304b" returned: 0 in 1.464s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:41:24 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-667976df-086c-420e-8693-452f0ea20b8c tempest-VolumesExtendTest-1843197783 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc467fe4-e46a-4bad-a393-0db82f3dc296(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 14:41:24 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[a56d19d9-51d7-4bd9-8dcd-5fc0e66d8870]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:41:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-667976df-086c-420e-8693-452f0ea20b8c tempest-VolumesExtendTest-1843197783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bc467fe4-e46a-4bad-a393-0db82f3dc296 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:41:25 devstack sudo[98384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bc467fe4-e46a-4bad-a393-0db82f3dc296
Jul 09 14:41:25 devstack sudo[98384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:41:26 devstack sudo[98384]: pam_unix(sudo:session): session closed for user root
Jul 09 14:41:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-667976df-086c-420e-8693-452f0ea20b8c tempest-VolumesExtendTest-1843197783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bc467fe4-e46a-4bad-a393-0db82f3dc296" returned: 0 in 1.299s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:41:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-667976df-086c-420e-8693-452f0ea20b8c tempest-VolumesExtendTest-1843197783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bc467fe4-e46a-4bad-a393-0db82f3dc296.0930ba3b-361f-46ec-8e1b-c0ffb560304b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:41:26 devstack sudo[98389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bc467fe4-e46a-4bad-a393-0db82f3dc296.0930ba3b-361f-46ec-8e1b-c0ffb560304b
Jul 09 14:41:26 devstack sudo[98389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:41:27 devstack sudo[98389]: pam_unix(sudo:session): session closed for user root
Jul 09 14:41:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-667976df-086c-420e-8693-452f0ea20b8c tempest-VolumesExtendTest-1843197783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bc467fe4-e46a-4bad-a393-0db82f3dc296.0930ba3b-361f-46ec-8e1b-c0ffb560304b" returned: 0 in 0.903s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:41:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-667976df-086c-420e-8693-452f0ea20b8c tempest-VolumesExtendTest-1843197783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bc467fe4-e46a-4bad-a393-0db82f3dc296.0930ba3b-361f-46ec-8e1b-c0ffb560304b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:41:27 devstack sudo[98395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bc467fe4-e46a-4bad-a393-0db82f3dc296.0930ba3b-361f-46ec-8e1b-c0ffb560304b
Jul 09 14:41:27 devstack sudo[98395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:41:28 devstack sudo[98395]: pam_unix(sudo:session): session closed for user root
Jul 09 14:41:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-667976df-086c-420e-8693-452f0ea20b8c tempest-VolumesExtendTest-1843197783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bc467fe4-e46a-4bad-a393-0db82f3dc296.0930ba3b-361f-46ec-8e1b-c0ffb560304b" returned: 0 in 0.829s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:41:28 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-667976df-086c-420e-8693-452f0ea20b8c tempest-VolumesExtendTest-1843197783 None] Lock "cinder-quobyte-0930ba3b-361f-46ec-8e1b-c0ffb560304b" released by "_delete_snapshot" :: held 4.664s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:41:28 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-667976df-086c-420e-8693-452f0ea20b8c tempest-VolumesExtendTest-1843197783 None] Lock "cinder-quobyte-bc467fe4-e46a-4bad-a393-0db82f3dc296" released by "delete_snapshot" :: held 4.699s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:41:28 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-235d7a30-829d-4972-818e-1b551a0a147e tempest-VolumeRetypeWithoutMigrationTest-1680379655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:41:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-235d7a30-829d-4972-818e-1b551a0a147e tempest-VolumeRetypeWithoutMigrationTest-1680379655 None] Flow 'volume_create_manager' (9e3c269b-22a5-4603-9064-133c4302913b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:41:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-235d7a30-829d-4972-818e-1b551a0a147e tempest-VolumeRetypeWithoutMigrationTest-1680379655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a59f83de-aecd-4027-8cfe-6de0a5cc15a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:41:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-235d7a30-829d-4972-818e-1b551a0a147e tempest-VolumeRetypeWithoutMigrationTest-1680379655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a59f83de-aecd-4027-8cfe-6de0a5cc15a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:41:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-2025323724',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29a0a1ff-3719-42a7-b42e-f7752c32c04a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6bdd9a692b649dbaa19b41009ddf41e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:41:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:41:28Z,use_quota=True,user_id='ec4328baebb547259ae7c7d909e8a469',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8bbef26-739b-40ca-9865-ee4207e51994),volume_type_id=e8bbef26-739b-40ca-9865-ee4207e51994)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:41:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-235d7a30-829d-4972-818e-1b551a0a147e tempest-VolumeRetypeWithoutMigrationTest-1680379655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f187a7bf-0d28-439f-965c-fb1ac394a16c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:41:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-235d7a30-829d-4972-818e-1b551a0a147e tempest-VolumeRetypeWithoutMigrationTest-1680379655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f187a7bf-0d28-439f-965c-fb1ac394a16c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:41:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-235d7a30-829d-4972-818e-1b551a0a147e tempest-VolumeRetypeWithoutMigrationTest-1680379655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f665634-3675-4aac-880d-c9ba4ca85927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:41:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-235d7a30-829d-4972-818e-1b551a0a147e tempest-VolumeRetypeWithoutMigrationTest-1680379655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f665634-3675-4aac-880d-c9ba4ca85927) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29a0a1ff-3719-42a7-b42e-f7752c32c04a', 'volume_name': 'volume-29a0a1ff-3719-42a7-b42e-f7752c32c04a', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:41:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-235d7a30-829d-4972-818e-1b551a0a147e tempest-VolumeRetypeWithoutMigrationTest-1680379655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43094233-d7d2-4be3-9497-415d54237cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:41:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-235d7a30-829d-4972-818e-1b551a0a147e tempest-VolumeRetypeWithoutMigrationTest-1680379655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43094233-d7d2-4be3-9497-415d54237cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:41:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-235d7a30-829d-4972-818e-1b551a0a147e tempest-VolumeRetypeWithoutMigrationTest-1680379655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44414bbd-efe1-4a0d-9846-0ea34221063b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:41:28 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-235d7a30-829d-4972-818e-1b551a0a147e tempest-VolumeRetypeWithoutMigrationTest-1680379655 None] Volume 29a0a1ff-3719-42a7-b42e-f7752c32c04a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29a0a1ff-3719-42a7-b42e-f7752c32c04a', 'volume_size': 1}
Jul 09 14:41:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-235d7a30-829d-4972-818e-1b551a0a147e tempest-VolumeRetypeWithoutMigrationTest-1680379655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:41:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-235d7a30-829d-4972-818e-1b551a0a147e tempest-VolumeRetypeWithoutMigrationTest-1680379655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:41:28 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-235d7a30-829d-4972-818e-1b551a0a147e tempest-VolumeRetypeWithoutMigrationTest-1680379655 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:41:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-2025323724',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29a0a1ff-3719-42a7-b42e-f7752c32c04a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6bdd9a692b649dbaa19b41009ddf41e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:41:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:41:28Z,use_quota=True,user_id='ec4328baebb547259ae7c7d909e8a469',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8bbef26-739b-40ca-9865-ee4207e51994),volume_type_id=e8bbef26-739b-40ca-9865-ee4207e51994)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:41:28 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-235d7a30-829d-4972-818e-1b551a0a147e tempest-VolumeRetypeWithoutMigrationTest-1680379655 None] Creating volume 29a0a1ff-3719-42a7-b42e-f7752c32c04a {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:41:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-235d7a30-829d-4972-818e-1b551a0a147e tempest-VolumeRetypeWithoutMigrationTest-1680379655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:41:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-235d7a30-829d-4972-818e-1b551a0a147e tempest-VolumeRetypeWithoutMigrationTest-1680379655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:41:28 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-235d7a30-829d-4972-818e-1b551a0a147e tempest-VolumeRetypeWithoutMigrationTest-1680379655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:41:28 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-235d7a30-829d-4972-818e-1b551a0a147e tempest-VolumeRetypeWithoutMigrationTest-1680379655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:41:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-235d7a30-829d-4972-818e-1b551a0a147e tempest-VolumeRetypeWithoutMigrationTest-1680379655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:41:28 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-235d7a30-829d-4972-818e-1b551a0a147e tempest-VolumeRetypeWithoutMigrationTest-1680379655 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:41:28 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-235d7a30-829d-4972-818e-1b551a0a147e tempest-VolumeRetypeWithoutMigrationTest-1680379655 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:41:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-235d7a30-829d-4972-818e-1b551a0a147e tempest-VolumeRetypeWithoutMigrationTest-1680379655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29a0a1ff-3719-42a7-b42e-f7752c32c04a 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:41:28 devstack sudo[98424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29a0a1ff-3719-42a7-b42e-f7752c32c04a 1073741824
Jul 09 14:41:28 devstack sudo[98424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:41:28 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-667976df-086c-420e-8693-452f0ea20b8c tempest-VolumesExtendTest-1843197783 None] Created reservations ['dc7b5648-a98f-4ed9-a4f2-5e79cde193cd', 'bec55e69-b384-496f-9bf7-657ad20ec868', '9f10564c-1b5d-45e7-8684-0209e91485c6', '06bde240-afe2-490f-b74f-fade5f52a6dc'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:41:28 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-667976df-086c-420e-8693-452f0ea20b8c tempest-VolumesExtendTest-1843197783 None] Delete snapshot completed successfully.
Jul 09 14:41:28 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-667976df-086c-420e-8693-452f0ea20b8c tempest-VolumesExtendTest-1843197783 None] Lock "cinder-0930ba3b-361f-46ec-8e1b-c0ffb560304b-delete_snapshot" released by "delete_snapshot" :: held 5.012s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:41:28 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d15f3173-b775-4af4-8853-ac30368e97f9 tempest-VolumesExtendTest-1843197783 None] Acquiring lock "cinder-bc467fe4-e46a-4bad-a393-0db82f3dc296-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:41:28 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d15f3173-b775-4af4-8853-ac30368e97f9 tempest-VolumesExtendTest-1843197783 None] Lock "cinder-bc467fe4-e46a-4bad-a393-0db82f3dc296-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:41:28 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d15f3173-b775-4af4-8853-ac30368e97f9 tempest-VolumesExtendTest-1843197783 None] Acquiring lock "cinder-quobyte-bc467fe4-e46a-4bad-a393-0db82f3dc296" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:41:28 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d15f3173-b775-4af4-8853-ac30368e97f9 tempest-VolumesExtendTest-1843197783 None] Lock "cinder-quobyte-bc467fe4-e46a-4bad-a393-0db82f3dc296" acquired by "delete_volume" :: waited 0.033s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:41:29 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ff34de3-9862-4d70-b2ec-de664eedb992]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:41:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d15f3173-b775-4af4-8853-ac30368e97f9 tempest-VolumesExtendTest-1843197783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bc467fe4-e46a-4bad-a393-0db82f3dc296 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:41:29 devstack sudo[98493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bc467fe4-e46a-4bad-a393-0db82f3dc296
Jul 09 14:41:29 devstack sudo[98493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:41:29 devstack sudo[98424]: pam_unix(sudo:session): session closed for user root
Jul 09 14:41:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-235d7a30-829d-4972-818e-1b551a0a147e tempest-VolumeRetypeWithoutMigrationTest-1680379655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29a0a1ff-3719-42a7-b42e-f7752c32c04a 1073741824" returned: 0 in 1.255s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:41:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-235d7a30-829d-4972-818e-1b551a0a147e tempest-VolumeRetypeWithoutMigrationTest-1680379655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29a0a1ff-3719-42a7-b42e-f7752c32c04a {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:41:29 devstack sudo[98496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29a0a1ff-3719-42a7-b42e-f7752c32c04a
Jul 09 14:41:29 devstack sudo[98496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:41:29 devstack sudo[98493]: pam_unix(sudo:session): session closed for user root
Jul 09 14:41:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d15f3173-b775-4af4-8853-ac30368e97f9 tempest-VolumesExtendTest-1843197783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bc467fe4-e46a-4bad-a393-0db82f3dc296" returned: 0 in 0.956s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:41:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d15f3173-b775-4af4-8853-ac30368e97f9 tempest-VolumesExtendTest-1843197783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bc467fe4-e46a-4bad-a393-0db82f3dc296 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:41:30 devstack sudo[98502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bc467fe4-e46a-4bad-a393-0db82f3dc296
Jul 09 14:41:30 devstack sudo[98502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:41:30 devstack sudo[98496]: pam_unix(sudo:session): session closed for user root
Jul 09 14:41:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-235d7a30-829d-4972-818e-1b551a0a147e tempest-VolumeRetypeWithoutMigrationTest-1680379655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29a0a1ff-3719-42a7-b42e-f7752c32c04a" returned: 0 in 0.756s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:41:30 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-235d7a30-829d-4972-818e-1b551a0a147e tempest-VolumeRetypeWithoutMigrationTest-1680379655 None] <== create_volume: return (2073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:41:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-235d7a30-829d-4972-818e-1b551a0a147e tempest-VolumeRetypeWithoutMigrationTest-1680379655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.075s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:41:30 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-235d7a30-829d-4972-818e-1b551a0a147e tempest-VolumeRetypeWithoutMigrationTest-1680379655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44414bbd-efe1-4a0d-9846-0ea34221063b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29a0a1ff-3719-42a7-b42e-f7752c32c04a', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:41:30 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-235d7a30-829d-4972-818e-1b551a0a147e tempest-VolumeRetypeWithoutMigrationTest-1680379655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1441394-40f8-42cf-9156-a0fffefdac90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:41:30 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-235d7a30-829d-4972-818e-1b551a0a147e tempest-VolumeRetypeWithoutMigrationTest-1680379655 None] Volume volume-29a0a1ff-3719-42a7-b42e-f7752c32c04a (29a0a1ff-3719-42a7-b42e-f7752c32c04a): created successfully
Jul 09 14:41:30 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-235d7a30-829d-4972-818e-1b551a0a147e tempest-VolumeRetypeWithoutMigrationTest-1680379655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1441394-40f8-42cf-9156-a0fffefdac90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:41:30 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-235d7a30-829d-4972-818e-1b551a0a147e tempest-VolumeRetypeWithoutMigrationTest-1680379655 None] Flow 'volume_create_manager' (9e3c269b-22a5-4603-9064-133c4302913b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:41:30 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-235d7a30-829d-4972-818e-1b551a0a147e tempest-VolumeRetypeWithoutMigrationTest-1680379655 None] Created volume successfully.
Jul 09 14:41:30 devstack sudo[98502]: pam_unix(sudo:session): session closed for user root
Jul 09 14:41:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d15f3173-b775-4af4-8853-ac30368e97f9 tempest-VolumesExtendTest-1843197783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bc467fe4-e46a-4bad-a393-0db82f3dc296" returned: 0 in 0.697s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:41:30 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d15f3173-b775-4af4-8853-ac30368e97f9 tempest-VolumesExtendTest-1843197783 None] Lock "cinder-quobyte-bc467fe4-e46a-4bad-a393-0db82f3dc296" released by "delete_volume" :: held 1.729s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:41:30 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-b70c44d6-685b-42a2-bdb1-c9073dfaf6b6 tempest-VolumeTypesAccessTest-301952007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:41:30 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b70c44d6-685b-42a2-bdb1-c9073dfaf6b6 tempest-VolumeTypesAccessTest-301952007 None] Flow 'volume_create_manager' (c0572d0a-be6f-4d90-99f9-9d524e4ca3dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:41:30 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b70c44d6-685b-42a2-bdb1-c9073dfaf6b6 tempest-VolumeTypesAccessTest-301952007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbe49604-da36-41df-8dee-5cef3f26f528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:41:30 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b70c44d6-685b-42a2-bdb1-c9073dfaf6b6 tempest-VolumeTypesAccessTest-301952007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbe49604-da36-41df-8dee-5cef3f26f528) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:41:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-105594365',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32c996a7-17cb-4770-b2cb-778bd3bc53c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27b075ae1b4c44ddab69d9952e177dd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:41:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:41:31Z,use_quota=True,user_id='bf0d86b98a194d0e8b55fe6c87b97ad6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5604e5ae-5f73-4b54-bad9-d4aad4a66ce0),volume_type_id=5604e5ae-5f73-4b54-bad9-d4aad4a66ce0)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:41:30 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b70c44d6-685b-42a2-bdb1-c9073dfaf6b6 tempest-VolumeTypesAccessTest-301952007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e6e203d-0199-4e6b-9275-fa4752442bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:41:30 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b70c44d6-685b-42a2-bdb1-c9073dfaf6b6 tempest-VolumeTypesAccessTest-301952007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e6e203d-0199-4e6b-9275-fa4752442bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:41:30 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b70c44d6-685b-42a2-bdb1-c9073dfaf6b6 tempest-VolumeTypesAccessTest-301952007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56589ba1-9057-4690-bfdb-02458ef09f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:41:30 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b70c44d6-685b-42a2-bdb1-c9073dfaf6b6 tempest-VolumeTypesAccessTest-301952007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56589ba1-9057-4690-bfdb-02458ef09f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32c996a7-17cb-4770-b2cb-778bd3bc53c4', 'volume_name': 'volume-32c996a7-17cb-4770-b2cb-778bd3bc53c4', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:41:30 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b70c44d6-685b-42a2-bdb1-c9073dfaf6b6 tempest-VolumeTypesAccessTest-301952007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (964ac820-b8f3-4a1b-9ddc-cdb197af76f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:41:30 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b70c44d6-685b-42a2-bdb1-c9073dfaf6b6 tempest-VolumeTypesAccessTest-301952007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (964ac820-b8f3-4a1b-9ddc-cdb197af76f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:41:30 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b70c44d6-685b-42a2-bdb1-c9073dfaf6b6 tempest-VolumeTypesAccessTest-301952007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee884aad-f642-4635-a7c2-067f165ca856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:41:30 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-b70c44d6-685b-42a2-bdb1-c9073dfaf6b6 tempest-VolumeTypesAccessTest-301952007 None] Volume 32c996a7-17cb-4770-b2cb-778bd3bc53c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32c996a7-17cb-4770-b2cb-778bd3bc53c4', 'volume_size': 1}
Jul 09 14:41:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b70c44d6-685b-42a2-bdb1-c9073dfaf6b6 tempest-VolumeTypesAccessTest-301952007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:41:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b70c44d6-685b-42a2-bdb1-c9073dfaf6b6 tempest-VolumeTypesAccessTest-301952007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:41:30 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b70c44d6-685b-42a2-bdb1-c9073dfaf6b6 tempest-VolumeTypesAccessTest-301952007 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:41:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-105594365',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32c996a7-17cb-4770-b2cb-778bd3bc53c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27b075ae1b4c44ddab69d9952e177dd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:41:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:41:31Z,use_quota=True,user_id='bf0d86b98a194d0e8b55fe6c87b97ad6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5604e5ae-5f73-4b54-bad9-d4aad4a66ce0),volume_type_id=5604e5ae-5f73-4b54-bad9-d4aad4a66ce0)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:41:30 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-b70c44d6-685b-42a2-bdb1-c9073dfaf6b6 tempest-VolumeTypesAccessTest-301952007 None] Creating volume 32c996a7-17cb-4770-b2cb-778bd3bc53c4 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:41:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b70c44d6-685b-42a2-bdb1-c9073dfaf6b6 tempest-VolumeTypesAccessTest-301952007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:41:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b70c44d6-685b-42a2-bdb1-c9073dfaf6b6 tempest-VolumeTypesAccessTest-301952007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:41:30 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b70c44d6-685b-42a2-bdb1-c9073dfaf6b6 tempest-VolumeTypesAccessTest-301952007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:41:30 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b70c44d6-685b-42a2-bdb1-c9073dfaf6b6 tempest-VolumeTypesAccessTest-301952007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:41:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b70c44d6-685b-42a2-bdb1-c9073dfaf6b6 tempest-VolumeTypesAccessTest-301952007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:41:30 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b70c44d6-685b-42a2-bdb1-c9073dfaf6b6 tempest-VolumeTypesAccessTest-301952007 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:41:30 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-b70c44d6-685b-42a2-bdb1-c9073dfaf6b6 tempest-VolumeTypesAccessTest-301952007 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:41:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b70c44d6-685b-42a2-bdb1-c9073dfaf6b6 tempest-VolumeTypesAccessTest-301952007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-32c996a7-17cb-4770-b2cb-778bd3bc53c4 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:41:30 devstack sudo[98507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-32c996a7-17cb-4770-b2cb-778bd3bc53c4 1073741824
Jul 09 14:41:30 devstack sudo[98507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:41:30 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-d15f3173-b775-4af4-8853-ac30368e97f9 tempest-VolumesExtendTest-1843197783 None] Created reservations ['7a716597-c049-43ea-8138-a991c6ba8abc', '7a1a8e74-b16e-46fd-8188-de61df47ff0b', '30da456c-b2d6-4c98-95f3-02e502c1dc54', '695553c9-c035-4794-b652-e65ec7b64680'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:41:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d15f3173-b775-4af4-8853-ac30368e97f9 tempest-VolumesExtendTest-1843197783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:41:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d15f3173-b775-4af4-8853-ac30368e97f9 tempest-VolumesExtendTest-1843197783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:41:30 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-d15f3173-b775-4af4-8853-ac30368e97f9 tempest-VolumesExtendTest-1843197783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:41:30 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-d15f3173-b775-4af4-8853-ac30368e97f9 tempest-VolumesExtendTest-1843197783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:41:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d15f3173-b775-4af4-8853-ac30368e97f9 tempest-VolumesExtendTest-1843197783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:41:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d15f3173-b775-4af4-8853-ac30368e97f9 tempest-VolumesExtendTest-1843197783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:41:30 devstack sudo[98509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:41:30 devstack sudo[98509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:41:31 devstack sudo[98509]: pam_unix(sudo:session): session closed for user root
Jul 09 14:41:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d15f3173-b775-4af4-8853-ac30368e97f9 tempest-VolumesExtendTest-1843197783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.821s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:41:31 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-d15f3173-b775-4af4-8853-ac30368e97f9 tempest-VolumesExtendTest-1843197783 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:41:31 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-d15f3173-b775-4af4-8853-ac30368e97f9 tempest-VolumesExtendTest-1843197783 None] Deleted volume successfully.
Jul 09 14:41:31 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d15f3173-b775-4af4-8853-ac30368e97f9 tempest-VolumesExtendTest-1843197783 None] Lock "cinder-bc467fe4-e46a-4bad-a393-0db82f3dc296-delete_volume" released by "delete_volume" :: held 2.907s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:41:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-59087f8a-5c9d-4ffb-9ab4-7ccd5f5973f7 tempest-VolumeRetypeWithoutMigrationTest-1680379655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:41:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-59087f8a-5c9d-4ffb-9ab4-7ccd5f5973f7 tempest-VolumeRetypeWithoutMigrationTest-1680379655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:41:31 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-59087f8a-5c9d-4ffb-9ab4-7ccd5f5973f7 tempest-VolumeRetypeWithoutMigrationTest-1680379655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:41:31 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-59087f8a-5c9d-4ffb-9ab4-7ccd5f5973f7 tempest-VolumeRetypeWithoutMigrationTest-1680379655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:41:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-59087f8a-5c9d-4ffb-9ab4-7ccd5f5973f7 tempest-VolumeRetypeWithoutMigrationTest-1680379655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:41:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-59087f8a-5c9d-4ffb-9ab4-7ccd5f5973f7 tempest-VolumeRetypeWithoutMigrationTest-1680379655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:41:31 devstack sudo[98516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:41:31 devstack sudo[98516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:41:31 devstack sudo[98507]: pam_unix(sudo:session): session closed for user root
Jul 09 14:41:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b70c44d6-685b-42a2-bdb1-c9073dfaf6b6 tempest-VolumeTypesAccessTest-301952007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-32c996a7-17cb-4770-b2cb-778bd3bc53c4 1073741824" returned: 0 in 1.096s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:41:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b70c44d6-685b-42a2-bdb1-c9073dfaf6b6 tempest-VolumeTypesAccessTest-301952007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-32c996a7-17cb-4770-b2cb-778bd3bc53c4 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:41:31 devstack sudo[98518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-32c996a7-17cb-4770-b2cb-778bd3bc53c4
Jul 09 14:41:31 devstack sudo[98518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:41:32 devstack sudo[98516]: pam_unix(sudo:session): session closed for user root
Jul 09 14:41:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-59087f8a-5c9d-4ffb-9ab4-7ccd5f5973f7 tempest-VolumeRetypeWithoutMigrationTest-1680379655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.685s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:41:32 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-59087f8a-5c9d-4ffb-9ab4-7ccd5f5973f7 tempest-VolumeRetypeWithoutMigrationTest-1680379655 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:41:32 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-59087f8a-5c9d-4ffb-9ab4-7ccd5f5973f7 tempest-VolumeRetypeWithoutMigrationTest-1680379655 None] Retype volume completed successfully.
Jul 09 14:41:32 devstack sudo[98518]: pam_unix(sudo:session): session closed for user root
Jul 09 14:41:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b70c44d6-685b-42a2-bdb1-c9073dfaf6b6 tempest-VolumeTypesAccessTest-301952007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-32c996a7-17cb-4770-b2cb-778bd3bc53c4" returned: 0 in 0.674s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:41:32 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b70c44d6-685b-42a2-bdb1-c9073dfaf6b6 tempest-VolumeTypesAccessTest-301952007 None] <== create_volume: return (1820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:41:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b70c44d6-685b-42a2-bdb1-c9073dfaf6b6 tempest-VolumeTypesAccessTest-301952007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.822s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:41:32 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b70c44d6-685b-42a2-bdb1-c9073dfaf6b6 tempest-VolumeTypesAccessTest-301952007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee884aad-f642-4635-a7c2-067f165ca856) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32c996a7-17cb-4770-b2cb-778bd3bc53c4', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:41:32 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b70c44d6-685b-42a2-bdb1-c9073dfaf6b6 tempest-VolumeTypesAccessTest-301952007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e822f9d5-92a6-4a6f-bd1b-9c1fabd9d2b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:41:32 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-b70c44d6-685b-42a2-bdb1-c9073dfaf6b6 tempest-VolumeTypesAccessTest-301952007 None] Volume volume-32c996a7-17cb-4770-b2cb-778bd3bc53c4 (32c996a7-17cb-4770-b2cb-778bd3bc53c4): created successfully
Jul 09 14:41:32 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b70c44d6-685b-42a2-bdb1-c9073dfaf6b6 tempest-VolumeTypesAccessTest-301952007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e822f9d5-92a6-4a6f-bd1b-9c1fabd9d2b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:41:32 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b70c44d6-685b-42a2-bdb1-c9073dfaf6b6 tempest-VolumeTypesAccessTest-301952007 None] Flow 'volume_create_manager' (c0572d0a-be6f-4d90-99f9-9d524e4ca3dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:41:32 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-b70c44d6-685b-42a2-bdb1-c9073dfaf6b6 tempest-VolumeTypesAccessTest-301952007 None] Created volume successfully.
Jul 09 14:41:32 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-4b7f389e-499f-4e9b-a3a8-47660b1b2359 tempest-VolumeTypesAccessTest-301952007 None] Acquiring lock "cinder-32c996a7-17cb-4770-b2cb-778bd3bc53c4-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:41:32 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-4b7f389e-499f-4e9b-a3a8-47660b1b2359 tempest-VolumeTypesAccessTest-301952007 None] Lock "cinder-32c996a7-17cb-4770-b2cb-778bd3bc53c4-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:41:32 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-4b7f389e-499f-4e9b-a3a8-47660b1b2359 tempest-VolumeTypesAccessTest-301952007 None] Acquiring lock "cinder-quobyte-32c996a7-17cb-4770-b2cb-778bd3bc53c4" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:41:32 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-4b7f389e-499f-4e9b-a3a8-47660b1b2359 tempest-VolumeTypesAccessTest-301952007 None] Lock "cinder-quobyte-32c996a7-17cb-4770-b2cb-778bd3bc53c4" acquired by "delete_volume" :: waited 0.022s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:41:32 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[1447edbe-98e4-4a5f-9f9a-5f97d8f928b3]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:41:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4b7f389e-499f-4e9b-a3a8-47660b1b2359 tempest-VolumeTypesAccessTest-301952007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-32c996a7-17cb-4770-b2cb-778bd3bc53c4 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:41:33 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-4c870b9b-d4c6-44f2-957c-4238e3954988 tempest-VolumeRetypeWithoutMigrationTest-1680379655 None] Acquiring lock "cinder-29a0a1ff-3719-42a7-b42e-f7752c32c04a-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:41:33 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-4c870b9b-d4c6-44f2-957c-4238e3954988 tempest-VolumeRetypeWithoutMigrationTest-1680379655 None] Lock "cinder-29a0a1ff-3719-42a7-b42e-f7752c32c04a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:41:33 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-4c870b9b-d4c6-44f2-957c-4238e3954988 tempest-VolumeRetypeWithoutMigrationTest-1680379655 None] Acquiring lock "cinder-quobyte-29a0a1ff-3719-42a7-b42e-f7752c32c04a" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:41:33 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-4c870b9b-d4c6-44f2-957c-4238e3954988 tempest-VolumeRetypeWithoutMigrationTest-1680379655 None] Lock "cinder-quobyte-29a0a1ff-3719-42a7-b42e-f7752c32c04a" acquired by "delete_volume" :: waited 0.015s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:41:33 devstack sudo[98522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-32c996a7-17cb-4770-b2cb-778bd3bc53c4
Jul 09 14:41:33 devstack sudo[98522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:41:33 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a5ee23-1070-49bc-a704-2781a25e0f50]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:41:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4c870b9b-d4c6-44f2-957c-4238e3954988 tempest-VolumeRetypeWithoutMigrationTest-1680379655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29a0a1ff-3719-42a7-b42e-f7752c32c04a {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:41:33 devstack sudo[98524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29a0a1ff-3719-42a7-b42e-f7752c32c04a
Jul 09 14:41:33 devstack sudo[98524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:41:33 devstack sudo[98522]: pam_unix(sudo:session): session closed for user root
Jul 09 14:41:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4b7f389e-499f-4e9b-a3a8-47660b1b2359 tempest-VolumeTypesAccessTest-301952007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-32c996a7-17cb-4770-b2cb-778bd3bc53c4" returned: 0 in 0.829s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:41:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4b7f389e-499f-4e9b-a3a8-47660b1b2359 tempest-VolumeTypesAccessTest-301952007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-32c996a7-17cb-4770-b2cb-778bd3bc53c4 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:41:33 devstack sudo[98532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-32c996a7-17cb-4770-b2cb-778bd3bc53c4
Jul 09 14:41:33 devstack sudo[98532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:41:33 devstack sudo[98524]: pam_unix(sudo:session): session closed for user root
Jul 09 14:41:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4c870b9b-d4c6-44f2-957c-4238e3954988 tempest-VolumeRetypeWithoutMigrationTest-1680379655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29a0a1ff-3719-42a7-b42e-f7752c32c04a" returned: 0 in 0.790s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:41:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4c870b9b-d4c6-44f2-957c-4238e3954988 tempest-VolumeRetypeWithoutMigrationTest-1680379655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29a0a1ff-3719-42a7-b42e-f7752c32c04a {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:41:33 devstack sudo[98534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29a0a1ff-3719-42a7-b42e-f7752c32c04a
Jul 09 14:41:33 devstack sudo[98534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:41:34 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-674b49c4-1a5b-4282-9bab-2e40a85506a4 tempest-VolumesGetTest-2096456054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:41:34 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-674b49c4-1a5b-4282-9bab-2e40a85506a4 tempest-VolumesGetTest-2096456054 None] Flow 'volume_create_manager' (1bac62d8-34b3-447c-bb09-756e0d6d90b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:41:34 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-674b49c4-1a5b-4282-9bab-2e40a85506a4 tempest-VolumesGetTest-2096456054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41e8120d-4294-4162-869f-118ac38c680b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:41:34 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-674b49c4-1a5b-4282-9bab-2e40a85506a4 tempest-VolumesGetTest-2096456054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41e8120d-4294-4162-869f-118ac38c680b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:41:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1599746191',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd13f28a-4a4f-4f9d-a061-27fcde58f2a2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='32af181c197945aeb61deace335c7961',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:41:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:41:34Z,use_quota=True,user_id='ba462433f4ed421ca2235f25668a482f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:41:34 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-674b49c4-1a5b-4282-9bab-2e40a85506a4 tempest-VolumesGetTest-2096456054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba3f9eb0-fec2-4b99-8d7b-e4ab310e0bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:41:34 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-674b49c4-1a5b-4282-9bab-2e40a85506a4 tempest-VolumesGetTest-2096456054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba3f9eb0-fec2-4b99-8d7b-e4ab310e0bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:41:34 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-674b49c4-1a5b-4282-9bab-2e40a85506a4 tempest-VolumesGetTest-2096456054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cd900e6-4d73-4c3b-b4d8-f2fcebf5e798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:41:34 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-674b49c4-1a5b-4282-9bab-2e40a85506a4 tempest-VolumesGetTest-2096456054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cd900e6-4d73-4c3b-b4d8-f2fcebf5e798) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd13f28a-4a4f-4f9d-a061-27fcde58f2a2', 'volume_name': 'volume-dd13f28a-4a4f-4f9d-a061-27fcde58f2a2', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:41:34 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-674b49c4-1a5b-4282-9bab-2e40a85506a4 tempest-VolumesGetTest-2096456054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af980f2b-4423-40fa-ae3a-1b36c1b60a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:41:34 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-674b49c4-1a5b-4282-9bab-2e40a85506a4 tempest-VolumesGetTest-2096456054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af980f2b-4423-40fa-ae3a-1b36c1b60a83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:41:34 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-674b49c4-1a5b-4282-9bab-2e40a85506a4 tempest-VolumesGetTest-2096456054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7e7a082-73f8-4f0a-b8da-7b1032792017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:41:34 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-674b49c4-1a5b-4282-9bab-2e40a85506a4 tempest-VolumesGetTest-2096456054 None] Volume dd13f28a-4a4f-4f9d-a061-27fcde58f2a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd13f28a-4a4f-4f9d-a061-27fcde58f2a2', 'volume_size': 1}
Jul 09 14:41:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-674b49c4-1a5b-4282-9bab-2e40a85506a4 tempest-VolumesGetTest-2096456054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:41:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-674b49c4-1a5b-4282-9bab-2e40a85506a4 tempest-VolumesGetTest-2096456054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:41:34 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-674b49c4-1a5b-4282-9bab-2e40a85506a4 tempest-VolumesGetTest-2096456054 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:41:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1599746191',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd13f28a-4a4f-4f9d-a061-27fcde58f2a2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='32af181c197945aeb61deace335c7961',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:41:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:41:34Z,use_quota=True,user_id='ba462433f4ed421ca2235f25668a482f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:41:34 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-674b49c4-1a5b-4282-9bab-2e40a85506a4 tempest-VolumesGetTest-2096456054 None] Creating volume dd13f28a-4a4f-4f9d-a061-27fcde58f2a2 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:41:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-674b49c4-1a5b-4282-9bab-2e40a85506a4 tempest-VolumesGetTest-2096456054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:41:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-674b49c4-1a5b-4282-9bab-2e40a85506a4 tempest-VolumesGetTest-2096456054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:41:34 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-674b49c4-1a5b-4282-9bab-2e40a85506a4 tempest-VolumesGetTest-2096456054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:41:34 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-674b49c4-1a5b-4282-9bab-2e40a85506a4 tempest-VolumesGetTest-2096456054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:41:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-674b49c4-1a5b-4282-9bab-2e40a85506a4 tempest-VolumesGetTest-2096456054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:41:34 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-674b49c4-1a5b-4282-9bab-2e40a85506a4 tempest-VolumesGetTest-2096456054 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:41:34 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-674b49c4-1a5b-4282-9bab-2e40a85506a4 tempest-VolumesGetTest-2096456054 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:41:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-674b49c4-1a5b-4282-9bab-2e40a85506a4 tempest-VolumesGetTest-2096456054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-dd13f28a-4a4f-4f9d-a061-27fcde58f2a2 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:41:34 devstack sudo[98537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-dd13f28a-4a4f-4f9d-a061-27fcde58f2a2 1073741824
Jul 09 14:41:34 devstack sudo[98537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:41:34 devstack sudo[98532]: pam_unix(sudo:session): session closed for user root
Jul 09 14:41:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4b7f389e-499f-4e9b-a3a8-47660b1b2359 tempest-VolumeTypesAccessTest-301952007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-32c996a7-17cb-4770-b2cb-778bd3bc53c4" returned: 0 in 0.738s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:41:34 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-4b7f389e-499f-4e9b-a3a8-47660b1b2359 tempest-VolumeTypesAccessTest-301952007 None] Lock "cinder-quobyte-32c996a7-17cb-4770-b2cb-778bd3bc53c4" released by "delete_volume" :: held 1.618s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:41:34 devstack cinder-volume[87230]: WARNING cinder.quota [None req-4b7f389e-499f-4e9b-a3a8-47660b1b2359 tempest-VolumeTypesAccessTest-301952007 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-854708062 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-854708062, it is now deprecated. Please use the default quota class for default quota.
Jul 09 14:41:34 devstack cinder-volume[87230]: WARNING cinder.quota [None req-4b7f389e-499f-4e9b-a3a8-47660b1b2359 tempest-VolumeTypesAccessTest-301952007 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-854708062 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-854708062, it is now deprecated. Please use the default quota class for default quota.
Jul 09 14:41:34 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-4b7f389e-499f-4e9b-a3a8-47660b1b2359 tempest-VolumeTypesAccessTest-301952007 None] Created reservations ['fa2e3b5d-039e-41cb-adc9-e50376cbf3aa', '6cb0e8ee-ac14-4459-960f-6ddec86bfc43', 'bd2187f1-cadb-465c-ad9e-e1166d5e3340', '4cd04fdf-6481-4e20-bb8b-b0a188d3a85d'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:41:34 devstack sudo[98534]: pam_unix(sudo:session): session closed for user root
Jul 09 14:41:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4c870b9b-d4c6-44f2-957c-4238e3954988 tempest-VolumeRetypeWithoutMigrationTest-1680379655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-29a0a1ff-3719-42a7-b42e-f7752c32c04a" returned: 0 in 0.709s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:41:34 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-4c870b9b-d4c6-44f2-957c-4238e3954988 tempest-VolumeRetypeWithoutMigrationTest-1680379655 None] Lock "cinder-quobyte-29a0a1ff-3719-42a7-b42e-f7752c32c04a" released by "delete_volume" :: held 1.560s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:41:34 devstack cinder-volume[87230]: WARNING cinder.quota [None req-4c870b9b-d4c6-44f2-957c-4238e3954988 tempest-VolumeRetypeWithoutMigrationTest-1680379655 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Jul 09 14:41:34 devstack cinder-volume[87230]: WARNING cinder.quota [None req-4c870b9b-d4c6-44f2-957c-4238e3954988 tempest-VolumeRetypeWithoutMigrationTest-1680379655 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Jul 09 14:41:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-4b7f389e-499f-4e9b-a3a8-47660b1b2359 tempest-VolumeTypesAccessTest-301952007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:41:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-4b7f389e-499f-4e9b-a3a8-47660b1b2359 tempest-VolumeTypesAccessTest-301952007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:41:34 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-4b7f389e-499f-4e9b-a3a8-47660b1b2359 tempest-VolumeTypesAccessTest-301952007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:41:34 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-4b7f389e-499f-4e9b-a3a8-47660b1b2359 tempest-VolumeTypesAccessTest-301952007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:41:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-4b7f389e-499f-4e9b-a3a8-47660b1b2359 tempest-VolumeTypesAccessTest-301952007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:41:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4b7f389e-499f-4e9b-a3a8-47660b1b2359 tempest-VolumeTypesAccessTest-301952007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:41:34 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-4c870b9b-d4c6-44f2-957c-4238e3954988 tempest-VolumeRetypeWithoutMigrationTest-1680379655 None] Created reservations ['9d1ff268-581f-4d9b-b44a-2c2b7c1fecfb', '434abe2d-5fcd-4dc7-9803-5129c781c7d8', '01e06839-183d-4cbe-a120-34726ccf80f2', '1fcb0cde-2ca1-4c1f-8989-aa46d623f94c'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:41:34 devstack sudo[98540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:41:34 devstack sudo[98540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:41:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-4c870b9b-d4c6-44f2-957c-4238e3954988 tempest-VolumeRetypeWithoutMigrationTest-1680379655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:41:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-4c870b9b-d4c6-44f2-957c-4238e3954988 tempest-VolumeRetypeWithoutMigrationTest-1680379655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:41:34 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-4c870b9b-d4c6-44f2-957c-4238e3954988 tempest-VolumeRetypeWithoutMigrationTest-1680379655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:41:34 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-4c870b9b-d4c6-44f2-957c-4238e3954988 tempest-VolumeRetypeWithoutMigrationTest-1680379655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:41:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-4c870b9b-d4c6-44f2-957c-4238e3954988 tempest-VolumeRetypeWithoutMigrationTest-1680379655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:41:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4c870b9b-d4c6-44f2-957c-4238e3954988 tempest-VolumeRetypeWithoutMigrationTest-1680379655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:41:34 devstack sudo[98542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:41:34 devstack sudo[98542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:41:35 devstack sudo[98537]: pam_unix(sudo:session): session closed for user root
Jul 09 14:41:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-674b49c4-1a5b-4282-9bab-2e40a85506a4 tempest-VolumesGetTest-2096456054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-dd13f28a-4a4f-4f9d-a061-27fcde58f2a2 1073741824" returned: 0 in 1.116s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:41:35 devstack sudo[98540]: pam_unix(sudo:session): session closed for user root
Jul 09 14:41:35 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=127,cinder:UPDATE=141,cinder:INSERT=44,cinder:DELETE=11 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 14:41:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4b7f389e-499f-4e9b-a3a8-47660b1b2359 tempest-VolumeTypesAccessTest-301952007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.910s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:41:35 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-4b7f389e-499f-4e9b-a3a8-47660b1b2359 tempest-VolumeTypesAccessTest-301952007 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:41:35 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-4b7f389e-499f-4e9b-a3a8-47660b1b2359 tempest-VolumeTypesAccessTest-301952007 None] Deleted volume successfully.
Jul 09 14:41:35 devstack sudo[98542]: pam_unix(sudo:session): session closed for user root
Jul 09 14:41:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4c870b9b-d4c6-44f2-957c-4238e3954988 tempest-VolumeRetypeWithoutMigrationTest-1680379655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.846s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:41:35 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-4c870b9b-d4c6-44f2-957c-4238e3954988 tempest-VolumeRetypeWithoutMigrationTest-1680379655 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:41:35 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-4c870b9b-d4c6-44f2-957c-4238e3954988 tempest-VolumeRetypeWithoutMigrationTest-1680379655 None] Deleted volume successfully.
Jul 09 14:41:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-674b49c4-1a5b-4282-9bab-2e40a85506a4 tempest-VolumesGetTest-2096456054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-dd13f28a-4a4f-4f9d-a061-27fcde58f2a2 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:41:35 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-4b7f389e-499f-4e9b-a3a8-47660b1b2359 tempest-VolumeTypesAccessTest-301952007 None] Lock "cinder-32c996a7-17cb-4770-b2cb-778bd3bc53c4-delete_volume" released by "delete_volume" :: held 2.849s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:41:35 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-4c870b9b-d4c6-44f2-957c-4238e3954988 tempest-VolumeRetypeWithoutMigrationTest-1680379655 None] Lock "cinder-29a0a1ff-3719-42a7-b42e-f7752c32c04a-delete_volume" released by "delete_volume" :: held 2.690s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:41:35 devstack sudo[98550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-dd13f28a-4a4f-4f9d-a061-27fcde58f2a2
Jul 09 14:41:35 devstack sudo[98550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:41:36 devstack sudo[98550]: pam_unix(sudo:session): session closed for user root
Jul 09 14:41:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-674b49c4-1a5b-4282-9bab-2e40a85506a4 tempest-VolumesGetTest-2096456054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-dd13f28a-4a4f-4f9d-a061-27fcde58f2a2" returned: 0 in 0.918s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:41:36 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-674b49c4-1a5b-4282-9bab-2e40a85506a4 tempest-VolumesGetTest-2096456054 None] <== create_volume: return (2122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:41:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-674b49c4-1a5b-4282-9bab-2e40a85506a4 tempest-VolumesGetTest-2096456054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.124s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:41:36 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-674b49c4-1a5b-4282-9bab-2e40a85506a4 tempest-VolumesGetTest-2096456054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7e7a082-73f8-4f0a-b8da-7b1032792017) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd13f28a-4a4f-4f9d-a061-27fcde58f2a2', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:41:36 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-674b49c4-1a5b-4282-9bab-2e40a85506a4 tempest-VolumesGetTest-2096456054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e2831ab-80aa-4452-bb84-1113c4e8cc58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:41:36 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-674b49c4-1a5b-4282-9bab-2e40a85506a4 tempest-VolumesGetTest-2096456054 None] Volume volume-dd13f28a-4a4f-4f9d-a061-27fcde58f2a2 (dd13f28a-4a4f-4f9d-a061-27fcde58f2a2): created successfully
Jul 09 14:41:36 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-674b49c4-1a5b-4282-9bab-2e40a85506a4 tempest-VolumesGetTest-2096456054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e2831ab-80aa-4452-bb84-1113c4e8cc58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:41:36 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-674b49c4-1a5b-4282-9bab-2e40a85506a4 tempest-VolumesGetTest-2096456054 None] Flow 'volume_create_manager' (1bac62d8-34b3-447c-bb09-756e0d6d90b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:41:36 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-674b49c4-1a5b-4282-9bab-2e40a85506a4 tempest-VolumesGetTest-2096456054 None] Created volume successfully.
Jul 09 14:41:38 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-8099b096-f7a5-49a8-9557-4ea8ec50cfcd tempest-VolumesGetTest-2096456054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:41:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8099b096-f7a5-49a8-9557-4ea8ec50cfcd tempest-VolumesGetTest-2096456054 None] Flow 'volume_create_manager' (aa703d04-61e9-4af0-9225-28041b210200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:41:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8099b096-f7a5-49a8-9557-4ea8ec50cfcd tempest-VolumesGetTest-2096456054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5eb31b16-6daf-4fa8-a61e-6d6aecf5a107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:41:39 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8099b096-f7a5-49a8-9557-4ea8ec50cfcd tempest-VolumesGetTest-2096456054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5eb31b16-6daf-4fa8-a61e-6d6aecf5a107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:41:39Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-753894018',display_name='tempest-VolumesGetTest-Volume-1856406431',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cce2ac9b-5ff6-44d9-9dfd-b4731ac24081,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32af181c197945aeb61deace335c7961',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:41:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:41:39Z,use_quota=True,user_id='ba462433f4ed421ca2235f25668a482f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:41:39 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8099b096-f7a5-49a8-9557-4ea8ec50cfcd tempest-VolumesGetTest-2096456054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06c2e060-d6a1-42c5-87d1-508c18dbea43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:41:39 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8099b096-f7a5-49a8-9557-4ea8ec50cfcd tempest-VolumesGetTest-2096456054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06c2e060-d6a1-42c5-87d1-508c18dbea43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:41:39 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8099b096-f7a5-49a8-9557-4ea8ec50cfcd tempest-VolumesGetTest-2096456054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c8d63bd-688a-484a-87a5-13eb6988c2e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:41:39 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8099b096-f7a5-49a8-9557-4ea8ec50cfcd tempest-VolumesGetTest-2096456054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c8d63bd-688a-484a-87a5-13eb6988c2e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cce2ac9b-5ff6-44d9-9dfd-b4731ac24081', 'volume_name': 'volume-cce2ac9b-5ff6-44d9-9dfd-b4731ac24081', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:41:39 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8099b096-f7a5-49a8-9557-4ea8ec50cfcd tempest-VolumesGetTest-2096456054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (047ca554-2142-4ad6-b673-af063d5a3ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:41:39 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8099b096-f7a5-49a8-9557-4ea8ec50cfcd tempest-VolumesGetTest-2096456054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (047ca554-2142-4ad6-b673-af063d5a3ac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:41:39 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8099b096-f7a5-49a8-9557-4ea8ec50cfcd tempest-VolumesGetTest-2096456054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffc994c7-19f3-494f-b728-476b4e1f7c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:41:39 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-8099b096-f7a5-49a8-9557-4ea8ec50cfcd tempest-VolumesGetTest-2096456054 None] Volume cce2ac9b-5ff6-44d9-9dfd-b4731ac24081: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cce2ac9b-5ff6-44d9-9dfd-b4731ac24081', 'volume_size': 1}
Jul 09 14:41:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8099b096-f7a5-49a8-9557-4ea8ec50cfcd tempest-VolumesGetTest-2096456054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:41:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8099b096-f7a5-49a8-9557-4ea8ec50cfcd tempest-VolumesGetTest-2096456054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:41:39 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-8099b096-f7a5-49a8-9557-4ea8ec50cfcd tempest-VolumesGetTest-2096456054 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:41:39Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-753894018',display_name='tempest-VolumesGetTest-Volume-1856406431',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cce2ac9b-5ff6-44d9-9dfd-b4731ac24081,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32af181c197945aeb61deace335c7961',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:41:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:41:39Z,use_quota=True,user_id='ba462433f4ed421ca2235f25668a482f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:41:39 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-8099b096-f7a5-49a8-9557-4ea8ec50cfcd tempest-VolumesGetTest-2096456054 None] Creating volume cce2ac9b-5ff6-44d9-9dfd-b4731ac24081 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:41:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8099b096-f7a5-49a8-9557-4ea8ec50cfcd tempest-VolumesGetTest-2096456054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:41:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8099b096-f7a5-49a8-9557-4ea8ec50cfcd tempest-VolumesGetTest-2096456054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:41:39 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-8099b096-f7a5-49a8-9557-4ea8ec50cfcd tempest-VolumesGetTest-2096456054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:41:39 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-8099b096-f7a5-49a8-9557-4ea8ec50cfcd tempest-VolumesGetTest-2096456054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:41:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8099b096-f7a5-49a8-9557-4ea8ec50cfcd tempest-VolumesGetTest-2096456054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:41:39 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-8099b096-f7a5-49a8-9557-4ea8ec50cfcd tempest-VolumesGetTest-2096456054 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:41:39 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-8099b096-f7a5-49a8-9557-4ea8ec50cfcd tempest-VolumesGetTest-2096456054 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:41:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8099b096-f7a5-49a8-9557-4ea8ec50cfcd tempest-VolumesGetTest-2096456054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-cce2ac9b-5ff6-44d9-9dfd-b4731ac24081 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:41:39 devstack sudo[98560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-cce2ac9b-5ff6-44d9-9dfd-b4731ac24081 1073741824
Jul 09 14:41:39 devstack sudo[98560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:41:40 devstack sudo[98560]: pam_unix(sudo:session): session closed for user root
Jul 09 14:41:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8099b096-f7a5-49a8-9557-4ea8ec50cfcd tempest-VolumesGetTest-2096456054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-cce2ac9b-5ff6-44d9-9dfd-b4731ac24081 1073741824" returned: 0 in 1.047s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:41:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8099b096-f7a5-49a8-9557-4ea8ec50cfcd tempest-VolumesGetTest-2096456054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-cce2ac9b-5ff6-44d9-9dfd-b4731ac24081 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:41:40 devstack sudo[98600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-cce2ac9b-5ff6-44d9-9dfd-b4731ac24081
Jul 09 14:41:40 devstack sudo[98600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:41:40 devstack sudo[98600]: pam_unix(sudo:session): session closed for user root
Jul 09 14:41:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8099b096-f7a5-49a8-9557-4ea8ec50cfcd tempest-VolumesGetTest-2096456054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-cce2ac9b-5ff6-44d9-9dfd-b4731ac24081" returned: 0 in 0.798s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:41:40 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-8099b096-f7a5-49a8-9557-4ea8ec50cfcd tempest-VolumesGetTest-2096456054 None] <== create_volume: return (1910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:41:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8099b096-f7a5-49a8-9557-4ea8ec50cfcd tempest-VolumesGetTest-2096456054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.913s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:41:41 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8099b096-f7a5-49a8-9557-4ea8ec50cfcd tempest-VolumesGetTest-2096456054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffc994c7-19f3-494f-b728-476b4e1f7c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cce2ac9b-5ff6-44d9-9dfd-b4731ac24081', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:41:41 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8099b096-f7a5-49a8-9557-4ea8ec50cfcd tempest-VolumesGetTest-2096456054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7388b73-36c9-42e2-a813-689243d4e6f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:41:41 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-8099b096-f7a5-49a8-9557-4ea8ec50cfcd tempest-VolumesGetTest-2096456054 None] Volume volume-cce2ac9b-5ff6-44d9-9dfd-b4731ac24081 (cce2ac9b-5ff6-44d9-9dfd-b4731ac24081): created successfully
Jul 09 14:41:41 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8099b096-f7a5-49a8-9557-4ea8ec50cfcd tempest-VolumesGetTest-2096456054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7388b73-36c9-42e2-a813-689243d4e6f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:41:41 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8099b096-f7a5-49a8-9557-4ea8ec50cfcd tempest-VolumesGetTest-2096456054 None] Flow 'volume_create_manager' (aa703d04-61e9-4af0-9225-28041b210200) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:41:41 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-8099b096-f7a5-49a8-9557-4ea8ec50cfcd tempest-VolumesGetTest-2096456054 None] Created volume successfully.
Jul 09 14:41:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-76a9b70e-0d6d-4535-a358-8285698f0ea6 req-ca3e1323-7967-4aea-beb6-225e6fd0080e tempest-TestInstancesWithCinderVolumes-1507168999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:41:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-76a9b70e-0d6d-4535-a358-8285698f0ea6 req-ca3e1323-7967-4aea-beb6-225e6fd0080e tempest-TestInstancesWithCinderVolumes-1507168999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:41:41 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7525d22-f409-403f-8750-5acdb2efee37]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:41:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-76a9b70e-0d6d-4535-a358-8285698f0ea6 req-ca3e1323-7967-4aea-beb6-225e6fd0080e tempest-TestInstancesWithCinderVolumes-1507168999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ffedc0c5-a50b-4b16-8c53-4c21c22887bd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:41:42 devstack sudo[98614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ffedc0c5-a50b-4b16-8c53-4c21c22887bd
Jul 09 14:41:42 devstack sudo[98614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:41:42 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-6d5cdee6-d6e4-49fd-9b5a-3f6e4d8814c7 tempest-VolumesGetTest-2096456054 None] Acquiring lock "cinder-cce2ac9b-5ff6-44d9-9dfd-b4731ac24081-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:41:42 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-6d5cdee6-d6e4-49fd-9b5a-3f6e4d8814c7 tempest-VolumesGetTest-2096456054 None] Lock "cinder-cce2ac9b-5ff6-44d9-9dfd-b4731ac24081-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:41:42 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-6d5cdee6-d6e4-49fd-9b5a-3f6e4d8814c7 tempest-VolumesGetTest-2096456054 None] Acquiring lock "cinder-quobyte-cce2ac9b-5ff6-44d9-9dfd-b4731ac24081" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:41:42 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-6d5cdee6-d6e4-49fd-9b5a-3f6e4d8814c7 tempest-VolumesGetTest-2096456054 None] Lock "cinder-quobyte-cce2ac9b-5ff6-44d9-9dfd-b4731ac24081" acquired by "delete_volume" :: waited 0.018s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:41:42 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[f67704c7-30bd-41a9-ae61-d609ac9fc8c3]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:41:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6d5cdee6-d6e4-49fd-9b5a-3f6e4d8814c7 tempest-VolumesGetTest-2096456054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-cce2ac9b-5ff6-44d9-9dfd-b4731ac24081 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:41:42 devstack sudo[98616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-cce2ac9b-5ff6-44d9-9dfd-b4731ac24081
Jul 09 14:41:42 devstack sudo[98616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:41:43 devstack sudo[98614]: pam_unix(sudo:session): session closed for user root
Jul 09 14:41:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-76a9b70e-0d6d-4535-a358-8285698f0ea6 req-ca3e1323-7967-4aea-beb6-225e6fd0080e tempest-TestInstancesWithCinderVolumes-1507168999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ffedc0c5-a50b-4b16-8c53-4c21c22887bd" returned: 0 in 1.072s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:41:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-76a9b70e-0d6d-4535-a358-8285698f0ea6 req-ca3e1323-7967-4aea-beb6-225e6fd0080e tempest-TestInstancesWithCinderVolumes-1507168999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.099s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:41:43 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-76a9b70e-0d6d-4535-a358-8285698f0ea6 req-ca3e1323-7967-4aea-beb6-225e6fd0080e tempest-TestInstancesWithCinderVolumes-1507168999 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653', 'name': 'volume-ffedc0c5-a50b-4b16-8c53-4c21c22887bd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '447634cd-ab02-4107-8d6c-aa1392c6dfb7', 'enforce_multipath': True} {{(pid=87230) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 09 14:41:43 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-76a9b70e-0d6d-4535-a358-8285698f0ea6 req-ca3e1323-7967-4aea-beb6-225e6fd0080e tempest-TestInstancesWithCinderVolumes-1507168999 None] attachment_update completed successfully.
Jul 09 14:41:43 devstack sudo[98616]: pam_unix(sudo:session): session closed for user root
Jul 09 14:41:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6d5cdee6-d6e4-49fd-9b5a-3f6e4d8814c7 tempest-VolumesGetTest-2096456054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-cce2ac9b-5ff6-44d9-9dfd-b4731ac24081" returned: 0 in 1.086s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:41:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6d5cdee6-d6e4-49fd-9b5a-3f6e4d8814c7 tempest-VolumesGetTest-2096456054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-cce2ac9b-5ff6-44d9-9dfd-b4731ac24081 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:41:43 devstack sudo[98625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-cce2ac9b-5ff6-44d9-9dfd-b4731ac24081
Jul 09 14:41:43 devstack sudo[98625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:41:44 devstack sudo[98625]: pam_unix(sudo:session): session closed for user root
Jul 09 14:41:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6d5cdee6-d6e4-49fd-9b5a-3f6e4d8814c7 tempest-VolumesGetTest-2096456054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-cce2ac9b-5ff6-44d9-9dfd-b4731ac24081" returned: 0 in 0.801s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:41:44 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-6d5cdee6-d6e4-49fd-9b5a-3f6e4d8814c7 tempest-VolumesGetTest-2096456054 None] Lock "cinder-quobyte-cce2ac9b-5ff6-44d9-9dfd-b4731ac24081" released by "delete_volume" :: held 1.951s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:41:44 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-6d5cdee6-d6e4-49fd-9b5a-3f6e4d8814c7 tempest-VolumesGetTest-2096456054 None] Created reservations ['a4b1b38b-e431-4c53-add7-232e15c3ebc5', '4a197ab8-e22d-47b9-8fad-685497276a68', '84f9cc95-1bdf-4a99-bf33-25eea5ade159', 'f047fc33-d9ce-4c43-9322-0dc8c56d9749'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:41:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6d5cdee6-d6e4-49fd-9b5a-3f6e4d8814c7 tempest-VolumesGetTest-2096456054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:41:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6d5cdee6-d6e4-49fd-9b5a-3f6e4d8814c7 tempest-VolumesGetTest-2096456054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:41:44 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-6d5cdee6-d6e4-49fd-9b5a-3f6e4d8814c7 tempest-VolumesGetTest-2096456054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:41:44 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-6d5cdee6-d6e4-49fd-9b5a-3f6e4d8814c7 tempest-VolumesGetTest-2096456054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:41:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6d5cdee6-d6e4-49fd-9b5a-3f6e4d8814c7 tempest-VolumesGetTest-2096456054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:41:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6d5cdee6-d6e4-49fd-9b5a-3f6e4d8814c7 tempest-VolumesGetTest-2096456054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:41:44 devstack sudo[98630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:41:44 devstack sudo[98630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:41:44 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-0de85fe0-1ce3-4d2c-abb3-156f339da9ce tempest-VolumesGetTest-2096456054 None] Acquiring lock "cinder-dd13f28a-4a4f-4f9d-a061-27fcde58f2a2-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:41:44 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-0de85fe0-1ce3-4d2c-abb3-156f339da9ce tempest-VolumesGetTest-2096456054 None] Lock "cinder-dd13f28a-4a4f-4f9d-a061-27fcde58f2a2-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:41:44 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-0de85fe0-1ce3-4d2c-abb3-156f339da9ce tempest-VolumesGetTest-2096456054 None] Acquiring lock "cinder-quobyte-dd13f28a-4a4f-4f9d-a061-27fcde58f2a2" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:41:44 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-0de85fe0-1ce3-4d2c-abb3-156f339da9ce tempest-VolumesGetTest-2096456054 None] Lock "cinder-quobyte-dd13f28a-4a4f-4f9d-a061-27fcde58f2a2" acquired by "delete_volume" :: waited 0.023s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:41:44 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[33b770e9-eaa5-4b7d-bc87-21ace08db460]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:41:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0de85fe0-1ce3-4d2c-abb3-156f339da9ce tempest-VolumesGetTest-2096456054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-dd13f28a-4a4f-4f9d-a061-27fcde58f2a2 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:41:45 devstack sudo[98632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-dd13f28a-4a4f-4f9d-a061-27fcde58f2a2
Jul 09 14:41:45 devstack sudo[98632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:41:45 devstack sudo[98630]: pam_unix(sudo:session): session closed for user root
Jul 09 14:41:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6d5cdee6-d6e4-49fd-9b5a-3f6e4d8814c7 tempest-VolumesGetTest-2096456054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.989s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:41:45 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-6d5cdee6-d6e4-49fd-9b5a-3f6e4d8814c7 tempest-VolumesGetTest-2096456054 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:41:45 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-6d5cdee6-d6e4-49fd-9b5a-3f6e4d8814c7 tempest-VolumesGetTest-2096456054 None] Deleted volume successfully.
Jul 09 14:41:45 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-6d5cdee6-d6e4-49fd-9b5a-3f6e4d8814c7 tempest-VolumesGetTest-2096456054 None] Lock "cinder-cce2ac9b-5ff6-44d9-9dfd-b4731ac24081-delete_volume" released by "delete_volume" :: held 3.173s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:41:45 devstack sudo[98632]: pam_unix(sudo:session): session closed for user root
Jul 09 14:41:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0de85fe0-1ce3-4d2c-abb3-156f339da9ce tempest-VolumesGetTest-2096456054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-dd13f28a-4a4f-4f9d-a061-27fcde58f2a2" returned: 0 in 0.912s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:41:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0de85fe0-1ce3-4d2c-abb3-156f339da9ce tempest-VolumesGetTest-2096456054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-dd13f28a-4a4f-4f9d-a061-27fcde58f2a2 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:41:45 devstack sudo[98638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-dd13f28a-4a4f-4f9d-a061-27fcde58f2a2
Jul 09 14:41:45 devstack sudo[98638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:41:46 devstack sudo[98638]: pam_unix(sudo:session): session closed for user root
Jul 09 14:41:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0de85fe0-1ce3-4d2c-abb3-156f339da9ce tempest-VolumesGetTest-2096456054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-dd13f28a-4a4f-4f9d-a061-27fcde58f2a2" returned: 0 in 0.821s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:41:46 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-0de85fe0-1ce3-4d2c-abb3-156f339da9ce tempest-VolumesGetTest-2096456054 None] Lock "cinder-quobyte-dd13f28a-4a4f-4f9d-a061-27fcde58f2a2" released by "delete_volume" :: held 1.787s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:41:46 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-0de85fe0-1ce3-4d2c-abb3-156f339da9ce tempest-VolumesGetTest-2096456054 None] Created reservations ['af5cb0e7-2648-4b27-87f2-61e8273c7039', '86f4b694-f77a-4f80-ad75-20036fd90b86', '71a5b5a1-c777-43c6-8de1-aef0cd44b1f0', '522a21cf-bff4-424f-b713-4b825d18a442'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:41:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0de85fe0-1ce3-4d2c-abb3-156f339da9ce tempest-VolumesGetTest-2096456054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:41:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0de85fe0-1ce3-4d2c-abb3-156f339da9ce tempest-VolumesGetTest-2096456054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:41:46 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-0de85fe0-1ce3-4d2c-abb3-156f339da9ce tempest-VolumesGetTest-2096456054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:41:46 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-0de85fe0-1ce3-4d2c-abb3-156f339da9ce tempest-VolumesGetTest-2096456054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:41:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0de85fe0-1ce3-4d2c-abb3-156f339da9ce tempest-VolumesGetTest-2096456054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:41:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0de85fe0-1ce3-4d2c-abb3-156f339da9ce tempest-VolumesGetTest-2096456054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:41:46 devstack sudo[98641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:41:46 devstack sudo[98641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:41:47 devstack sudo[98641]: pam_unix(sudo:session): session closed for user root
Jul 09 14:41:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0de85fe0-1ce3-4d2c-abb3-156f339da9ce tempest-VolumesGetTest-2096456054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.985s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:41:47 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-0de85fe0-1ce3-4d2c-abb3-156f339da9ce tempest-VolumesGetTest-2096456054 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:41:47 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-0de85fe0-1ce3-4d2c-abb3-156f339da9ce tempest-VolumesGetTest-2096456054 None] Deleted volume successfully.
Jul 09 14:41:47 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-252f512d-551d-4659-bdaa-1e2b06fd5a12 tempest-VolumesGetTest-2096456054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:41:47 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-252f512d-551d-4659-bdaa-1e2b06fd5a12 tempest-VolumesGetTest-2096456054 None] Flow 'volume_create_manager' (c4001407-77c5-42e9-a7db-3b95fc7e8739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:41:47 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-252f512d-551d-4659-bdaa-1e2b06fd5a12 tempest-VolumesGetTest-2096456054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (337b06f3-206c-4e3e-965e-72ca9c17bd2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:41:47 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-252f512d-551d-4659-bdaa-1e2b06fd5a12 tempest-VolumesGetTest-2096456054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (337b06f3-206c-4e3e-965e-72ca9c17bd2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:41:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-878137021',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33b36218-8a01-4afa-8d92-2b01d57eff61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32af181c197945aeb61deace335c7961',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:41:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:41:48Z,use_quota=True,user_id='ba462433f4ed421ca2235f25668a482f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:41:47 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-252f512d-551d-4659-bdaa-1e2b06fd5a12 tempest-VolumesGetTest-2096456054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78d72956-70cf-4291-a2d4-17aa6251199c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:41:47 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-252f512d-551d-4659-bdaa-1e2b06fd5a12 tempest-VolumesGetTest-2096456054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78d72956-70cf-4291-a2d4-17aa6251199c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:41:47 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-252f512d-551d-4659-bdaa-1e2b06fd5a12 tempest-VolumesGetTest-2096456054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03ed07df-c342-4d0b-9363-7e4d076a1d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:41:47 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-252f512d-551d-4659-bdaa-1e2b06fd5a12 tempest-VolumesGetTest-2096456054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03ed07df-c342-4d0b-9363-7e4d076a1d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33b36218-8a01-4afa-8d92-2b01d57eff61', 'volume_name': 'volume-33b36218-8a01-4afa-8d92-2b01d57eff61', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:41:47 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-252f512d-551d-4659-bdaa-1e2b06fd5a12 tempest-VolumesGetTest-2096456054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f79dfd33-bbdf-4977-af16-0a8dd3dcc2c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:41:47 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-252f512d-551d-4659-bdaa-1e2b06fd5a12 tempest-VolumesGetTest-2096456054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f79dfd33-bbdf-4977-af16-0a8dd3dcc2c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:41:47 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-252f512d-551d-4659-bdaa-1e2b06fd5a12 tempest-VolumesGetTest-2096456054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (817c5d9f-53e7-4065-a2eb-c6554a0bf3ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:41:48 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-252f512d-551d-4659-bdaa-1e2b06fd5a12 tempest-VolumesGetTest-2096456054 None] Volume 33b36218-8a01-4afa-8d92-2b01d57eff61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33b36218-8a01-4afa-8d92-2b01d57eff61', 'volume_size': 1}
Jul 09 14:41:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-252f512d-551d-4659-bdaa-1e2b06fd5a12 tempest-VolumesGetTest-2096456054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:41:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-252f512d-551d-4659-bdaa-1e2b06fd5a12 tempest-VolumesGetTest-2096456054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:41:48 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-252f512d-551d-4659-bdaa-1e2b06fd5a12 tempest-VolumesGetTest-2096456054 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:41:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-878137021',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33b36218-8a01-4afa-8d92-2b01d57eff61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32af181c197945aeb61deace335c7961',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:41:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:41:48Z,use_quota=True,user_id='ba462433f4ed421ca2235f25668a482f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:41:48 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-252f512d-551d-4659-bdaa-1e2b06fd5a12 tempest-VolumesGetTest-2096456054 None] Creating volume 33b36218-8a01-4afa-8d92-2b01d57eff61 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:41:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-252f512d-551d-4659-bdaa-1e2b06fd5a12 tempest-VolumesGetTest-2096456054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:41:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-252f512d-551d-4659-bdaa-1e2b06fd5a12 tempest-VolumesGetTest-2096456054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:41:48 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-252f512d-551d-4659-bdaa-1e2b06fd5a12 tempest-VolumesGetTest-2096456054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:41:48 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-252f512d-551d-4659-bdaa-1e2b06fd5a12 tempest-VolumesGetTest-2096456054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:41:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-252f512d-551d-4659-bdaa-1e2b06fd5a12 tempest-VolumesGetTest-2096456054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:41:48 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-252f512d-551d-4659-bdaa-1e2b06fd5a12 tempest-VolumesGetTest-2096456054 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:41:48 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-252f512d-551d-4659-bdaa-1e2b06fd5a12 tempest-VolumesGetTest-2096456054 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:41:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-252f512d-551d-4659-bdaa-1e2b06fd5a12 tempest-VolumesGetTest-2096456054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-33b36218-8a01-4afa-8d92-2b01d57eff61 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:41:48 devstack sudo[98644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-33b36218-8a01-4afa-8d92-2b01d57eff61 1073741824
Jul 09 14:41:48 devstack sudo[98644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:41:48 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-0de85fe0-1ce3-4d2c-abb3-156f339da9ce tempest-VolumesGetTest-2096456054 None] Lock "cinder-dd13f28a-4a4f-4f9d-a061-27fcde58f2a2-delete_volume" released by "delete_volume" :: held 3.211s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:41:49 devstack sudo[98644]: pam_unix(sudo:session): session closed for user root
Jul 09 14:41:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-252f512d-551d-4659-bdaa-1e2b06fd5a12 tempest-VolumesGetTest-2096456054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-33b36218-8a01-4afa-8d92-2b01d57eff61 1073741824" returned: 0 in 1.035s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:41:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-252f512d-551d-4659-bdaa-1e2b06fd5a12 tempest-VolumesGetTest-2096456054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-33b36218-8a01-4afa-8d92-2b01d57eff61 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:41:49 devstack sudo[98659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-33b36218-8a01-4afa-8d92-2b01d57eff61
Jul 09 14:41:49 devstack sudo[98659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:41:49 devstack sudo[98659]: pam_unix(sudo:session): session closed for user root
Jul 09 14:41:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-252f512d-551d-4659-bdaa-1e2b06fd5a12 tempest-VolumesGetTest-2096456054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-33b36218-8a01-4afa-8d92-2b01d57eff61" returned: 0 in 0.754s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:41:49 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-252f512d-551d-4659-bdaa-1e2b06fd5a12 tempest-VolumesGetTest-2096456054 None] <== create_volume: return (1840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:41:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-252f512d-551d-4659-bdaa-1e2b06fd5a12 tempest-VolumesGetTest-2096456054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.843s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:41:49 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-252f512d-551d-4659-bdaa-1e2b06fd5a12 tempest-VolumesGetTest-2096456054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (817c5d9f-53e7-4065-a2eb-c6554a0bf3ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33b36218-8a01-4afa-8d92-2b01d57eff61', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:41:49 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-252f512d-551d-4659-bdaa-1e2b06fd5a12 tempest-VolumesGetTest-2096456054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (758164d4-6e19-4997-a242-f892a66fa9f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:41:49 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-252f512d-551d-4659-bdaa-1e2b06fd5a12 tempest-VolumesGetTest-2096456054 None] Volume volume-33b36218-8a01-4afa-8d92-2b01d57eff61 (33b36218-8a01-4afa-8d92-2b01d57eff61): created successfully
Jul 09 14:41:49 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-252f512d-551d-4659-bdaa-1e2b06fd5a12 tempest-VolumesGetTest-2096456054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (758164d4-6e19-4997-a242-f892a66fa9f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:41:49 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-252f512d-551d-4659-bdaa-1e2b06fd5a12 tempest-VolumesGetTest-2096456054 None] Flow 'volume_create_manager' (c4001407-77c5-42e9-a7db-3b95fc7e8739) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:41:49 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-252f512d-551d-4659-bdaa-1e2b06fd5a12 tempest-VolumesGetTest-2096456054 None] Created volume successfully.
Jul 09 14:41:51 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-defd47b0-ab71-413e-a2c3-5580bbd6265f tempest-VolumesGetTest-2096456054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:41:51 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-defd47b0-ab71-413e-a2c3-5580bbd6265f tempest-VolumesGetTest-2096456054 None] Flow 'volume_create_manager' (9d12531d-02e2-4a35-a36a-5cfd395b65a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:41:51 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-defd47b0-ab71-413e-a2c3-5580bbd6265f tempest-VolumesGetTest-2096456054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d47f5d69-9326-42a3-905a-a4bd6a462d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:41:51 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-defd47b0-ab71-413e-a2c3-5580bbd6265f tempest-VolumesGetTest-2096456054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d47f5d69-9326-42a3-905a-a4bd6a462d17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:41:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1828149039',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cea1c4c3-756c-4866-80b8-ad5d776b14d1,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='32af181c197945aeb61deace335c7961',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:41:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=33b36218-8a01-4afa-8d92-2b01d57eff61,status='creating',terminated_at=None,updated_at=2026-07-09T12:41:52Z,use_quota=True,user_id='ba462433f4ed421ca2235f25668a482f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:41:51 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-defd47b0-ab71-413e-a2c3-5580bbd6265f tempest-VolumesGetTest-2096456054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b89b1ec0-8c07-4b3e-bf91-e4f9163e52a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:41:51 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-defd47b0-ab71-413e-a2c3-5580bbd6265f tempest-VolumesGetTest-2096456054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b89b1ec0-8c07-4b3e-bf91-e4f9163e52a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:41:51 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-defd47b0-ab71-413e-a2c3-5580bbd6265f tempest-VolumesGetTest-2096456054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc8382e8-801f-4590-9d98-3eb2993df090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:41:51 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-defd47b0-ab71-413e-a2c3-5580bbd6265f tempest-VolumesGetTest-2096456054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc8382e8-801f-4590-9d98-3eb2993df090) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'cea1c4c3-756c-4866-80b8-ad5d776b14d1', 'volume_name': 'volume-cea1c4c3-756c-4866-80b8-ad5d776b14d1', 'volume_size': 1, 'source_volid': '33b36218-8a01-4afa-8d92-2b01d57eff61', 'source_volstatus': 'available'}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:41:51 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-defd47b0-ab71-413e-a2c3-5580bbd6265f tempest-VolumesGetTest-2096456054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b96cd41-6b8d-4470-b7ef-706f39f87fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:41:51 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-defd47b0-ab71-413e-a2c3-5580bbd6265f tempest-VolumesGetTest-2096456054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b96cd41-6b8d-4470-b7ef-706f39f87fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:41:51 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-defd47b0-ab71-413e-a2c3-5580bbd6265f tempest-VolumesGetTest-2096456054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98eb7f69-b6a9-44ac-b7e1-f795590b791e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:41:51 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-defd47b0-ab71-413e-a2c3-5580bbd6265f tempest-VolumesGetTest-2096456054 None] Volume cea1c4c3-756c-4866-80b8-ad5d776b14d1: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-cea1c4c3-756c-4866-80b8-ad5d776b14d1', 'volume_size': 1, 'source_volid': '33b36218-8a01-4afa-8d92-2b01d57eff61', 'source_volstatus': 'available'}
Jul 09 14:41:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-defd47b0-ab71-413e-a2c3-5580bbd6265f tempest-VolumesGetTest-2096456054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:41:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-defd47b0-ab71-413e-a2c3-5580bbd6265f tempest-VolumesGetTest-2096456054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:41:51 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-defd47b0-ab71-413e-a2c3-5580bbd6265f tempest-VolumesGetTest-2096456054 None] Cloning volume 33b36218-8a01-4afa-8d92-2b01d57eff61 to volume cea1c4c3-756c-4866-80b8-ad5d776b14d1
Jul 09 14:41:52 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-defd47b0-ab71-413e-a2c3-5580bbd6265f tempest-VolumesGetTest-2096456054 None] Creating offline snapshot 31d99fab-17e9-4bfc-8b13-99c46e54006b of volume 33b36218-8a01-4afa-8d92-2b01d57eff61 {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 14:41:52 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fba78e5-652a-4cf6-99bd-696cc6474dfc]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:41:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-defd47b0-ab71-413e-a2c3-5580bbd6265f tempest-VolumesGetTest-2096456054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-33b36218-8a01-4afa-8d92-2b01d57eff61 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:41:52 devstack sudo[98669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-33b36218-8a01-4afa-8d92-2b01d57eff61
Jul 09 14:41:52 devstack sudo[98669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:41:52 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0392bb0-20b5-4baa-8235-ebf406dbeb69 tempest-VolumesMetadataTest-106439776 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:41:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b0392bb0-20b5-4baa-8235-ebf406dbeb69 tempest-VolumesMetadataTest-106439776 None] Flow 'volume_create_manager' (388bc07e-1971-4a3f-933b-ef46ee65c1c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:41:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b0392bb0-20b5-4baa-8235-ebf406dbeb69 tempest-VolumesMetadataTest-106439776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fae3a7e9-5542-45bc-b3c5-2d86b8ae8b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:41:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b0392bb0-20b5-4baa-8235-ebf406dbeb69 tempest-VolumesMetadataTest-106439776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fae3a7e9-5542-45bc-b3c5-2d86b8ae8b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:41:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-950394101',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a5855f8-0d35-48ee-a945-a79d416f2488,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53d46ffe147b4f9f926f0e79a46f5b66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:41:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:41:52Z,use_quota=True,user_id='dbd58a1c234a43c1a4b6f8465e92b1a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:41:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b0392bb0-20b5-4baa-8235-ebf406dbeb69 tempest-VolumesMetadataTest-106439776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ad6a106-c805-4e21-af32-e44fe0ee17e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:41:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b0392bb0-20b5-4baa-8235-ebf406dbeb69 tempest-VolumesMetadataTest-106439776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ad6a106-c805-4e21-af32-e44fe0ee17e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:41:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b0392bb0-20b5-4baa-8235-ebf406dbeb69 tempest-VolumesMetadataTest-106439776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef0a00c7-60d9-4a1b-83cc-9172e24bbc18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:41:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b0392bb0-20b5-4baa-8235-ebf406dbeb69 tempest-VolumesMetadataTest-106439776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef0a00c7-60d9-4a1b-83cc-9172e24bbc18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a5855f8-0d35-48ee-a945-a79d416f2488', 'volume_name': 'volume-7a5855f8-0d35-48ee-a945-a79d416f2488', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:41:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b0392bb0-20b5-4baa-8235-ebf406dbeb69 tempest-VolumesMetadataTest-106439776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caf37027-1156-4334-b973-bd49e7e693be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:41:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b0392bb0-20b5-4baa-8235-ebf406dbeb69 tempest-VolumesMetadataTest-106439776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caf37027-1156-4334-b973-bd49e7e693be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:41:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b0392bb0-20b5-4baa-8235-ebf406dbeb69 tempest-VolumesMetadataTest-106439776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1eb40567-3a03-4c2a-9556-18c5da712f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:41:52 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-b0392bb0-20b5-4baa-8235-ebf406dbeb69 tempest-VolumesMetadataTest-106439776 None] Volume 7a5855f8-0d35-48ee-a945-a79d416f2488: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a5855f8-0d35-48ee-a945-a79d416f2488', 'volume_size': 1}
Jul 09 14:41:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b0392bb0-20b5-4baa-8235-ebf406dbeb69 tempest-VolumesMetadataTest-106439776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:41:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-cbff3d9b-7524-45f1-b8ff-e3ec415b4954 req-19e795fb-af96-44b1-82ba-bc7cb670407f tempest-TestInstancesWithCinderVolumes-1507168999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:41:52 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 14:41:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:41:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:41:52 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:41:52 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:41:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:41:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:41:52 devstack sudo[98673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:41:52 devstack sudo[98673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:41:53 devstack sudo[98669]: pam_unix(sudo:session): session closed for user root
Jul 09 14:41:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-defd47b0-ab71-413e-a2c3-5580bbd6265f tempest-VolumesGetTest-2096456054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-33b36218-8a01-4afa-8d92-2b01d57eff61" returned: 0 in 1.025s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:41:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-defd47b0-ab71-413e-a2c3-5580bbd6265f tempest-VolumesGetTest-2096456054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-33b36218-8a01-4afa-8d92-2b01d57eff61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-33b36218-8a01-4afa-8d92-2b01d57eff61.31d99fab-17e9-4bfc-8b13-99c46e54006b 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:41:53 devstack sudo[98680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-33b36218-8a01-4afa-8d92-2b01d57eff61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-33b36218-8a01-4afa-8d92-2b01d57eff61.31d99fab-17e9-4bfc-8b13-99c46e54006b 1G
Jul 09 14:41:53 devstack sudo[98680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:41:53 devstack sudo[98673]: pam_unix(sudo:session): session closed for user root
Jul 09 14:41:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.761s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:41:53 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:41:53 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Running periodic task VolumeManager._thread_info {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 14:41:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] thread count: 28 {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 09 14:41:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] thread info: [<_MainThread(MainThread, started 125388812103808)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125388713797504)>, <Thread(Thread-3 (stat_writer), started daemon 125388699995392)>, <Thread(Rabbit-heartbeat, started daemon 125388700522560)>, <Thread(Thread-5 (_runner), started daemon 125388698545216)>, <Thread(Thread-7 (_runner), started daemon 125388698611264)>, <Thread(fd_logger, started daemon 125388703020672)>, <Thread(privsep_reader, started daemon 125388696441088)>, <Thread(tpool_thread_0, started daemon 125388687943360)>, <Thread(tpool_thread_1, started daemon 125388679550656)>, <Thread(tpool_thread_2, started daemon 125388671141568)>, <Thread(tpool_thread_3, started daemon 125388662732480)>, <Thread(tpool_thread_4, started daemon 125388654323392)>, <Thread(tpool_thread_5, started daemon 125388645914304)>, <Thread(tpool_thread_6, started daemon 125388637505216)>, <Thread(tpool_thread_7, started daemon 125388629096128)>, <Thread(tpool_thread_8, started daemon 125388620687040)>, <Thread(tpool_thread_9, started daemon 125388612277952)>, <Thread(tpool_thread_10, started daemon 125388603868864)>, <Thread(tpool_thread_11, started daemon 125388595459776)>, <Thread(tpool_thread_12, started daemon 125388587050688)>, <Thread(tpool_thread_13, started daemon 125388578641600)>, <Thread(tpool_thread_14, started daemon 125388570232512)>, <Thread(tpool_thread_15, started daemon 125388561823424)>, <Thread(tpool_thread_16, started daemon 125388553414336)>, <Thread(tpool_thread_17, started daemon 125388545005248)>, <Thread(tpool_thread_18, started daemon 125388536596160)>, <Thread(tpool_thread_19, started daemon 125388528187072)>] {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 09 14:41:53 devstack sudo[98680]: pam_unix(sudo:session): session closed for user root
Jul 09 14:41:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-defd47b0-ab71-413e-a2c3-5580bbd6265f tempest-VolumesGetTest-2096456054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-33b36218-8a01-4afa-8d92-2b01d57eff61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-33b36218-8a01-4afa-8d92-2b01d57eff61.31d99fab-17e9-4bfc-8b13-99c46e54006b 1G" returned: 0 in 0.868s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:41:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-defd47b0-ab71-413e-a2c3-5580bbd6265f tempest-VolumesGetTest-2096456054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33b36218-8a01-4afa-8d92-2b01d57eff61 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-33b36218-8a01-4afa-8d92-2b01d57eff61.31d99fab-17e9-4bfc-8b13-99c46e54006b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:41:54 devstack sudo[98686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33b36218-8a01-4afa-8d92-2b01d57eff61 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-33b36218-8a01-4afa-8d92-2b01d57eff61.31d99fab-17e9-4bfc-8b13-99c46e54006b
Jul 09 14:41:54 devstack sudo[98686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:41:54 devstack sudo[98686]: pam_unix(sudo:session): session closed for user root
Jul 09 14:41:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-defd47b0-ab71-413e-a2c3-5580bbd6265f tempest-VolumesGetTest-2096456054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33b36218-8a01-4afa-8d92-2b01d57eff61 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-33b36218-8a01-4afa-8d92-2b01d57eff61.31d99fab-17e9-4bfc-8b13-99c46e54006b" returned: 0 in 0.721s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:41:54 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-defd47b0-ab71-413e-a2c3-5580bbd6265f tempest-VolumesGetTest-2096456054 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-33b36218-8a01-4afa-8d92-2b01d57eff61.31d99fab-17e9-4bfc-8b13-99c46e54006b is being set with open permissions: ugo+rw
Jul 09 14:41:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-defd47b0-ab71-413e-a2c3-5580bbd6265f tempest-VolumesGetTest-2096456054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-33b36218-8a01-4afa-8d92-2b01d57eff61.31d99fab-17e9-4bfc-8b13-99c46e54006b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:41:54 devstack sudo[98692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-33b36218-8a01-4afa-8d92-2b01d57eff61.31d99fab-17e9-4bfc-8b13-99c46e54006b
Jul 09 14:41:54 devstack sudo[98692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:41:55 devstack sudo[98692]: pam_unix(sudo:session): session closed for user root
Jul 09 14:41:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-defd47b0-ab71-413e-a2c3-5580bbd6265f tempest-VolumesGetTest-2096456054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-33b36218-8a01-4afa-8d92-2b01d57eff61.31d99fab-17e9-4bfc-8b13-99c46e54006b" returned: 0 in 0.750s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:41:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-defd47b0-ab71-413e-a2c3-5580bbd6265f tempest-VolumesGetTest-2096456054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-33b36218-8a01-4afa-8d92-2b01d57eff61.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:41:55 devstack sudo[98701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-33b36218-8a01-4afa-8d92-2b01d57eff61.info
Jul 09 14:41:55 devstack sudo[98701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:41:56 devstack sudo[98701]: pam_unix(sudo:session): session closed for user root
Jul 09 14:41:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-defd47b0-ab71-413e-a2c3-5580bbd6265f tempest-VolumesGetTest-2096456054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-33b36218-8a01-4afa-8d92-2b01d57eff61.info" returned: 0 in 0.644s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:41:56 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-defd47b0-ab71-413e-a2c3-5580bbd6265f tempest-VolumesGetTest-2096456054 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-33b36218-8a01-4afa-8d92-2b01d57eff61.info is being set with open permissions: ugo+rw
Jul 09 14:41:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-defd47b0-ab71-413e-a2c3-5580bbd6265f tempest-VolumesGetTest-2096456054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-33b36218-8a01-4afa-8d92-2b01d57eff61.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:41:56 devstack sudo[98704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-33b36218-8a01-4afa-8d92-2b01d57eff61.info
Jul 09 14:41:56 devstack sudo[98704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:41:56 devstack sudo[98704]: pam_unix(sudo:session): session closed for user root
Jul 09 14:41:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-defd47b0-ab71-413e-a2c3-5580bbd6265f tempest-VolumesGetTest-2096456054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-33b36218-8a01-4afa-8d92-2b01d57eff61.info" returned: 0 in 0.691s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:41:56 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-defd47b0-ab71-413e-a2c3-5580bbd6265f tempest-VolumesGetTest-2096456054 None] Acquiring lock "cinder-quobyte-cea1c4c3-756c-4866-80b8-ad5d776b14d1" by "_copy_volume_from_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:41:56 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-defd47b0-ab71-413e-a2c3-5580bbd6265f tempest-VolumesGetTest-2096456054 None] Lock "cinder-quobyte-cea1c4c3-756c-4866-80b8-ad5d776b14d1" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:41:56 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-defd47b0-ab71-413e-a2c3-5580bbd6265f tempest-VolumesGetTest-2096456054 None] snapshot: 31d99fab-17e9-4bfc-8b13-99c46e54006b, volume: cea1c4c3-756c-4866-80b8-ad5d776b14d1,  {{(pid=87230) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 09 14:41:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-defd47b0-ab71-413e-a2c3-5580bbd6265f tempest-VolumesGetTest-2096456054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:41:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-defd47b0-ab71-413e-a2c3-5580bbd6265f tempest-VolumesGetTest-2096456054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:41:56 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-defd47b0-ab71-413e-a2c3-5580bbd6265f tempest-VolumesGetTest-2096456054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:41:56 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-defd47b0-ab71-413e-a2c3-5580bbd6265f tempest-VolumesGetTest-2096456054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:41:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-defd47b0-ab71-413e-a2c3-5580bbd6265f tempest-VolumesGetTest-2096456054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:41:56 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f266e14-8605-4594-aeda-25037e1a87a0]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:41:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-defd47b0-ab71-413e-a2c3-5580bbd6265f tempest-VolumesGetTest-2096456054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-33b36218-8a01-4afa-8d92-2b01d57eff61.31d99fab-17e9-4bfc-8b13-99c46e54006b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:41:57 devstack sudo[98707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-33b36218-8a01-4afa-8d92-2b01d57eff61.31d99fab-17e9-4bfc-8b13-99c46e54006b
Jul 09 14:41:57 devstack sudo[98707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:41:57 devstack sudo[98707]: pam_unix(sudo:session): session closed for user root
Jul 09 14:41:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-defd47b0-ab71-413e-a2c3-5580bbd6265f tempest-VolumesGetTest-2096456054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-33b36218-8a01-4afa-8d92-2b01d57eff61.31d99fab-17e9-4bfc-8b13-99c46e54006b" returned: 0 in 0.795s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:41:57 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-defd47b0-ab71-413e-a2c3-5580bbd6265f tempest-VolumesGetTest-2096456054 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33b36218-8a01-4afa-8d92-2b01d57eff61(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 14:41:57 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-defd47b0-ab71-413e-a2c3-5580bbd6265f tempest-VolumesGetTest-2096456054 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-33b36218-8a01-4afa-8d92-2b01d57eff61 {{(pid=87230) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 09 14:41:57 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-defd47b0-ab71-413e-a2c3-5580bbd6265f tempest-VolumesGetTest-2096456054 None] Creating direct copy from snapshot {{(pid=87230) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 09 14:41:57 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc27cef-ea14-47f2-b3bd-f9442686fd97]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:41:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-defd47b0-ab71-413e-a2c3-5580bbd6265f tempest-VolumesGetTest-2096456054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-33b36218-8a01-4afa-8d92-2b01d57eff61 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:41:57 devstack sudo[98712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-33b36218-8a01-4afa-8d92-2b01d57eff61
Jul 09 14:41:57 devstack sudo[98712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:41:58 devstack sudo[98712]: pam_unix(sudo:session): session closed for user root
Jul 09 14:41:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-defd47b0-ab71-413e-a2c3-5580bbd6265f tempest-VolumesGetTest-2096456054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-33b36218-8a01-4afa-8d92-2b01d57eff61" returned: 0 in 0.932s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:41:58 devstack cinder-volume[87230]: DEBUG cinder.utils [None req-defd47b0-ab71-413e-a2c3-5580bbd6265f tempest-VolumesGetTest-2096456054 None] Path /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-cea1c4c3-756c-4866-80b8-ad5d776b14d1 not found in is_blk_device check {{(pid=87230) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 09 14:41:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-defd47b0-ab71-413e-a2c3-5580bbd6265f tempest-VolumesGetTest-2096456054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-33b36218-8a01-4afa-8d92-2b01d57eff61 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-cea1c4c3-756c-4866-80b8-ad5d776b14d1 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:41:58 devstack sudo[98717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-33b36218-8a01-4afa-8d92-2b01d57eff61 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-cea1c4c3-756c-4866-80b8-ad5d776b14d1
Jul 09 14:41:58 devstack sudo[98717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:42:04 devstack sudo[98717]: pam_unix(sudo:session): session closed for user root
Jul 09 14:42:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-defd47b0-ab71-413e-a2c3-5580bbd6265f tempest-VolumesGetTest-2096456054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-33b36218-8a01-4afa-8d92-2b01d57eff61 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-cea1c4c3-756c-4866-80b8-ad5d776b14d1" returned: 0 in 5.409s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:42:04 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[dba3c1c4-9538-48eb-992c-12cab1903585]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:42:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-defd47b0-ab71-413e-a2c3-5580bbd6265f tempest-VolumesGetTest-2096456054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-33b36218-8a01-4afa-8d92-2b01d57eff61 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:42:04 devstack sudo[98732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-33b36218-8a01-4afa-8d92-2b01d57eff61
Jul 09 14:42:04 devstack sudo[98732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:42:04 devstack sudo[98732]: pam_unix(sudo:session): session closed for user root
Jul 09 14:42:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-defd47b0-ab71-413e-a2c3-5580bbd6265f tempest-VolumesGetTest-2096456054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-33b36218-8a01-4afa-8d92-2b01d57eff61" returned: 0 in 0.912s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:42:04 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-defd47b0-ab71-413e-a2c3-5580bbd6265f tempest-VolumesGetTest-2096456054 None] Image conversion details: src /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-33b36218-8a01-4afa-8d92-2b01d57eff61, size 1024.00 MB, duration 5.41 sec, destination /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-cea1c4c3-756c-4866-80b8-ad5d776b14d1 {{(pid=87230) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 09 14:42:04 devstack cinder-volume[87230]: INFO cinder.image.image_utils [None req-defd47b0-ab71-413e-a2c3-5580bbd6265f tempest-VolumesGetTest-2096456054 None] Converted 1024.00 MB image at 189.26 MB/s
Jul 09 14:42:04 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-defd47b0-ab71-413e-a2c3-5580bbd6265f tempest-VolumesGetTest-2096456054 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-cea1c4c3-756c-4866-80b8-ad5d776b14d1 is being set with open permissions: ugo+rw
Jul 09 14:42:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-defd47b0-ab71-413e-a2c3-5580bbd6265f tempest-VolumesGetTest-2096456054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-cea1c4c3-756c-4866-80b8-ad5d776b14d1 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:42:05 devstack sudo[98737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-cea1c4c3-756c-4866-80b8-ad5d776b14d1
Jul 09 14:42:05 devstack sudo[98737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:42:05 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=57,cinder:INSERT=16,cinder:UPDATE=83,cinder:DELETE=9 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 14:42:05 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:UPDATE=23,cinder:SELECT=31,cinder:INSERT=8 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 14:42:05 devstack sudo[98737]: pam_unix(sudo:session): session closed for user root
Jul 09 14:42:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-defd47b0-ab71-413e-a2c3-5580bbd6265f tempest-VolumesGetTest-2096456054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-cea1c4c3-756c-4866-80b8-ad5d776b14d1" returned: 0 in 0.667s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:42:05 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-defd47b0-ab71-413e-a2c3-5580bbd6265f tempest-VolumesGetTest-2096456054 None] Lock "cinder-quobyte-cea1c4c3-756c-4866-80b8-ad5d776b14d1" released by "_copy_volume_from_snapshot" :: held 8.817s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:42:05 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-defd47b0-ab71-413e-a2c3-5580bbd6265f tempest-VolumesGetTest-2096456054 None] Acquiring lock "cinder-quobyte-31d99fab-17e9-4bfc-8b13-99c46e54006b" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:42:05 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-defd47b0-ab71-413e-a2c3-5580bbd6265f tempest-VolumesGetTest-2096456054 None] Lock "cinder-quobyte-31d99fab-17e9-4bfc-8b13-99c46e54006b" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:42:05 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-defd47b0-ab71-413e-a2c3-5580bbd6265f tempest-VolumesGetTest-2096456054 None] Deleting offline snapshot 31d99fab-17e9-4bfc-8b13-99c46e54006b of volume 33b36218-8a01-4afa-8d92-2b01d57eff61 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 14:42:05 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-defd47b0-ab71-413e-a2c3-5580bbd6265f tempest-VolumesGetTest-2096456054 None] snapshot_file for this snap is: volume-33b36218-8a01-4afa-8d92-2b01d57eff61.31d99fab-17e9-4bfc-8b13-99c46e54006b {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 14:42:05 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[111e8733-dc9d-448f-ac4a-88a16099cbda]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:42:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-defd47b0-ab71-413e-a2c3-5580bbd6265f tempest-VolumesGetTest-2096456054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-33b36218-8a01-4afa-8d92-2b01d57eff61.31d99fab-17e9-4bfc-8b13-99c46e54006b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:42:05 devstack sudo[98740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-33b36218-8a01-4afa-8d92-2b01d57eff61.31d99fab-17e9-4bfc-8b13-99c46e54006b
Jul 09 14:42:05 devstack sudo[98740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:42:06 devstack sudo[98740]: pam_unix(sudo:session): session closed for user root
Jul 09 14:42:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-defd47b0-ab71-413e-a2c3-5580bbd6265f tempest-VolumesGetTest-2096456054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-33b36218-8a01-4afa-8d92-2b01d57eff61.31d99fab-17e9-4bfc-8b13-99c46e54006b" returned: 0 in 0.890s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:42:06 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-defd47b0-ab71-413e-a2c3-5580bbd6265f tempest-VolumesGetTest-2096456054 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33b36218-8a01-4afa-8d92-2b01d57eff61(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 14:42:06 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[3373f79d-f071-4466-98c4-e1cca516f580]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:42:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-defd47b0-ab71-413e-a2c3-5580bbd6265f tempest-VolumesGetTest-2096456054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-33b36218-8a01-4afa-8d92-2b01d57eff61 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:42:06 devstack sudo[98746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-33b36218-8a01-4afa-8d92-2b01d57eff61
Jul 09 14:42:06 devstack sudo[98746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:42:07 devstack sudo[98746]: pam_unix(sudo:session): session closed for user root
Jul 09 14:42:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-defd47b0-ab71-413e-a2c3-5580bbd6265f tempest-VolumesGetTest-2096456054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-33b36218-8a01-4afa-8d92-2b01d57eff61" returned: 0 in 0.848s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:42:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-defd47b0-ab71-413e-a2c3-5580bbd6265f tempest-VolumesGetTest-2096456054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-33b36218-8a01-4afa-8d92-2b01d57eff61.31d99fab-17e9-4bfc-8b13-99c46e54006b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:42:07 devstack sudo[98751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-33b36218-8a01-4afa-8d92-2b01d57eff61.31d99fab-17e9-4bfc-8b13-99c46e54006b
Jul 09 14:42:07 devstack sudo[98751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:42:08 devstack sudo[98751]: pam_unix(sudo:session): session closed for user root
Jul 09 14:42:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-defd47b0-ab71-413e-a2c3-5580bbd6265f tempest-VolumesGetTest-2096456054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-33b36218-8a01-4afa-8d92-2b01d57eff61.31d99fab-17e9-4bfc-8b13-99c46e54006b" returned: 0 in 0.801s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:42:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-defd47b0-ab71-413e-a2c3-5580bbd6265f tempest-VolumesGetTest-2096456054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-33b36218-8a01-4afa-8d92-2b01d57eff61.31d99fab-17e9-4bfc-8b13-99c46e54006b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:42:08 devstack sudo[98760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-33b36218-8a01-4afa-8d92-2b01d57eff61.31d99fab-17e9-4bfc-8b13-99c46e54006b
Jul 09 14:42:08 devstack sudo[98760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:42:08 devstack sudo[98760]: pam_unix(sudo:session): session closed for user root
Jul 09 14:42:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-defd47b0-ab71-413e-a2c3-5580bbd6265f tempest-VolumesGetTest-2096456054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-33b36218-8a01-4afa-8d92-2b01d57eff61.31d99fab-17e9-4bfc-8b13-99c46e54006b" returned: 0 in 0.670s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:42:09 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-defd47b0-ab71-413e-a2c3-5580bbd6265f tempest-VolumesGetTest-2096456054 None] Lock "cinder-quobyte-31d99fab-17e9-4bfc-8b13-99c46e54006b" released by "_delete_snapshot" :: held 3.308s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:42:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-defd47b0-ab71-413e-a2c3-5580bbd6265f tempest-VolumesGetTest-2096456054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.061s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:42:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b0392bb0-20b5-4baa-8235-ebf406dbeb69 tempest-VolumesMetadataTest-106439776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.695s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:42:09 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b0392bb0-20b5-4baa-8235-ebf406dbeb69 tempest-VolumesMetadataTest-106439776 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:41:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-950394101',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a5855f8-0d35-48ee-a945-a79d416f2488,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53d46ffe147b4f9f926f0e79a46f5b66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:41:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:41:52Z,use_quota=True,user_id='dbd58a1c234a43c1a4b6f8465e92b1a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:42:09 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-b0392bb0-20b5-4baa-8235-ebf406dbeb69 tempest-VolumesMetadataTest-106439776 None] Creating volume 7a5855f8-0d35-48ee-a945-a79d416f2488 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:42:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b0392bb0-20b5-4baa-8235-ebf406dbeb69 tempest-VolumesMetadataTest-106439776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:42:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b0392bb0-20b5-4baa-8235-ebf406dbeb69 tempest-VolumesMetadataTest-106439776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:42:09 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b0392bb0-20b5-4baa-8235-ebf406dbeb69 tempest-VolumesMetadataTest-106439776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:42:09 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b0392bb0-20b5-4baa-8235-ebf406dbeb69 tempest-VolumesMetadataTest-106439776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:42:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b0392bb0-20b5-4baa-8235-ebf406dbeb69 tempest-VolumesMetadataTest-106439776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:42:09 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b0392bb0-20b5-4baa-8235-ebf406dbeb69 tempest-VolumesMetadataTest-106439776 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:42:09 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-b0392bb0-20b5-4baa-8235-ebf406dbeb69 tempest-VolumesMetadataTest-106439776 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:42:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b0392bb0-20b5-4baa-8235-ebf406dbeb69 tempest-VolumesMetadataTest-106439776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7a5855f8-0d35-48ee-a945-a79d416f2488 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:42:09 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-defd47b0-ab71-413e-a2c3-5580bbd6265f tempest-VolumesGetTest-2096456054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98eb7f69-b6a9-44ac-b7e1-f795590b791e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cea1c4c3-756c-4866-80b8-ad5d776b14d1', 'volume_size': 1, 'source_volid': '33b36218-8a01-4afa-8d92-2b01d57eff61', 'source_volstatus': 'available'}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:42:09 devstack sudo[98764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7a5855f8-0d35-48ee-a945-a79d416f2488 1073741824
Jul 09 14:42:09 devstack sudo[98764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:42:09 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-defd47b0-ab71-413e-a2c3-5580bbd6265f tempest-VolumesGetTest-2096456054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fbfa003-deb7-47ac-a86f-6bf71137359a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:42:09 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-defd47b0-ab71-413e-a2c3-5580bbd6265f tempest-VolumesGetTest-2096456054 None] Volume volume-cea1c4c3-756c-4866-80b8-ad5d776b14d1 (cea1c4c3-756c-4866-80b8-ad5d776b14d1): created successfully
Jul 09 14:42:09 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-defd47b0-ab71-413e-a2c3-5580bbd6265f tempest-VolumesGetTest-2096456054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fbfa003-deb7-47ac-a86f-6bf71137359a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:42:09 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-defd47b0-ab71-413e-a2c3-5580bbd6265f tempest-VolumesGetTest-2096456054 None] Flow 'volume_create_manager' (9d12531d-02e2-4a35-a36a-5cfd395b65a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:42:09 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-defd47b0-ab71-413e-a2c3-5580bbd6265f tempest-VolumesGetTest-2096456054 None] Created volume successfully.
Jul 09 14:42:09 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-5faa682d-4345-4449-8ce5-e2303267bd73 tempest-VolumesGetTest-2096456054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:42:09 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5faa682d-4345-4449-8ce5-e2303267bd73 tempest-VolumesGetTest-2096456054 None] Flow 'volume_create_manager' (2b3ed608-8487-4b8b-bd07-b6d9249f959e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:42:09 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5faa682d-4345-4449-8ce5-e2303267bd73 tempest-VolumesGetTest-2096456054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbc2abca-28e5-43ad-9e66-5d7adb70c29b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:42:09 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5faa682d-4345-4449-8ce5-e2303267bd73 tempest-VolumesGetTest-2096456054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbc2abca-28e5-43ad-9e66-5d7adb70c29b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:42:10Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1753091097',display_name='tempest-VolumesGetTest-Volume-591343689',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a8f159d-771d-44b4-baec-ef41d5dfe892,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32af181c197945aeb61deace335c7961',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:42:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:42:10Z,use_quota=True,user_id='ba462433f4ed421ca2235f25668a482f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:42:10 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5faa682d-4345-4449-8ce5-e2303267bd73 tempest-VolumesGetTest-2096456054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bde69964-4652-4d41-85f7-7923a05cd35b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:42:10 devstack sudo[98764]: pam_unix(sudo:session): session closed for user root
Jul 09 14:42:10 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5faa682d-4345-4449-8ce5-e2303267bd73 tempest-VolumesGetTest-2096456054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bde69964-4652-4d41-85f7-7923a05cd35b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:42:10 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5faa682d-4345-4449-8ce5-e2303267bd73 tempest-VolumesGetTest-2096456054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e43e5e43-de35-4b7f-97a0-406d3510b9e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:42:10 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5faa682d-4345-4449-8ce5-e2303267bd73 tempest-VolumesGetTest-2096456054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e43e5e43-de35-4b7f-97a0-406d3510b9e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a8f159d-771d-44b4-baec-ef41d5dfe892', 'volume_name': 'volume-6a8f159d-771d-44b4-baec-ef41d5dfe892', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:42:10 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5faa682d-4345-4449-8ce5-e2303267bd73 tempest-VolumesGetTest-2096456054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b9631ed-59d4-4b9f-9e23-2d8a838af15b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:42:10 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5faa682d-4345-4449-8ce5-e2303267bd73 tempest-VolumesGetTest-2096456054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b9631ed-59d4-4b9f-9e23-2d8a838af15b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:42:10 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5faa682d-4345-4449-8ce5-e2303267bd73 tempest-VolumesGetTest-2096456054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b80e758d-90c4-443a-84c7-cf54a6acc571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:42:10 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-5faa682d-4345-4449-8ce5-e2303267bd73 tempest-VolumesGetTest-2096456054 None] Volume 6a8f159d-771d-44b4-baec-ef41d5dfe892: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a8f159d-771d-44b4-baec-ef41d5dfe892', 'volume_size': 1}
Jul 09 14:42:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5faa682d-4345-4449-8ce5-e2303267bd73 tempest-VolumesGetTest-2096456054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:42:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b0392bb0-20b5-4baa-8235-ebf406dbeb69 tempest-VolumesMetadataTest-106439776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7a5855f8-0d35-48ee-a945-a79d416f2488 1073741824" returned: 0 in 0.977s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:42:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b0392bb0-20b5-4baa-8235-ebf406dbeb69 tempest-VolumesMetadataTest-106439776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7a5855f8-0d35-48ee-a945-a79d416f2488 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:42:10 devstack sudo[98770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7a5855f8-0d35-48ee-a945-a79d416f2488
Jul 09 14:42:10 devstack sudo[98770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:42:10 devstack sudo[98770]: pam_unix(sudo:session): session closed for user root
Jul 09 14:42:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b0392bb0-20b5-4baa-8235-ebf406dbeb69 tempest-VolumesMetadataTest-106439776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7a5855f8-0d35-48ee-a945-a79d416f2488" returned: 0 in 0.644s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:42:10 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b0392bb0-20b5-4baa-8235-ebf406dbeb69 tempest-VolumesMetadataTest-106439776 None] <== create_volume: return (1657ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:42:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b0392bb0-20b5-4baa-8235-ebf406dbeb69 tempest-VolumesMetadataTest-106439776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.660s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:42:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-cbff3d9b-7524-45f1-b8ff-e3ec415b4954 req-19e795fb-af96-44b1-82ba-bc7cb670407f tempest-TestInstancesWithCinderVolumes-1507168999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 18.333s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:42:10 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b0392bb0-20b5-4baa-8235-ebf406dbeb69 tempest-VolumesMetadataTest-106439776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1eb40567-3a03-4c2a-9556-18c5da712f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a5855f8-0d35-48ee-a945-a79d416f2488', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:42:10 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b0392bb0-20b5-4baa-8235-ebf406dbeb69 tempest-VolumesMetadataTest-106439776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4dff877-916a-4b85-a262-d8e7e015abc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:42:10 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[e986cf14-a9cb-4607-938b-54358230fa0f]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:42:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-cbff3d9b-7524-45f1-b8ff-e3ec415b4954 req-19e795fb-af96-44b1-82ba-bc7cb670407f tempest-TestInstancesWithCinderVolumes-1507168999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8d49df72-89a9-4f2c-ac53-c34b068fb2d9 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:42:10 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-b0392bb0-20b5-4baa-8235-ebf406dbeb69 tempest-VolumesMetadataTest-106439776 None] Volume volume-7a5855f8-0d35-48ee-a945-a79d416f2488 (7a5855f8-0d35-48ee-a945-a79d416f2488): created successfully
Jul 09 14:42:10 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b0392bb0-20b5-4baa-8235-ebf406dbeb69 tempest-VolumesMetadataTest-106439776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4dff877-916a-4b85-a262-d8e7e015abc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:42:10 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b0392bb0-20b5-4baa-8235-ebf406dbeb69 tempest-VolumesMetadataTest-106439776 None] Flow 'volume_create_manager' (388bc07e-1971-4a3f-933b-ef46ee65c1c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:42:10 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-b0392bb0-20b5-4baa-8235-ebf406dbeb69 tempest-VolumesMetadataTest-106439776 None] Created volume successfully.
Jul 09 14:42:10 devstack sudo[98774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8d49df72-89a9-4f2c-ac53-c34b068fb2d9
Jul 09 14:42:10 devstack sudo[98774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:42:11 devstack sudo[98774]: pam_unix(sudo:session): session closed for user root
Jul 09 14:42:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-cbff3d9b-7524-45f1-b8ff-e3ec415b4954 req-19e795fb-af96-44b1-82ba-bc7cb670407f tempest-TestInstancesWithCinderVolumes-1507168999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8d49df72-89a9-4f2c-ac53-c34b068fb2d9" returned: 0 in 0.780s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:42:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-cbff3d9b-7524-45f1-b8ff-e3ec415b4954 req-19e795fb-af96-44b1-82ba-bc7cb670407f tempest-TestInstancesWithCinderVolumes-1507168999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.807s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:42:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5faa682d-4345-4449-8ce5-e2303267bd73 tempest-VolumesGetTest-2096456054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.490s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:42:11 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-5faa682d-4345-4449-8ce5-e2303267bd73 tempest-VolumesGetTest-2096456054 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:42:10Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1753091097',display_name='tempest-VolumesGetTest-Volume-591343689',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a8f159d-771d-44b4-baec-ef41d5dfe892,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32af181c197945aeb61deace335c7961',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:42:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:42:10Z,use_quota=True,user_id='ba462433f4ed421ca2235f25668a482f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:42:11 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-5faa682d-4345-4449-8ce5-e2303267bd73 tempest-VolumesGetTest-2096456054 None] Creating volume 6a8f159d-771d-44b4-baec-ef41d5dfe892 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:42:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5faa682d-4345-4449-8ce5-e2303267bd73 tempest-VolumesGetTest-2096456054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:42:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5faa682d-4345-4449-8ce5-e2303267bd73 tempest-VolumesGetTest-2096456054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:42:11 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-5faa682d-4345-4449-8ce5-e2303267bd73 tempest-VolumesGetTest-2096456054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:42:11 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-5faa682d-4345-4449-8ce5-e2303267bd73 tempest-VolumesGetTest-2096456054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:42:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5faa682d-4345-4449-8ce5-e2303267bd73 tempest-VolumesGetTest-2096456054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:42:11 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-5faa682d-4345-4449-8ce5-e2303267bd73 tempest-VolumesGetTest-2096456054 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:42:11 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-5faa682d-4345-4449-8ce5-e2303267bd73 tempest-VolumesGetTest-2096456054 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:42:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5faa682d-4345-4449-8ce5-e2303267bd73 tempest-VolumesGetTest-2096456054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-6a8f159d-771d-44b4-baec-ef41d5dfe892 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:42:11 devstack sudo[98779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-6a8f159d-771d-44b4-baec-ef41d5dfe892 1073741824
Jul 09 14:42:11 devstack sudo[98779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:42:11 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-cbff3d9b-7524-45f1-b8ff-e3ec415b4954 req-19e795fb-af96-44b1-82ba-bc7cb670407f tempest-TestInstancesWithCinderVolumes-1507168999 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653', 'name': 'volume-8d49df72-89a9-4f2c-ac53-c34b068fb2d9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4e340a19-4228-4407-bfe2-5d059b0154f2', 'enforce_multipath': True} {{(pid=87230) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 09 14:42:11 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-cbff3d9b-7524-45f1-b8ff-e3ec415b4954 req-19e795fb-af96-44b1-82ba-bc7cb670407f tempest-TestInstancesWithCinderVolumes-1507168999 None] attachment_update completed successfully.
Jul 09 14:42:11 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-293db25b-25bc-4873-9155-6d209ad2fd9d tempest-VolumesMetadataTest-106439776 None] Acquiring lock "cinder-7a5855f8-0d35-48ee-a945-a79d416f2488-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:42:11 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-293db25b-25bc-4873-9155-6d209ad2fd9d tempest-VolumesMetadataTest-106439776 None] Lock "cinder-7a5855f8-0d35-48ee-a945-a79d416f2488-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:42:11 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-293db25b-25bc-4873-9155-6d209ad2fd9d tempest-VolumesMetadataTest-106439776 None] Acquiring lock "cinder-quobyte-7a5855f8-0d35-48ee-a945-a79d416f2488" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:42:11 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-293db25b-25bc-4873-9155-6d209ad2fd9d tempest-VolumesMetadataTest-106439776 None] Lock "cinder-quobyte-7a5855f8-0d35-48ee-a945-a79d416f2488" acquired by "delete_volume" :: waited 0.017s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:42:11 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[17749354-85cb-4fb0-8b73-4545386e4afe]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:42:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-293db25b-25bc-4873-9155-6d209ad2fd9d tempest-VolumesMetadataTest-106439776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7a5855f8-0d35-48ee-a945-a79d416f2488 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:42:11 devstack sudo[98781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7a5855f8-0d35-48ee-a945-a79d416f2488
Jul 09 14:42:11 devstack sudo[98781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:42:12 devstack sudo[98779]: pam_unix(sudo:session): session closed for user root
Jul 09 14:42:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5faa682d-4345-4449-8ce5-e2303267bd73 tempest-VolumesGetTest-2096456054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-6a8f159d-771d-44b4-baec-ef41d5dfe892 1073741824" returned: 0 in 0.950s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:42:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5faa682d-4345-4449-8ce5-e2303267bd73 tempest-VolumesGetTest-2096456054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-6a8f159d-771d-44b4-baec-ef41d5dfe892 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:42:12 devstack sudo[98792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-6a8f159d-771d-44b4-baec-ef41d5dfe892
Jul 09 14:42:12 devstack sudo[98792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:42:12 devstack sudo[98781]: pam_unix(sudo:session): session closed for user root
Jul 09 14:42:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-293db25b-25bc-4873-9155-6d209ad2fd9d tempest-VolumesMetadataTest-106439776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7a5855f8-0d35-48ee-a945-a79d416f2488" returned: 0 in 1.016s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:42:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-293db25b-25bc-4873-9155-6d209ad2fd9d tempest-VolumesMetadataTest-106439776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7a5855f8-0d35-48ee-a945-a79d416f2488 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:42:12 devstack sudo[98795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7a5855f8-0d35-48ee-a945-a79d416f2488
Jul 09 14:42:12 devstack sudo[98795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:42:13 devstack sudo[98792]: pam_unix(sudo:session): session closed for user root
Jul 09 14:42:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5faa682d-4345-4449-8ce5-e2303267bd73 tempest-VolumesGetTest-2096456054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-6a8f159d-771d-44b4-baec-ef41d5dfe892" returned: 0 in 0.882s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:42:13 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-5faa682d-4345-4449-8ce5-e2303267bd73 tempest-VolumesGetTest-2096456054 None] <== create_volume: return (1887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:42:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5faa682d-4345-4449-8ce5-e2303267bd73 tempest-VolumesGetTest-2096456054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.890s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:42:13 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5faa682d-4345-4449-8ce5-e2303267bd73 tempest-VolumesGetTest-2096456054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b80e758d-90c4-443a-84c7-cf54a6acc571) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a8f159d-771d-44b4-baec-ef41d5dfe892', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:42:13 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5faa682d-4345-4449-8ce5-e2303267bd73 tempest-VolumesGetTest-2096456054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15e9565c-9049-48a1-aabf-19125685ae43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:42:13 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-5faa682d-4345-4449-8ce5-e2303267bd73 tempest-VolumesGetTest-2096456054 None] Volume volume-6a8f159d-771d-44b4-baec-ef41d5dfe892 (6a8f159d-771d-44b4-baec-ef41d5dfe892): created successfully
Jul 09 14:42:13 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5faa682d-4345-4449-8ce5-e2303267bd73 tempest-VolumesGetTest-2096456054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15e9565c-9049-48a1-aabf-19125685ae43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:42:13 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5faa682d-4345-4449-8ce5-e2303267bd73 tempest-VolumesGetTest-2096456054 None] Flow 'volume_create_manager' (2b3ed608-8487-4b8b-bd07-b6d9249f959e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:42:13 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-5faa682d-4345-4449-8ce5-e2303267bd73 tempest-VolumesGetTest-2096456054 None] Created volume successfully.
Jul 09 14:42:13 devstack sudo[98795]: pam_unix(sudo:session): session closed for user root
Jul 09 14:42:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-293db25b-25bc-4873-9155-6d209ad2fd9d tempest-VolumesMetadataTest-106439776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7a5855f8-0d35-48ee-a945-a79d416f2488" returned: 0 in 0.744s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:42:13 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-293db25b-25bc-4873-9155-6d209ad2fd9d tempest-VolumesMetadataTest-106439776 None] Lock "cinder-quobyte-7a5855f8-0d35-48ee-a945-a79d416f2488" released by "delete_volume" :: held 1.801s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:42:13 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-293db25b-25bc-4873-9155-6d209ad2fd9d tempest-VolumesMetadataTest-106439776 None] Created reservations ['a8062674-ff48-40eb-874b-b8363381ea8b', 'a7c45633-ce5d-4096-b4b2-9f6198f992d7', 'd2e652b6-5542-47e5-b204-ba19c4f0d1c2', 'ca798cd2-19ce-4530-b84d-71dff9fe41a9'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:42:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-293db25b-25bc-4873-9155-6d209ad2fd9d tempest-VolumesMetadataTest-106439776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:42:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-293db25b-25bc-4873-9155-6d209ad2fd9d tempest-VolumesMetadataTest-106439776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:42:13 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-293db25b-25bc-4873-9155-6d209ad2fd9d tempest-VolumesMetadataTest-106439776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:42:13 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-293db25b-25bc-4873-9155-6d209ad2fd9d tempest-VolumesMetadataTest-106439776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:42:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-293db25b-25bc-4873-9155-6d209ad2fd9d tempest-VolumesMetadataTest-106439776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:42:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-293db25b-25bc-4873-9155-6d209ad2fd9d tempest-VolumesMetadataTest-106439776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:42:13 devstack sudo[98799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:42:13 devstack sudo[98799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:42:14 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7a735b02-ff3d-4cb7-a76c-52031ea6504f tempest-VolumesGetTest-2096456054 None] Acquiring lock "cinder-6a8f159d-771d-44b4-baec-ef41d5dfe892-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:42:14 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7a735b02-ff3d-4cb7-a76c-52031ea6504f tempest-VolumesGetTest-2096456054 None] Lock "cinder-6a8f159d-771d-44b4-baec-ef41d5dfe892-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:42:14 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7a735b02-ff3d-4cb7-a76c-52031ea6504f tempest-VolumesGetTest-2096456054 None] Acquiring lock "cinder-quobyte-6a8f159d-771d-44b4-baec-ef41d5dfe892" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:42:14 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7a735b02-ff3d-4cb7-a76c-52031ea6504f tempest-VolumesGetTest-2096456054 None] Lock "cinder-quobyte-6a8f159d-771d-44b4-baec-ef41d5dfe892" acquired by "delete_volume" :: waited 0.026s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:42:14 devstack sudo[98799]: pam_unix(sudo:session): session closed for user root
Jul 09 14:42:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-293db25b-25bc-4873-9155-6d209ad2fd9d tempest-VolumesMetadataTest-106439776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.914s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:42:14 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-293db25b-25bc-4873-9155-6d209ad2fd9d tempest-VolumesMetadataTest-106439776 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:42:14 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-293db25b-25bc-4873-9155-6d209ad2fd9d tempest-VolumesMetadataTest-106439776 None] Deleted volume successfully.
Jul 09 14:42:14 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3a8b25-b508-4721-8878-e8cec0221e32]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:42:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7a735b02-ff3d-4cb7-a76c-52031ea6504f tempest-VolumesGetTest-2096456054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-6a8f159d-771d-44b4-baec-ef41d5dfe892 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:42:14 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-293db25b-25bc-4873-9155-6d209ad2fd9d tempest-VolumesMetadataTest-106439776 None] Lock "cinder-7a5855f8-0d35-48ee-a945-a79d416f2488-delete_volume" released by "delete_volume" :: held 2.964s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:42:14 devstack sudo[98803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-6a8f159d-771d-44b4-baec-ef41d5dfe892
Jul 09 14:42:14 devstack sudo[98803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:42:15 devstack sudo[98803]: pam_unix(sudo:session): session closed for user root
Jul 09 14:42:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7a735b02-ff3d-4cb7-a76c-52031ea6504f tempest-VolumesGetTest-2096456054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-6a8f159d-771d-44b4-baec-ef41d5dfe892" returned: 0 in 1.035s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:42:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7a735b02-ff3d-4cb7-a76c-52031ea6504f tempest-VolumesGetTest-2096456054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-6a8f159d-771d-44b4-baec-ef41d5dfe892 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:42:15 devstack sudo[98826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-6a8f159d-771d-44b4-baec-ef41d5dfe892
Jul 09 14:42:15 devstack sudo[98826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:42:16 devstack sudo[98826]: pam_unix(sudo:session): session closed for user root
Jul 09 14:42:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7a735b02-ff3d-4cb7-a76c-52031ea6504f tempest-VolumesGetTest-2096456054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-6a8f159d-771d-44b4-baec-ef41d5dfe892" returned: 0 in 0.688s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:42:16 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7a735b02-ff3d-4cb7-a76c-52031ea6504f tempest-VolumesGetTest-2096456054 None] Lock "cinder-quobyte-6a8f159d-771d-44b4-baec-ef41d5dfe892" released by "delete_volume" :: held 1.804s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:42:16 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-7a735b02-ff3d-4cb7-a76c-52031ea6504f tempest-VolumesGetTest-2096456054 None] Created reservations ['e29090e8-a7f5-4e51-81cb-cdf1cddc1cbe', 'e43c359c-5923-406e-98c1-a8ff2c5d53ed', '9187d244-f6be-43ce-ab44-a9b087de1690', '41bc7385-7f4e-4d67-bf58-1a1e795f2ca7'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:42:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7a735b02-ff3d-4cb7-a76c-52031ea6504f tempest-VolumesGetTest-2096456054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:42:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7a735b02-ff3d-4cb7-a76c-52031ea6504f tempest-VolumesGetTest-2096456054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:42:16 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7a735b02-ff3d-4cb7-a76c-52031ea6504f tempest-VolumesGetTest-2096456054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:42:16 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7a735b02-ff3d-4cb7-a76c-52031ea6504f tempest-VolumesGetTest-2096456054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:42:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7a735b02-ff3d-4cb7-a76c-52031ea6504f tempest-VolumesGetTest-2096456054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:42:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7a735b02-ff3d-4cb7-a76c-52031ea6504f tempest-VolumesGetTest-2096456054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:42:16 devstack sudo[98833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:42:16 devstack sudo[98833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:42:16 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-0b2a4e1a-8c09-4299-9323-f7496a2d48f5 tempest-VolumesGetTest-2096456054 None] Acquiring lock "cinder-cea1c4c3-756c-4866-80b8-ad5d776b14d1-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:42:16 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-0b2a4e1a-8c09-4299-9323-f7496a2d48f5 tempest-VolumesGetTest-2096456054 None] Lock "cinder-cea1c4c3-756c-4866-80b8-ad5d776b14d1-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:42:16 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-0b2a4e1a-8c09-4299-9323-f7496a2d48f5 tempest-VolumesGetTest-2096456054 None] Acquiring lock "cinder-quobyte-cea1c4c3-756c-4866-80b8-ad5d776b14d1" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:42:17 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-0b2a4e1a-8c09-4299-9323-f7496a2d48f5 tempest-VolumesGetTest-2096456054 None] Lock "cinder-quobyte-cea1c4c3-756c-4866-80b8-ad5d776b14d1" acquired by "delete_volume" :: waited 0.029s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:42:17 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8f3c140-2731-40eb-ab4c-532d6eafc933]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:42:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0b2a4e1a-8c09-4299-9323-f7496a2d48f5 tempest-VolumesGetTest-2096456054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-cea1c4c3-756c-4866-80b8-ad5d776b14d1 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:42:17 devstack sudo[98839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-cea1c4c3-756c-4866-80b8-ad5d776b14d1
Jul 09 14:42:17 devstack sudo[98839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:42:17 devstack sudo[98833]: pam_unix(sudo:session): session closed for user root
Jul 09 14:42:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7a735b02-ff3d-4cb7-a76c-52031ea6504f tempest-VolumesGetTest-2096456054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.926s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:42:17 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-7a735b02-ff3d-4cb7-a76c-52031ea6504f tempest-VolumesGetTest-2096456054 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:42:17 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-7a735b02-ff3d-4cb7-a76c-52031ea6504f tempest-VolumesGetTest-2096456054 None] Deleted volume successfully.
Jul 09 14:42:17 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7a735b02-ff3d-4cb7-a76c-52031ea6504f tempest-VolumesGetTest-2096456054 None] Lock "cinder-6a8f159d-771d-44b4-baec-ef41d5dfe892-delete_volume" released by "delete_volume" :: held 3.003s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:42:18 devstack sudo[98839]: pam_unix(sudo:session): session closed for user root
Jul 09 14:42:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0b2a4e1a-8c09-4299-9323-f7496a2d48f5 tempest-VolumesGetTest-2096456054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-cea1c4c3-756c-4866-80b8-ad5d776b14d1" returned: 0 in 1.146s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:42:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0b2a4e1a-8c09-4299-9323-f7496a2d48f5 tempest-VolumesGetTest-2096456054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-cea1c4c3-756c-4866-80b8-ad5d776b14d1 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:42:18 devstack sudo[98845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-cea1c4c3-756c-4866-80b8-ad5d776b14d1
Jul 09 14:42:18 devstack sudo[98845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:42:19 devstack sudo[98845]: pam_unix(sudo:session): session closed for user root
Jul 09 14:42:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0b2a4e1a-8c09-4299-9323-f7496a2d48f5 tempest-VolumesGetTest-2096456054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-cea1c4c3-756c-4866-80b8-ad5d776b14d1" returned: 0 in 0.977s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:42:19 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-0b2a4e1a-8c09-4299-9323-f7496a2d48f5 tempest-VolumesGetTest-2096456054 None] Lock "cinder-quobyte-cea1c4c3-756c-4866-80b8-ad5d776b14d1" released by "delete_volume" :: held 2.261s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:42:19 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-0b2a4e1a-8c09-4299-9323-f7496a2d48f5 tempest-VolumesGetTest-2096456054 None] Created reservations ['1d2e2227-1314-4a69-9d17-864127419a28', '99a3a351-64aa-42bc-9fe3-8ce32afcf071', '96545a4f-d30a-46ca-aa68-4e0a23636c3c', '7f860cad-9cc6-4ec9-888f-0fb41120564a'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:42:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0b2a4e1a-8c09-4299-9323-f7496a2d48f5 tempest-VolumesGetTest-2096456054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:42:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0b2a4e1a-8c09-4299-9323-f7496a2d48f5 tempest-VolumesGetTest-2096456054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:42:19 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-0b2a4e1a-8c09-4299-9323-f7496a2d48f5 tempest-VolumesGetTest-2096456054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:42:19 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-0b2a4e1a-8c09-4299-9323-f7496a2d48f5 tempest-VolumesGetTest-2096456054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:42:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0b2a4e1a-8c09-4299-9323-f7496a2d48f5 tempest-VolumesGetTest-2096456054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:42:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0b2a4e1a-8c09-4299-9323-f7496a2d48f5 tempest-VolumesGetTest-2096456054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:42:19 devstack sudo[98896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:42:19 devstack sudo[98896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:42:20 devstack sudo[98896]: pam_unix(sudo:session): session closed for user root
Jul 09 14:42:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0b2a4e1a-8c09-4299-9323-f7496a2d48f5 tempest-VolumesGetTest-2096456054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.741s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:42:20 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-0b2a4e1a-8c09-4299-9323-f7496a2d48f5 tempest-VolumesGetTest-2096456054 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:42:20 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-0b2a4e1a-8c09-4299-9323-f7496a2d48f5 tempest-VolumesGetTest-2096456054 None] Deleted volume successfully.
Jul 09 14:42:20 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-0b2a4e1a-8c09-4299-9323-f7496a2d48f5 tempest-VolumesGetTest-2096456054 None] Lock "cinder-cea1c4c3-756c-4866-80b8-ad5d776b14d1-delete_volume" released by "delete_volume" :: held 3.378s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:42:20 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-4d835927-e159-458b-98ff-a75077b6cea2 tempest-VolumesGetTest-2096456054 None] Acquiring lock "cinder-33b36218-8a01-4afa-8d92-2b01d57eff61-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:42:20 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-4d835927-e159-458b-98ff-a75077b6cea2 tempest-VolumesGetTest-2096456054 None] Lock "cinder-33b36218-8a01-4afa-8d92-2b01d57eff61-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:42:20 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-4d835927-e159-458b-98ff-a75077b6cea2 tempest-VolumesGetTest-2096456054 None] Acquiring lock "cinder-quobyte-33b36218-8a01-4afa-8d92-2b01d57eff61" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:42:20 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-4d835927-e159-458b-98ff-a75077b6cea2 tempest-VolumesGetTest-2096456054 None] Lock "cinder-quobyte-33b36218-8a01-4afa-8d92-2b01d57eff61" acquired by "delete_volume" :: waited 0.036s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:42:20 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ac2e80-b426-4627-8d64-fc1bfc85583b]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:42:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4d835927-e159-458b-98ff-a75077b6cea2 tempest-VolumesGetTest-2096456054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-33b36218-8a01-4afa-8d92-2b01d57eff61 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:42:21 devstack sudo[98942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-33b36218-8a01-4afa-8d92-2b01d57eff61
Jul 09 14:42:21 devstack sudo[98942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:42:21 devstack sudo[98942]: pam_unix(sudo:session): session closed for user root
Jul 09 14:42:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4d835927-e159-458b-98ff-a75077b6cea2 tempest-VolumesGetTest-2096456054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-33b36218-8a01-4afa-8d92-2b01d57eff61" returned: 0 in 0.909s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:42:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4d835927-e159-458b-98ff-a75077b6cea2 tempest-VolumesGetTest-2096456054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-33b36218-8a01-4afa-8d92-2b01d57eff61 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:42:21 devstack sudo[98951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-33b36218-8a01-4afa-8d92-2b01d57eff61
Jul 09 14:42:21 devstack sudo[98951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:42:22 devstack sudo[98951]: pam_unix(sudo:session): session closed for user root
Jul 09 14:42:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4d835927-e159-458b-98ff-a75077b6cea2 tempest-VolumesGetTest-2096456054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-33b36218-8a01-4afa-8d92-2b01d57eff61" returned: 0 in 0.976s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:42:22 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-4d835927-e159-458b-98ff-a75077b6cea2 tempest-VolumesGetTest-2096456054 None] Lock "cinder-quobyte-33b36218-8a01-4afa-8d92-2b01d57eff61" released by "delete_volume" :: held 1.983s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:42:22 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-4d835927-e159-458b-98ff-a75077b6cea2 tempest-VolumesGetTest-2096456054 None] Created reservations ['a12b0bcd-53ec-4854-ae14-7e0ccf4ce2b4', 'aca2ad05-6cc0-4e2e-9c71-3aefecde98fb', '5bb43bbc-6b5c-40e4-a1be-26543dd249c3', '3ed9124d-4df7-4ad2-aba4-b61ebed12d06'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:42:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-4d835927-e159-458b-98ff-a75077b6cea2 tempest-VolumesGetTest-2096456054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:42:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-4d835927-e159-458b-98ff-a75077b6cea2 tempest-VolumesGetTest-2096456054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:42:23 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-4d835927-e159-458b-98ff-a75077b6cea2 tempest-VolumesGetTest-2096456054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:42:23 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-4d835927-e159-458b-98ff-a75077b6cea2 tempest-VolumesGetTest-2096456054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:42:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-4d835927-e159-458b-98ff-a75077b6cea2 tempest-VolumesGetTest-2096456054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:42:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4d835927-e159-458b-98ff-a75077b6cea2 tempest-VolumesGetTest-2096456054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:42:23 devstack sudo[98956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:42:23 devstack sudo[98956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:42:24 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-6a28dfdd-ecea-4c16-bca5-c3315aa32808 req-f2bae62b-a34a-4438-9493-5d363cc57a6a tempest-TestInstancesWithCinderVolumes-1507168999 None] Terminate volume connection completed successfully.
Jul 09 14:42:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-6a28dfdd-ecea-4c16-bca5-c3315aa32808 req-f2bae62b-a34a-4438-9493-5d363cc57a6a tempest-TestInstancesWithCinderVolumes-1507168999 None] Deleting attachment 447634cd-ab02-4107-8d6c-aa1392c6dfb7. {{(pid=87230) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 09 14:42:24 devstack sudo[98956]: pam_unix(sudo:session): session closed for user root
Jul 09 14:42:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4d835927-e159-458b-98ff-a75077b6cea2 tempest-VolumesGetTest-2096456054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 1.449s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:42:24 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-4d835927-e159-458b-98ff-a75077b6cea2 tempest-VolumesGetTest-2096456054 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:42:24 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-4d835927-e159-458b-98ff-a75077b6cea2 tempest-VolumesGetTest-2096456054 None] Deleted volume successfully.
Jul 09 14:42:24 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-4d835927-e159-458b-98ff-a75077b6cea2 tempest-VolumesGetTest-2096456054 None] Lock "cinder-33b36218-8a01-4afa-8d92-2b01d57eff61-delete_volume" released by "delete_volume" :: held 3.784s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:42:24 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a8ce24a-538e-49c6-822f-d77f2c9c9c62 tempest-VolumesGetTest-2096456054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:42:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4a8ce24a-538e-49c6-822f-d77f2c9c9c62 tempest-VolumesGetTest-2096456054 None] Flow 'volume_create_manager' (e4ed4f48-fddc-4253-88c3-993c23b103ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:42:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4a8ce24a-538e-49c6-822f-d77f2c9c9c62 tempest-VolumesGetTest-2096456054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c057e08-cf97-4da2-9ccc-9e7be7ae737e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:42:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4a8ce24a-538e-49c6-822f-d77f2c9c9c62 tempest-VolumesGetTest-2096456054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c057e08-cf97-4da2-9ccc-9e7be7ae737e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:42:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1439662422',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce122690-9d74-455b-9e46-713809ccb4da,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='32af181c197945aeb61deace335c7961',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:42:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:42:25Z,use_quota=True,user_id='ba462433f4ed421ca2235f25668a482f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:42:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4a8ce24a-538e-49c6-822f-d77f2c9c9c62 tempest-VolumesGetTest-2096456054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa55ec84-cf73-42e4-8906-d9224dad821a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:42:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4a8ce24a-538e-49c6-822f-d77f2c9c9c62 tempest-VolumesGetTest-2096456054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa55ec84-cf73-42e4-8906-d9224dad821a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:42:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4a8ce24a-538e-49c6-822f-d77f2c9c9c62 tempest-VolumesGetTest-2096456054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (604fcee8-e964-43d7-857f-241657ba0423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:42:24 devstack cinder-volume[87230]: DEBUG cinder.image.glance [None req-4a8ce24a-538e-49c6-822f-d77f2c9c9c62 tempest-VolumesGetTest-2096456054 None] Creating Keystone auth plugin from conf {{(pid=87230) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 09 14:42:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4a8ce24a-538e-49c6-822f-d77f2c9c9c62 tempest-VolumesGetTest-2096456054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (604fcee8-e964-43d7-857f-241657ba0423) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ce122690-9d74-455b-9e46-713809ccb4da', 'volume_name': 'volume-ce122690-9d74-455b-9e46-713809ccb4da', 'volume_size': 1, 'image_id': '5eba314f-9adb-4fc7-aaad-9e9a3b7dae70', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5eba314f-9adb-4fc7-aaad-9e9a3b7dae70', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '10a7640b39774d00a67b2de818bf4a10', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5eba314f-9adb-4fc7-aaad-9e9a3b7dae70', 'created_at': datetime.datetime(2026, 7, 9, 12, 24, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 12, 24, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5eba314f-9adb-4fc7-aaad-9e9a3b7dae70/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x720a5437d940>}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:42:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4a8ce24a-538e-49c6-822f-d77f2c9c9c62 tempest-VolumesGetTest-2096456054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de90a8f6-2ba8-4639-8459-6cedf49a354e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:42:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4a8ce24a-538e-49c6-822f-d77f2c9c9c62 tempest-VolumesGetTest-2096456054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de90a8f6-2ba8-4639-8459-6cedf49a354e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:42:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4a8ce24a-538e-49c6-822f-d77f2c9c9c62 tempest-VolumesGetTest-2096456054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbf849ad-0724-483d-8805-32e587274805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:42:25 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-4a8ce24a-538e-49c6-822f-d77f2c9c9c62 tempest-VolumesGetTest-2096456054 None] Volume ce122690-9d74-455b-9e46-713809ccb4da: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ce122690-9d74-455b-9e46-713809ccb4da', 'volume_size': 1, 'image_id': '5eba314f-9adb-4fc7-aaad-9e9a3b7dae70', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5eba314f-9adb-4fc7-aaad-9e9a3b7dae70', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '10a7640b39774d00a67b2de818bf4a10', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5eba314f-9adb-4fc7-aaad-9e9a3b7dae70', 'created_at': datetime.datetime(2026, 7, 9, 12, 24, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 12, 24, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5eba314f-9adb-4fc7-aaad-9e9a3b7dae70/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x720a5437d940>}
Jul 09 14:42:25 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a8ce24a-538e-49c6-822f-d77f2c9c9c62 tempest-VolumesGetTest-2096456054 None] Trying to clone ce122690-9d74-455b-9e46-713809ccb4da from image 5eba314f-9adb-4fc7-aaad-9e9a3b7dae70 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5eba314f-9adb-4fc7-aaad-9e9a3b7dae70', 'metadata': {}}]). {{(pid=87230) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 09 14:42:25 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-2aa5a4ed-7998-48f6-9888-cafecdcc4eed tempest-VolumesActionsTest-937364676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:42:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2aa5a4ed-7998-48f6-9888-cafecdcc4eed tempest-VolumesActionsTest-937364676 None] Flow 'volume_create_manager' (71b8a099-2841-428a-ad7d-90e7795127d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:42:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2aa5a4ed-7998-48f6-9888-cafecdcc4eed tempest-VolumesActionsTest-937364676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e812f270-5252-4c5d-a29b-2649cce810e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:42:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2aa5a4ed-7998-48f6-9888-cafecdcc4eed tempest-VolumesActionsTest-937364676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e812f270-5252-4c5d-a29b-2649cce810e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:42:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1948624930',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2196c3dc-6463-4ac0-b781-08d8ce45060a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='522e7febd7b6499d9f39419cabe064ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:42:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:42:26Z,use_quota=True,user_id='3802808ebeb5450cb366087caef84fcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:42:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2aa5a4ed-7998-48f6-9888-cafecdcc4eed tempest-VolumesActionsTest-937364676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f89a8e6-204b-4c46-8af4-c0ebb5e6504c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:42:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2aa5a4ed-7998-48f6-9888-cafecdcc4eed tempest-VolumesActionsTest-937364676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f89a8e6-204b-4c46-8af4-c0ebb5e6504c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:42:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2aa5a4ed-7998-48f6-9888-cafecdcc4eed tempest-VolumesActionsTest-937364676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47b1fab0-379e-4d43-88f7-2d6f43fabc96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:42:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2aa5a4ed-7998-48f6-9888-cafecdcc4eed tempest-VolumesActionsTest-937364676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47b1fab0-379e-4d43-88f7-2d6f43fabc96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2196c3dc-6463-4ac0-b781-08d8ce45060a', 'volume_name': 'volume-2196c3dc-6463-4ac0-b781-08d8ce45060a', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:42:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2aa5a4ed-7998-48f6-9888-cafecdcc4eed tempest-VolumesActionsTest-937364676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b873490-700a-4385-8634-cf6e22765a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:42:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2aa5a4ed-7998-48f6-9888-cafecdcc4eed tempest-VolumesActionsTest-937364676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b873490-700a-4385-8634-cf6e22765a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:42:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2aa5a4ed-7998-48f6-9888-cafecdcc4eed tempest-VolumesActionsTest-937364676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (980bf5bc-b601-4f0c-863f-cdc8bec80bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:42:26 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-2aa5a4ed-7998-48f6-9888-cafecdcc4eed tempest-VolumesActionsTest-937364676 None] Volume 2196c3dc-6463-4ac0-b781-08d8ce45060a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2196c3dc-6463-4ac0-b781-08d8ce45060a', 'volume_size': 1}
Jul 09 14:42:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-2aa5a4ed-7998-48f6-9888-cafecdcc4eed tempest-VolumesActionsTest-937364676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:42:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-2aa5a4ed-7998-48f6-9888-cafecdcc4eed tempest-VolumesActionsTest-937364676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:42:26 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-2aa5a4ed-7998-48f6-9888-cafecdcc4eed tempest-VolumesActionsTest-937364676 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:42:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1948624930',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2196c3dc-6463-4ac0-b781-08d8ce45060a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='522e7febd7b6499d9f39419cabe064ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:42:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:42:26Z,use_quota=True,user_id='3802808ebeb5450cb366087caef84fcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:42:26 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-2aa5a4ed-7998-48f6-9888-cafecdcc4eed tempest-VolumesActionsTest-937364676 None] Creating volume 2196c3dc-6463-4ac0-b781-08d8ce45060a {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:42:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-2aa5a4ed-7998-48f6-9888-cafecdcc4eed tempest-VolumesActionsTest-937364676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:42:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-2aa5a4ed-7998-48f6-9888-cafecdcc4eed tempest-VolumesActionsTest-937364676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:42:26 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-2aa5a4ed-7998-48f6-9888-cafecdcc4eed tempest-VolumesActionsTest-937364676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:42:26 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-2aa5a4ed-7998-48f6-9888-cafecdcc4eed tempest-VolumesActionsTest-937364676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:42:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-2aa5a4ed-7998-48f6-9888-cafecdcc4eed tempest-VolumesActionsTest-937364676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:42:26 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-2aa5a4ed-7998-48f6-9888-cafecdcc4eed tempest-VolumesActionsTest-937364676 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:42:26 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-2aa5a4ed-7998-48f6-9888-cafecdcc4eed tempest-VolumesActionsTest-937364676 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:42:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2aa5a4ed-7998-48f6-9888-cafecdcc4eed tempest-VolumesActionsTest-937364676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2196c3dc-6463-4ac0-b781-08d8ce45060a 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:42:26 devstack sudo[98961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2196c3dc-6463-4ac0-b781-08d8ce45060a 1073741824
Jul 09 14:42:26 devstack sudo[98961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:42:26 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-4a8ce24a-538e-49c6-822f-d77f2c9c9c62 tempest-VolumesGetTest-2096456054 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5eba314f-9adb-4fc7-aaad-9e9a3b7dae70__vl6dzdidevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87230) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 09 14:42:26 devstack cinder-volume[87230]: INFO cinder.image.image_utils [None req-4a8ce24a-538e-49c6-822f-d77f2c9c9c62 tempest-VolumesGetTest-2096456054 None] Image download 20.69 MB at 20.69 MB/s
Jul 09 14:42:26 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[4401b3f9-c9e6-46e7-9539-4ccdf4231341]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:42:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4a8ce24a-538e-49c6-822f-d77f2c9c9c62 tempest-VolumesGetTest-2096456054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5eba314f-9adb-4fc7-aaad-9e9a3b7dae70__vl6dzdidevstack@QuobyteHD {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:42:26 devstack sudo[98963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5eba314f-9adb-4fc7-aaad-9e9a3b7dae70__vl6dzdidevstack@QuobyteHD
Jul 09 14:42:26 devstack sudo[98963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:42:27 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1cb7e4e6-9e40-4533-a2c4-c09f67cd21c1 tempest-TestInstancesWithCinderVolumes-1507168999 None] Acquiring lock "cinder-ffedc0c5-a50b-4b16-8c53-4c21c22887bd-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:42:27 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1cb7e4e6-9e40-4533-a2c4-c09f67cd21c1 tempest-TestInstancesWithCinderVolumes-1507168999 None] Lock "cinder-ffedc0c5-a50b-4b16-8c53-4c21c22887bd-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:42:27 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1cb7e4e6-9e40-4533-a2c4-c09f67cd21c1 tempest-TestInstancesWithCinderVolumes-1507168999 None] Acquiring lock "cinder-quobyte-ffedc0c5-a50b-4b16-8c53-4c21c22887bd" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:42:27 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1cb7e4e6-9e40-4533-a2c4-c09f67cd21c1 tempest-TestInstancesWithCinderVolumes-1507168999 None] Lock "cinder-quobyte-ffedc0c5-a50b-4b16-8c53-4c21c22887bd" acquired by "delete_volume" :: waited 0.032s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:42:27 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f57ff2-910b-41a0-aa55-49f052780ebc]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:42:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1cb7e4e6-9e40-4533-a2c4-c09f67cd21c1 tempest-TestInstancesWithCinderVolumes-1507168999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ffedc0c5-a50b-4b16-8c53-4c21c22887bd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:42:27 devstack sudo[98969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ffedc0c5-a50b-4b16-8c53-4c21c22887bd
Jul 09 14:42:27 devstack sudo[98969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:42:27 devstack sudo[98963]: pam_unix(sudo:session): session closed for user root
Jul 09 14:42:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4a8ce24a-538e-49c6-822f-d77f2c9c9c62 tempest-VolumesGetTest-2096456054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5eba314f-9adb-4fc7-aaad-9e9a3b7dae70__vl6dzdidevstack@QuobyteHD" returned: 0 in 1.454s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:42:27 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-4a8ce24a-538e-49c6-822f-d77f2c9c9c62 tempest-VolumesGetTest-2096456054 None] Temporary image 5eba314f-9adb-4fc7-aaad-9e9a3b7dae70 is fetched for user ba462433f4ed421ca2235f25668a482f. {{(pid=87230) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 09 14:42:27 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[72d10b86-0d34-43c2-a77f-1df376d823e9]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:42:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4a8ce24a-538e-49c6-822f-d77f2c9c9c62 tempest-VolumesGetTest-2096456054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5eba314f-9adb-4fc7-aaad-9e9a3b7dae70__vl6dzdidevstack@QuobyteHD {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:42:28 devstack sudo[98961]: pam_unix(sudo:session): session closed for user root
Jul 09 14:42:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2aa5a4ed-7998-48f6-9888-cafecdcc4eed tempest-VolumesActionsTest-937364676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2196c3dc-6463-4ac0-b781-08d8ce45060a 1073741824" returned: 0 in 2.135s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:42:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2aa5a4ed-7998-48f6-9888-cafecdcc4eed tempest-VolumesActionsTest-937364676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2196c3dc-6463-4ac0-b781-08d8ce45060a {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:42:28 devstack sudo[98978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5eba314f-9adb-4fc7-aaad-9e9a3b7dae70__vl6dzdidevstack@QuobyteHD
Jul 09 14:42:28 devstack sudo[98978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:42:28 devstack sudo[98979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2196c3dc-6463-4ac0-b781-08d8ce45060a
Jul 09 14:42:28 devstack sudo[98979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:42:29 devstack sudo[98969]: pam_unix(sudo:session): session closed for user root
Jul 09 14:42:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1cb7e4e6-9e40-4533-a2c4-c09f67cd21c1 tempest-TestInstancesWithCinderVolumes-1507168999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ffedc0c5-a50b-4b16-8c53-4c21c22887bd" returned: 0 in 2.286s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:42:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1cb7e4e6-9e40-4533-a2c4-c09f67cd21c1 tempest-TestInstancesWithCinderVolumes-1507168999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ffedc0c5-a50b-4b16-8c53-4c21c22887bd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:42:29 devstack sudo[98989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ffedc0c5-a50b-4b16-8c53-4c21c22887bd
Jul 09 14:42:29 devstack sudo[98989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:42:29 devstack sudo[98978]: pam_unix(sudo:session): session closed for user root
Jul 09 14:42:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4a8ce24a-538e-49c6-822f-d77f2c9c9c62 tempest-VolumesGetTest-2096456054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5eba314f-9adb-4fc7-aaad-9e9a3b7dae70__vl6dzdidevstack@QuobyteHD" returned: 0 in 1.745s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:42:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-4a8ce24a-538e-49c6-822f-d77f2c9c9c62 tempest-VolumesGetTest-2096456054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:42:29 devstack sudo[98979]: pam_unix(sudo:session): session closed for user root
Jul 09 14:42:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2aa5a4ed-7998-48f6-9888-cafecdcc4eed tempest-VolumesActionsTest-937364676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2196c3dc-6463-4ac0-b781-08d8ce45060a" returned: 0 in 1.449s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:42:29 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-2aa5a4ed-7998-48f6-9888-cafecdcc4eed tempest-VolumesActionsTest-937364676 None] <== create_volume: return (3672ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:42:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-2aa5a4ed-7998-48f6-9888-cafecdcc4eed tempest-VolumesActionsTest-937364676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.675s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:42:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-4a8ce24a-538e-49c6-822f-d77f2c9c9c62 tempest-VolumesGetTest-2096456054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.044s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:42:29 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-4a8ce24a-538e-49c6-822f-d77f2c9c9c62 tempest-VolumesGetTest-2096456054 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:42:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1439662422',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce122690-9d74-455b-9e46-713809ccb4da,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='32af181c197945aeb61deace335c7961',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:42:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:42:25Z,use_quota=True,user_id='ba462433f4ed421ca2235f25668a482f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:42:29 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-4a8ce24a-538e-49c6-822f-d77f2c9c9c62 tempest-VolumesGetTest-2096456054 None] Creating volume ce122690-9d74-455b-9e46-713809ccb4da {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:42:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-4a8ce24a-538e-49c6-822f-d77f2c9c9c62 tempest-VolumesGetTest-2096456054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:42:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-4a8ce24a-538e-49c6-822f-d77f2c9c9c62 tempest-VolumesGetTest-2096456054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:42:29 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-4a8ce24a-538e-49c6-822f-d77f2c9c9c62 tempest-VolumesGetTest-2096456054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:42:29 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-4a8ce24a-538e-49c6-822f-d77f2c9c9c62 tempest-VolumesGetTest-2096456054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:42:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-4a8ce24a-538e-49c6-822f-d77f2c9c9c62 tempest-VolumesGetTest-2096456054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:42:29 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-4a8ce24a-538e-49c6-822f-d77f2c9c9c62 tempest-VolumesGetTest-2096456054 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:42:29 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-4a8ce24a-538e-49c6-822f-d77f2c9c9c62 tempest-VolumesGetTest-2096456054 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:42:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4a8ce24a-538e-49c6-822f-d77f2c9c9c62 tempest-VolumesGetTest-2096456054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ce122690-9d74-455b-9e46-713809ccb4da 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:42:29 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2aa5a4ed-7998-48f6-9888-cafecdcc4eed tempest-VolumesActionsTest-937364676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (980bf5bc-b601-4f0c-863f-cdc8bec80bbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2196c3dc-6463-4ac0-b781-08d8ce45060a', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:42:29 devstack sudo[98991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ce122690-9d74-455b-9e46-713809ccb4da 1073741824
Jul 09 14:42:29 devstack sudo[98991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:42:29 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2aa5a4ed-7998-48f6-9888-cafecdcc4eed tempest-VolumesActionsTest-937364676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a936d9bb-4ea9-4f98-8624-3f910821fa9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:42:29 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-2aa5a4ed-7998-48f6-9888-cafecdcc4eed tempest-VolumesActionsTest-937364676 None] Volume volume-2196c3dc-6463-4ac0-b781-08d8ce45060a (2196c3dc-6463-4ac0-b781-08d8ce45060a): created successfully
Jul 09 14:42:29 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2aa5a4ed-7998-48f6-9888-cafecdcc4eed tempest-VolumesActionsTest-937364676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a936d9bb-4ea9-4f98-8624-3f910821fa9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:42:29 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2aa5a4ed-7998-48f6-9888-cafecdcc4eed tempest-VolumesActionsTest-937364676 None] Flow 'volume_create_manager' (71b8a099-2841-428a-ad7d-90e7795127d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:42:29 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-2aa5a4ed-7998-48f6-9888-cafecdcc4eed tempest-VolumesActionsTest-937364676 None] Created volume successfully.
Jul 09 14:42:30 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-692a7349-c0b1-41db-bd15-e49660ac4153 tempest-VolumesActionsTest-937364676 None] Acquiring lock "cinder-2196c3dc-6463-4ac0-b781-08d8ce45060a" by "attach_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:42:30 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-692a7349-c0b1-41db-bd15-e49660ac4153 tempest-VolumesActionsTest-937364676 None] Lock "cinder-2196c3dc-6463-4ac0-b781-08d8ce45060a" acquired by "attach_volume" :: waited 0.045s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:42:30 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-692a7349-c0b1-41db-bd15-e49660ac4153 tempest-VolumesActionsTest-937364676 None] Attaching volume 2196c3dc-6463-4ac0-b781-08d8ce45060a to instance cf454556-8c15-41e2-96df-0d32487f7c1a at mountpoint /dev/vdb on host None.
Jul 09 14:42:30 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-692a7349-c0b1-41db-bd15-e49660ac4153 tempest-VolumesActionsTest-937364676 None] Attach volume completed successfully.
Jul 09 14:42:30 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-692a7349-c0b1-41db-bd15-e49660ac4153 tempest-VolumesActionsTest-937364676 None] Lock "cinder-2196c3dc-6463-4ac0-b781-08d8ce45060a" released by "attach_volume" :: held 0.350s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:42:31 devstack sudo[98989]: pam_unix(sudo:session): session closed for user root
Jul 09 14:42:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1cb7e4e6-9e40-4533-a2c4-c09f67cd21c1 tempest-TestInstancesWithCinderVolumes-1507168999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ffedc0c5-a50b-4b16-8c53-4c21c22887bd" returned: 0 in 1.463s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:42:31 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1cb7e4e6-9e40-4533-a2c4-c09f67cd21c1 tempest-TestInstancesWithCinderVolumes-1507168999 None] Lock "cinder-quobyte-ffedc0c5-a50b-4b16-8c53-4c21c22887bd" released by "delete_volume" :: held 3.872s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:42:31 devstack cinder-volume[87230]: WARNING cinder.quota [None req-1cb7e4e6-9e40-4533-a2c4-c09f67cd21c1 tempest-TestInstancesWithCinderVolumes-1507168999 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2095513295-880751420 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2095513295-880751420, it is now deprecated. Please use the default quota class for default quota.
Jul 09 14:42:31 devstack cinder-volume[87230]: WARNING cinder.quota [None req-1cb7e4e6-9e40-4533-a2c4-c09f67cd21c1 tempest-TestInstancesWithCinderVolumes-1507168999 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2095513295-880751420 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2095513295-880751420, it is now deprecated. Please use the default quota class for default quota.
Jul 09 14:42:31 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-1cb7e4e6-9e40-4533-a2c4-c09f67cd21c1 tempest-TestInstancesWithCinderVolumes-1507168999 None] Created reservations ['13680224-770c-4383-9d1d-705871fa4928', '0e5bd5fc-54d4-43a9-8270-18b5a16a3f52', 'c4d781d8-6fdf-473d-a9e6-199a7ac8a5de', 'cef0588c-27a1-40fa-be74-acc3ecf89e74'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:42:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1cb7e4e6-9e40-4533-a2c4-c09f67cd21c1 tempest-TestInstancesWithCinderVolumes-1507168999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:42:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1cb7e4e6-9e40-4533-a2c4-c09f67cd21c1 tempest-TestInstancesWithCinderVolumes-1507168999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:42:31 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-1cb7e4e6-9e40-4533-a2c4-c09f67cd21c1 tempest-TestInstancesWithCinderVolumes-1507168999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:42:31 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-1cb7e4e6-9e40-4533-a2c4-c09f67cd21c1 tempest-TestInstancesWithCinderVolumes-1507168999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:42:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1cb7e4e6-9e40-4533-a2c4-c09f67cd21c1 tempest-TestInstancesWithCinderVolumes-1507168999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:42:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1cb7e4e6-9e40-4533-a2c4-c09f67cd21c1 tempest-TestInstancesWithCinderVolumes-1507168999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:42:31 devstack sudo[99016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:42:31 devstack sudo[99016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:42:31 devstack sudo[98991]: pam_unix(sudo:session): session closed for user root
Jul 09 14:42:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4a8ce24a-538e-49c6-822f-d77f2c9c9c62 tempest-VolumesGetTest-2096456054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ce122690-9d74-455b-9e46-713809ccb4da 1073741824" returned: 0 in 1.905s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:42:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4a8ce24a-538e-49c6-822f-d77f2c9c9c62 tempest-VolumesGetTest-2096456054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ce122690-9d74-455b-9e46-713809ccb4da {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:42:31 devstack sudo[99020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ce122690-9d74-455b-9e46-713809ccb4da
Jul 09 14:42:31 devstack sudo[99020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:42:33 devstack sudo[99016]: pam_unix(sudo:session): session closed for user root
Jul 09 14:42:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1cb7e4e6-9e40-4533-a2c4-c09f67cd21c1 tempest-TestInstancesWithCinderVolumes-1507168999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 1.655s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:42:33 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-1cb7e4e6-9e40-4533-a2c4-c09f67cd21c1 tempest-TestInstancesWithCinderVolumes-1507168999 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:42:33 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-1cb7e4e6-9e40-4533-a2c4-c09f67cd21c1 tempest-TestInstancesWithCinderVolumes-1507168999 None] Deleted volume successfully.
Jul 09 14:42:33 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-ffc01dc6-6c0a-4e9f-bf6f-5106e0cf4111 tempest-VolumesActionsTest-1951729172 None] Terminate volume connection completed successfully.
Jul 09 14:42:33 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1cb7e4e6-9e40-4533-a2c4-c09f67cd21c1 tempest-TestInstancesWithCinderVolumes-1507168999 None] Lock "cinder-ffedc0c5-a50b-4b16-8c53-4c21c22887bd-delete_volume" released by "delete_volume" :: held 6.086s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:42:33 devstack sudo[99020]: pam_unix(sudo:session): session closed for user root
Jul 09 14:42:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4a8ce24a-538e-49c6-822f-d77f2c9c9c62 tempest-VolumesGetTest-2096456054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ce122690-9d74-455b-9e46-713809ccb4da" returned: 0 in 1.458s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:42:33 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-4a8ce24a-538e-49c6-822f-d77f2c9c9c62 tempest-VolumesGetTest-2096456054 None] <== create_volume: return (3453ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:42:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-4a8ce24a-538e-49c6-822f-d77f2c9c9c62 tempest-VolumesGetTest-2096456054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.458s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:42:33 devstack cinder-volume[87230]: DEBUG cinder.volume.volume_utils [None req-4a8ce24a-538e-49c6-822f-d77f2c9c9c62 tempest-VolumesGetTest-2096456054 None] Attempting download of 5eba314f-9adb-4fc7-aaad-9e9a3b7dae70 ((None, [{'url': 'file:///opt/stack/data/glance/images/5eba314f-9adb-4fc7-aaad-9e9a3b7dae70', 'metadata': {}}])) to volume ce122690-9d74-455b-9e46-713809ccb4da. {{(pid=87230) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 09 14:42:33 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6083eb6-da06-4356-96fb-66400dbdd959 tempest-VolumesActionsTest-1906998927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:42:33 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c6083eb6-da06-4356-96fb-66400dbdd959 tempest-VolumesActionsTest-1906998927 None] Flow 'volume_create_manager' (bfbb97e2-dd68-4059-b3cb-fb05ffae9060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:42:33 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c6083eb6-da06-4356-96fb-66400dbdd959 tempest-VolumesActionsTest-1906998927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77723f4d-a6d9-481a-8c61-e09d45a91d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:42:33 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[145a41a8-3af4-430d-8ca3-a19aca67458a]: (4, 'raw') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:42:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4a8ce24a-538e-49c6-822f-d77f2c9c9c62 tempest-VolumesGetTest-2096456054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5eba314f-9adb-4fc7-aaad-9e9a3b7dae70_sgbeetm0 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:42:33 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c6083eb6-da06-4356-96fb-66400dbdd959 tempest-VolumesActionsTest-1906998927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77723f4d-a6d9-481a-8c61-e09d45a91d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:42:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-925035998',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c94308d-f5c8-4a1c-9fd3-eedf373f1b20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2708c1ec4f3a4779a0c8e3f76cdb7005',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:42:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:42:33Z,use_quota=True,user_id='70761e784c1f4f65a28bdb713d4f9f39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:42:33 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c6083eb6-da06-4356-96fb-66400dbdd959 tempest-VolumesActionsTest-1906998927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff2fef0f-a26a-47d9-b622-5e39b099571f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:42:33 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c6083eb6-da06-4356-96fb-66400dbdd959 tempest-VolumesActionsTest-1906998927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff2fef0f-a26a-47d9-b622-5e39b099571f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:42:33 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c6083eb6-da06-4356-96fb-66400dbdd959 tempest-VolumesActionsTest-1906998927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c07e1d21-7436-419e-8373-76a01f644684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:42:33 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c6083eb6-da06-4356-96fb-66400dbdd959 tempest-VolumesActionsTest-1906998927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c07e1d21-7436-419e-8373-76a01f644684) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c94308d-f5c8-4a1c-9fd3-eedf373f1b20', 'volume_name': 'volume-9c94308d-f5c8-4a1c-9fd3-eedf373f1b20', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:42:33 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c6083eb6-da06-4356-96fb-66400dbdd959 tempest-VolumesActionsTest-1906998927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c399d9fc-c0f1-4163-8c48-73557e436f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:42:33 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c6083eb6-da06-4356-96fb-66400dbdd959 tempest-VolumesActionsTest-1906998927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c399d9fc-c0f1-4163-8c48-73557e436f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:42:33 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c6083eb6-da06-4356-96fb-66400dbdd959 tempest-VolumesActionsTest-1906998927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46f36cbc-d1dc-4bcc-8105-5ab87fadc97c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:42:33 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-c6083eb6-da06-4356-96fb-66400dbdd959 tempest-VolumesActionsTest-1906998927 None] Volume 9c94308d-f5c8-4a1c-9fd3-eedf373f1b20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c94308d-f5c8-4a1c-9fd3-eedf373f1b20', 'volume_size': 1}
Jul 09 14:42:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c6083eb6-da06-4356-96fb-66400dbdd959 tempest-VolumesActionsTest-1906998927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:42:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c6083eb6-da06-4356-96fb-66400dbdd959 tempest-VolumesActionsTest-1906998927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:42:33 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-c6083eb6-da06-4356-96fb-66400dbdd959 tempest-VolumesActionsTest-1906998927 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:42:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-925035998',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c94308d-f5c8-4a1c-9fd3-eedf373f1b20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2708c1ec4f3a4779a0c8e3f76cdb7005',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:42:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:42:33Z,use_quota=True,user_id='70761e784c1f4f65a28bdb713d4f9f39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:42:33 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-c6083eb6-da06-4356-96fb-66400dbdd959 tempest-VolumesActionsTest-1906998927 None] Creating volume 9c94308d-f5c8-4a1c-9fd3-eedf373f1b20 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:42:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c6083eb6-da06-4356-96fb-66400dbdd959 tempest-VolumesActionsTest-1906998927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:42:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c6083eb6-da06-4356-96fb-66400dbdd959 tempest-VolumesActionsTest-1906998927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:42:33 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-c6083eb6-da06-4356-96fb-66400dbdd959 tempest-VolumesActionsTest-1906998927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:42:33 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-c6083eb6-da06-4356-96fb-66400dbdd959 tempest-VolumesActionsTest-1906998927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:42:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c6083eb6-da06-4356-96fb-66400dbdd959 tempest-VolumesActionsTest-1906998927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:42:33 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-c6083eb6-da06-4356-96fb-66400dbdd959 tempest-VolumesActionsTest-1906998927 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:42:33 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-c6083eb6-da06-4356-96fb-66400dbdd959 tempest-VolumesActionsTest-1906998927 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:42:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c6083eb6-da06-4356-96fb-66400dbdd959 tempest-VolumesActionsTest-1906998927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-9c94308d-f5c8-4a1c-9fd3-eedf373f1b20 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:42:33 devstack sudo[99027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-9c94308d-f5c8-4a1c-9fd3-eedf373f1b20 1073741824
Jul 09 14:42:33 devstack sudo[99027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:42:33 devstack sudo[99026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5eba314f-9adb-4fc7-aaad-9e9a3b7dae70_sgbeetm0
Jul 09 14:42:33 devstack sudo[99026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:42:33 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-ffc01dc6-6c0a-4e9f-bf6f-5106e0cf4111 tempest-VolumesActionsTest-1951729172 None] Acquiring lock "cinder-2196c3dc-6463-4ac0-b781-08d8ce45060a-detach_volume" by "detach_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:42:33 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-ffc01dc6-6c0a-4e9f-bf6f-5106e0cf4111 tempest-VolumesActionsTest-1951729172 None] Lock "cinder-2196c3dc-6463-4ac0-b781-08d8ce45060a-detach_volume" acquired by "detach_volume" :: waited 0.036s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:42:33 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-ffc01dc6-6c0a-4e9f-bf6f-5106e0cf4111 tempest-VolumesActionsTest-1951729172 None] Detaching volume 2196c3dc-6463-4ac0-b781-08d8ce45060a from instance cf454556-8c15-41e2-96df-0d32487f7c1a.
Jul 09 14:42:33 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-ffc01dc6-6c0a-4e9f-bf6f-5106e0cf4111 tempest-VolumesActionsTest-1951729172 None] Detach volume completed successfully.
Jul 09 14:42:33 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-ffc01dc6-6c0a-4e9f-bf6f-5106e0cf4111 tempest-VolumesActionsTest-1951729172 None] Lock "cinder-2196c3dc-6463-4ac0-b781-08d8ce45060a-detach_volume" released by "detach_volume" :: held 0.128s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:42:34 devstack sudo[99026]: pam_unix(sudo:session): session closed for user root
Jul 09 14:42:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4a8ce24a-538e-49c6-822f-d77f2c9c9c62 tempest-VolumesGetTest-2096456054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5eba314f-9adb-4fc7-aaad-9e9a3b7dae70_sgbeetm0" returned: 0 in 0.874s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:42:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4a8ce24a-538e-49c6-822f-d77f2c9c9c62 tempest-VolumesGetTest-2096456054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5eba314f-9adb-4fc7-aaad-9e9a3b7dae70_sgbeetm0 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:42:34 devstack sudo[99041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5eba314f-9adb-4fc7-aaad-9e9a3b7dae70_sgbeetm0
Jul 09 14:42:34 devstack sudo[99041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:42:34 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-5cad54bf-cd6e-4841-96bc-a27b7fd24e56 tempest-VolumesActionsTest-937364676 None] Acquiring lock "cinder-2196c3dc-6463-4ac0-b781-08d8ce45060a-detach_volume" by "detach_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:42:34 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-5cad54bf-cd6e-4841-96bc-a27b7fd24e56 tempest-VolumesActionsTest-937364676 None] Lock "cinder-2196c3dc-6463-4ac0-b781-08d8ce45060a-detach_volume" acquired by "detach_volume" :: waited 0.023s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:42:34 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-5cad54bf-cd6e-4841-96bc-a27b7fd24e56 tempest-VolumesActionsTest-937364676 None] Volume detach called, but volume not attached.
Jul 09 14:42:34 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-5cad54bf-cd6e-4841-96bc-a27b7fd24e56 tempest-VolumesActionsTest-937364676 None] Lock "cinder-2196c3dc-6463-4ac0-b781-08d8ce45060a-detach_volume" released by "detach_volume" :: held 0.033s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:42:34 devstack sudo[99027]: pam_unix(sudo:session): session closed for user root
Jul 09 14:42:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c6083eb6-da06-4356-96fb-66400dbdd959 tempest-VolumesActionsTest-1906998927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-9c94308d-f5c8-4a1c-9fd3-eedf373f1b20 1073741824" returned: 0 in 1.115s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:42:34 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-519dda1d-c215-4192-bf46-27d0075a2204 req-c23ca730-b5f5-471a-a9d2-3b0e59662fa0 tempest-TestInstancesWithCinderVolumes-1507168999 None] Terminate volume connection completed successfully.
Jul 09 14:42:34 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-519dda1d-c215-4192-bf46-27d0075a2204 req-c23ca730-b5f5-471a-a9d2-3b0e59662fa0 tempest-TestInstancesWithCinderVolumes-1507168999 None] Deleting attachment 4e340a19-4228-4407-bfe2-5d059b0154f2. {{(pid=87230) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 09 14:42:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c6083eb6-da06-4356-96fb-66400dbdd959 tempest-VolumesActionsTest-1906998927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-9c94308d-f5c8-4a1c-9fd3-eedf373f1b20 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:42:34 devstack sudo[99059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-9c94308d-f5c8-4a1c-9fd3-eedf373f1b20
Jul 09 14:42:34 devstack sudo[99059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:42:35 devstack sudo[99041]: pam_unix(sudo:session): session closed for user root
Jul 09 14:42:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4a8ce24a-538e-49c6-822f-d77f2c9c9c62 tempest-VolumesGetTest-2096456054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5eba314f-9adb-4fc7-aaad-9e9a3b7dae70_sgbeetm0" returned: 1 in 0.912s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:42:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4a8ce24a-538e-49c6-822f-d77f2c9c9c62 tempest-VolumesGetTest-2096456054 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5eba314f-9adb-4fc7-aaad-9e9a3b7dae70_sgbeetm0' failed. Not Retrying. {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 09 14:42:35 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a83ff75-da01-4f38-8166-fdcaa0956717]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:42:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4a8ce24a-538e-49c6-822f-d77f2c9c9c62 tempest-VolumesGetTest-2096456054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5eba314f-9adb-4fc7-aaad-9e9a3b7dae70__vl6dzdidevstack@QuobyteHD {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:42:35 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-6d2d9013-415d-46a3-ac07-c163cfb83aaa tempest-VolumesActionsTest-937364676 None] Acquiring lock "cinder-2196c3dc-6463-4ac0-b781-08d8ce45060a-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:42:35 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-6d2d9013-415d-46a3-ac07-c163cfb83aaa tempest-VolumesActionsTest-937364676 None] Lock "cinder-2196c3dc-6463-4ac0-b781-08d8ce45060a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:42:35 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-6d2d9013-415d-46a3-ac07-c163cfb83aaa tempest-VolumesActionsTest-937364676 None] Acquiring lock "cinder-quobyte-2196c3dc-6463-4ac0-b781-08d8ce45060a" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:42:35 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-6d2d9013-415d-46a3-ac07-c163cfb83aaa tempest-VolumesActionsTest-937364676 None] Lock "cinder-quobyte-2196c3dc-6463-4ac0-b781-08d8ce45060a" acquired by "delete_volume" :: waited 0.019s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:42:35 devstack sudo[99059]: pam_unix(sudo:session): session closed for user root
Jul 09 14:42:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c6083eb6-da06-4356-96fb-66400dbdd959 tempest-VolumesActionsTest-1906998927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-9c94308d-f5c8-4a1c-9fd3-eedf373f1b20" returned: 0 in 0.722s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:42:35 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-c6083eb6-da06-4356-96fb-66400dbdd959 tempest-VolumesActionsTest-1906998927 None] <== create_volume: return (1882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:42:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c6083eb6-da06-4356-96fb-66400dbdd959 tempest-VolumesActionsTest-1906998927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.884s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:42:35 devstack sudo[99064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5eba314f-9adb-4fc7-aaad-9e9a3b7dae70__vl6dzdidevstack@QuobyteHD
Jul 09 14:42:35 devstack sudo[99064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:42:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c6083eb6-da06-4356-96fb-66400dbdd959 tempest-VolumesActionsTest-1906998927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46f36cbc-d1dc-4bcc-8105-5ab87fadc97c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c94308d-f5c8-4a1c-9fd3-eedf373f1b20', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:42:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c6083eb6-da06-4356-96fb-66400dbdd959 tempest-VolumesActionsTest-1906998927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60176f68-1597-41f4-adf7-f8ca8ca10c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:42:35 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd92717d-d932-47b5-a7dd-82121f38acac]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:42:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6d2d9013-415d-46a3-ac07-c163cfb83aaa tempest-VolumesActionsTest-937364676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2196c3dc-6463-4ac0-b781-08d8ce45060a {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:42:35 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-c6083eb6-da06-4356-96fb-66400dbdd959 tempest-VolumesActionsTest-1906998927 None] Volume volume-9c94308d-f5c8-4a1c-9fd3-eedf373f1b20 (9c94308d-f5c8-4a1c-9fd3-eedf373f1b20): created successfully
Jul 09 14:42:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c6083eb6-da06-4356-96fb-66400dbdd959 tempest-VolumesActionsTest-1906998927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60176f68-1597-41f4-adf7-f8ca8ca10c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:42:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c6083eb6-da06-4356-96fb-66400dbdd959 tempest-VolumesActionsTest-1906998927 None] Flow 'volume_create_manager' (bfbb97e2-dd68-4059-b3cb-fb05ffae9060) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:42:35 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-c6083eb6-da06-4356-96fb-66400dbdd959 tempest-VolumesActionsTest-1906998927 None] Created volume successfully.
Jul 09 14:42:35 devstack sudo[99066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2196c3dc-6463-4ac0-b781-08d8ce45060a
Jul 09 14:42:35 devstack sudo[99066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:42:35 devstack sudo[99064]: pam_unix(sudo:session): session closed for user root
Jul 09 14:42:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4a8ce24a-538e-49c6-822f-d77f2c9c9c62 tempest-VolumesGetTest-2096456054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5eba314f-9adb-4fc7-aaad-9e9a3b7dae70__vl6dzdidevstack@QuobyteHD" returned: 0 in 0.796s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:42:35 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-4a8ce24a-538e-49c6-822f-d77f2c9c9c62 tempest-VolumesGetTest-2096456054 None] 5eba314f-9adb-4fc7-aaad-9e9a3b7dae70 was qcow2, converting to raw {{(pid=87230) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 09 14:42:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4a8ce24a-538e-49c6-822f-d77f2c9c9c62 tempest-VolumesGetTest-2096456054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5eba314f-9adb-4fc7-aaad-9e9a3b7dae70__vl6dzdidevstack@QuobyteHD /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ce122690-9d74-455b-9e46-713809ccb4da {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:42:35 devstack sudo[99071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5eba314f-9adb-4fc7-aaad-9e9a3b7dae70__vl6dzdidevstack@QuobyteHD /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ce122690-9d74-455b-9e46-713809ccb4da
Jul 09 14:42:35 devstack sudo[99071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:42:36 devstack sudo[99066]: pam_unix(sudo:session): session closed for user root
Jul 09 14:42:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6d2d9013-415d-46a3-ac07-c163cfb83aaa tempest-VolumesActionsTest-937364676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2196c3dc-6463-4ac0-b781-08d8ce45060a" returned: 0 in 0.852s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:42:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6d2d9013-415d-46a3-ac07-c163cfb83aaa tempest-VolumesActionsTest-937364676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2196c3dc-6463-4ac0-b781-08d8ce45060a {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:42:36 devstack sudo[99077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2196c3dc-6463-4ac0-b781-08d8ce45060a
Jul 09 14:42:36 devstack sudo[99077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:42:36 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-4d3bc1cb-5b70-45ad-8a26-2cc5b8e2eb6a tempest-TestInstancesWithCinderVolumes-1507168999 None] Acquiring lock "cinder-8d49df72-89a9-4f2c-ac53-c34b068fb2d9-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:42:36 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-4d3bc1cb-5b70-45ad-8a26-2cc5b8e2eb6a tempest-TestInstancesWithCinderVolumes-1507168999 None] Lock "cinder-8d49df72-89a9-4f2c-ac53-c34b068fb2d9-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:42:36 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-4d3bc1cb-5b70-45ad-8a26-2cc5b8e2eb6a tempest-TestInstancesWithCinderVolumes-1507168999 None] Acquiring lock "cinder-quobyte-8d49df72-89a9-4f2c-ac53-c34b068fb2d9" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:42:36 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-4d3bc1cb-5b70-45ad-8a26-2cc5b8e2eb6a tempest-TestInstancesWithCinderVolumes-1507168999 None] Lock "cinder-quobyte-8d49df72-89a9-4f2c-ac53-c34b068fb2d9" acquired by "delete_volume" :: waited 0.034s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:42:36 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1d2101c-13fa-4f5b-9f63-f359485f6e64]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:42:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4d3bc1cb-5b70-45ad-8a26-2cc5b8e2eb6a tempest-TestInstancesWithCinderVolumes-1507168999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8d49df72-89a9-4f2c-ac53-c34b068fb2d9 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:42:36 devstack sudo[99091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8d49df72-89a9-4f2c-ac53-c34b068fb2d9
Jul 09 14:42:36 devstack sudo[99091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:42:37 devstack sudo[99077]: pam_unix(sudo:session): session closed for user root
Jul 09 14:42:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6d2d9013-415d-46a3-ac07-c163cfb83aaa tempest-VolumesActionsTest-937364676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2196c3dc-6463-4ac0-b781-08d8ce45060a" returned: 0 in 0.879s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:42:37 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-6d2d9013-415d-46a3-ac07-c163cfb83aaa tempest-VolumesActionsTest-937364676 None] Lock "cinder-quobyte-2196c3dc-6463-4ac0-b781-08d8ce45060a" released by "delete_volume" :: held 1.815s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:42:37 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-6d2d9013-415d-46a3-ac07-c163cfb83aaa tempest-VolumesActionsTest-937364676 None] Created reservations ['8ea44dba-81ad-4837-b3cd-a0691551cf98', 'be4ac7a2-1083-4e4d-a1af-098427161017', '486c84cd-eefa-44ec-afe6-850e2a1b5a99', 'e576997c-aed8-46fe-9245-e52fc5319cf5'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:42:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6d2d9013-415d-46a3-ac07-c163cfb83aaa tempest-VolumesActionsTest-937364676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:42:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6d2d9013-415d-46a3-ac07-c163cfb83aaa tempest-VolumesActionsTest-937364676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:42:37 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-6d2d9013-415d-46a3-ac07-c163cfb83aaa tempest-VolumesActionsTest-937364676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:42:37 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-6d2d9013-415d-46a3-ac07-c163cfb83aaa tempest-VolumesActionsTest-937364676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:42:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6d2d9013-415d-46a3-ac07-c163cfb83aaa tempest-VolumesActionsTest-937364676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:42:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6d2d9013-415d-46a3-ac07-c163cfb83aaa tempest-VolumesActionsTest-937364676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:42:37 devstack sudo[99094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:42:37 devstack sudo[99094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:42:37 devstack sudo[99091]: pam_unix(sudo:session): session closed for user root
Jul 09 14:42:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4d3bc1cb-5b70-45ad-8a26-2cc5b8e2eb6a tempest-TestInstancesWithCinderVolumes-1507168999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8d49df72-89a9-4f2c-ac53-c34b068fb2d9" returned: 0 in 1.188s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:42:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4d3bc1cb-5b70-45ad-8a26-2cc5b8e2eb6a tempest-TestInstancesWithCinderVolumes-1507168999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8d49df72-89a9-4f2c-ac53-c34b068fb2d9 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:42:38 devstack sudo[99102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8d49df72-89a9-4f2c-ac53-c34b068fb2d9
Jul 09 14:42:38 devstack sudo[99102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:42:38 devstack sudo[99094]: pam_unix(sudo:session): session closed for user root
Jul 09 14:42:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6d2d9013-415d-46a3-ac07-c163cfb83aaa tempest-VolumesActionsTest-937364676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 1.293s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:42:38 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-6d2d9013-415d-46a3-ac07-c163cfb83aaa tempest-VolumesActionsTest-937364676 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:42:38 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-6d2d9013-415d-46a3-ac07-c163cfb83aaa tempest-VolumesActionsTest-937364676 None] Deleted volume successfully.
Jul 09 14:42:38 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-6d2d9013-415d-46a3-ac07-c163cfb83aaa tempest-VolumesActionsTest-937364676 None] Lock "cinder-2196c3dc-6463-4ac0-b781-08d8ce45060a-delete_volume" released by "delete_volume" :: held 3.492s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:42:38 devstack sudo[99071]: pam_unix(sudo:session): session closed for user root
Jul 09 14:42:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4a8ce24a-538e-49c6-822f-d77f2c9c9c62 tempest-VolumesGetTest-2096456054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5eba314f-9adb-4fc7-aaad-9e9a3b7dae70__vl6dzdidevstack@QuobyteHD /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ce122690-9d74-455b-9e46-713809ccb4da" returned: 0 in 3.006s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:42:38 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-4a8ce24a-538e-49c6-822f-d77f2c9c9c62 tempest-VolumesGetTest-2096456054 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5eba314f-9adb-4fc7-aaad-9e9a3b7dae70__vl6dzdidevstack@QuobyteHD, size 112.00 MB, duration 3.01 sec, destination /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ce122690-9d74-455b-9e46-713809ccb4da {{(pid=87230) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 09 14:42:38 devstack cinder-volume[87230]: INFO cinder.image.image_utils [None req-4a8ce24a-538e-49c6-822f-d77f2c9c9c62 tempest-VolumesGetTest-2096456054 None] Converted 112.00 MB image at 37.24 MB/s
Jul 09 14:42:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4a8ce24a-538e-49c6-822f-d77f2c9c9c62 tempest-VolumesGetTest-2096456054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ce122690-9d74-455b-9e46-713809ccb4da 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:42:38 devstack sudo[99108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ce122690-9d74-455b-9e46-713809ccb4da 1G
Jul 09 14:42:38 devstack sudo[99108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:42:39 devstack sudo[99102]: pam_unix(sudo:session): session closed for user root
Jul 09 14:42:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4d3bc1cb-5b70-45ad-8a26-2cc5b8e2eb6a tempest-TestInstancesWithCinderVolumes-1507168999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8d49df72-89a9-4f2c-ac53-c34b068fb2d9" returned: 0 in 1.095s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:42:39 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-4d3bc1cb-5b70-45ad-8a26-2cc5b8e2eb6a tempest-TestInstancesWithCinderVolumes-1507168999 None] Lock "cinder-quobyte-8d49df72-89a9-4f2c-ac53-c34b068fb2d9" released by "delete_volume" :: held 2.355s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:42:39 devstack cinder-volume[87230]: WARNING cinder.quota [None req-4d3bc1cb-5b70-45ad-8a26-2cc5b8e2eb6a tempest-TestInstancesWithCinderVolumes-1507168999 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-624505215-1696221974 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-624505215-1696221974, it is now deprecated. Please use the default quota class for default quota.
Jul 09 14:42:39 devstack cinder-volume[87230]: WARNING cinder.quota [None req-4d3bc1cb-5b70-45ad-8a26-2cc5b8e2eb6a tempest-TestInstancesWithCinderVolumes-1507168999 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-624505215-1696221974 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-624505215-1696221974, it is now deprecated. Please use the default quota class for default quota.
Jul 09 14:42:39 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-4d3bc1cb-5b70-45ad-8a26-2cc5b8e2eb6a tempest-TestInstancesWithCinderVolumes-1507168999 None] Created reservations ['a2b5e8ba-461d-4992-a622-e7ecdbd8bbe2', '8872922b-785c-44ad-9cb2-34002979e25d', '40030589-bd54-475b-a5c9-db1b77f35231', '948fb92c-6666-42d8-bd3e-e1c1d17f40a2'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:42:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-4d3bc1cb-5b70-45ad-8a26-2cc5b8e2eb6a tempest-TestInstancesWithCinderVolumes-1507168999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:42:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-4d3bc1cb-5b70-45ad-8a26-2cc5b8e2eb6a tempest-TestInstancesWithCinderVolumes-1507168999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:42:39 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-4d3bc1cb-5b70-45ad-8a26-2cc5b8e2eb6a tempest-TestInstancesWithCinderVolumes-1507168999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:42:39 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-4d3bc1cb-5b70-45ad-8a26-2cc5b8e2eb6a tempest-TestInstancesWithCinderVolumes-1507168999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:42:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-4d3bc1cb-5b70-45ad-8a26-2cc5b8e2eb6a tempest-TestInstancesWithCinderVolumes-1507168999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:42:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4d3bc1cb-5b70-45ad-8a26-2cc5b8e2eb6a tempest-TestInstancesWithCinderVolumes-1507168999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:42:39 devstack sudo[99114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:42:39 devstack sudo[99114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:42:40 devstack sudo[99108]: pam_unix(sudo:session): session closed for user root
Jul 09 14:42:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4a8ce24a-538e-49c6-822f-d77f2c9c9c62 tempest-VolumesGetTest-2096456054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ce122690-9d74-455b-9e46-713809ccb4da 1G" returned: 0 in 1.275s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:42:40 devstack sudo[99114]: pam_unix(sudo:session): session closed for user root
Jul 09 14:42:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4d3bc1cb-5b70-45ad-8a26-2cc5b8e2eb6a tempest-TestInstancesWithCinderVolumes-1507168999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.945s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:42:40 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-4d3bc1cb-5b70-45ad-8a26-2cc5b8e2eb6a tempest-TestInstancesWithCinderVolumes-1507168999 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:42:40 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-4d3bc1cb-5b70-45ad-8a26-2cc5b8e2eb6a tempest-TestInstancesWithCinderVolumes-1507168999 None] Deleted volume successfully.
Jul 09 14:42:40 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[498d9970-3298-4ec0-acc2-62ed657735a2]: (4, 'raw') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:42:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4a8ce24a-538e-49c6-822f-d77f2c9c9c62 tempest-VolumesGetTest-2096456054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ce122690-9d74-455b-9e46-713809ccb4da {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:42:40 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-4d3bc1cb-5b70-45ad-8a26-2cc5b8e2eb6a tempest-TestInstancesWithCinderVolumes-1507168999 None] Lock "cinder-8d49df72-89a9-4f2c-ac53-c34b068fb2d9-delete_volume" released by "delete_volume" :: held 3.684s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:42:40 devstack sudo[99136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ce122690-9d74-455b-9e46-713809ccb4da
Jul 09 14:42:40 devstack sudo[99136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:42:41 devstack sudo[99136]: pam_unix(sudo:session): session closed for user root
Jul 09 14:42:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4a8ce24a-538e-49c6-822f-d77f2c9c9c62 tempest-VolumesGetTest-2096456054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ce122690-9d74-455b-9e46-713809ccb4da" returned: 0 in 1.199s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:42:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4a8ce24a-538e-49c6-822f-d77f2c9c9c62 tempest-VolumesGetTest-2096456054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ce122690-9d74-455b-9e46-713809ccb4da {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:42:41 devstack sudo[99182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ce122690-9d74-455b-9e46-713809ccb4da
Jul 09 14:42:41 devstack sudo[99182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:42:42 devstack sudo[99182]: pam_unix(sudo:session): session closed for user root
Jul 09 14:42:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4a8ce24a-538e-49c6-822f-d77f2c9c9c62 tempest-VolumesGetTest-2096456054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ce122690-9d74-455b-9e46-713809ccb4da" returned: 1 in 0.789s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:42:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4a8ce24a-538e-49c6-822f-d77f2c9c9c62 tempest-VolumesGetTest-2096456054 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ce122690-9d74-455b-9e46-713809ccb4da' failed. Not Retrying. {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 09 14:42:42 devstack cinder-volume[87230]: DEBUG cinder.volume.volume_utils [None req-4a8ce24a-538e-49c6-822f-d77f2c9c9c62 tempest-VolumesGetTest-2096456054 None] Downloaded image 5eba314f-9adb-4fc7-aaad-9e9a3b7dae70 ((None, [{'url': 'file:///opt/stack/data/glance/images/5eba314f-9adb-4fc7-aaad-9e9a3b7dae70', 'metadata': {}}])) to volume ce122690-9d74-455b-9e46-713809ccb4da successfully. {{(pid=87230) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 09 14:42:42 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-4a8ce24a-538e-49c6-822f-d77f2c9c9c62 tempest-VolumesGetTest-2096456054 None] Temporary image 5eba314f-9adb-4fc7-aaad-9e9a3b7dae70 for user ba462433f4ed421ca2235f25668a482f is deleted. {{(pid=87230) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 09 14:42:42 devstack cinder-volume[87230]: DEBUG cinder.volume.volume_utils [None req-4a8ce24a-538e-49c6-822f-d77f2c9c9c62 tempest-VolumesGetTest-2096456054 None] Marking volume ce122690-9d74-455b-9e46-713809ccb4da as bootable. {{(pid=87230) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 09 14:42:42 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a8ce24a-538e-49c6-822f-d77f2c9c9c62 tempest-VolumesGetTest-2096456054 None] Copying metadata from image 5eba314f-9adb-4fc7-aaad-9e9a3b7dae70 to ce122690-9d74-455b-9e46-713809ccb4da. {{(pid=87230) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 09 14:42:42 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a8ce24a-538e-49c6-822f-d77f2c9c9c62 tempest-VolumesGetTest-2096456054 None] Creating volume glance metadata for volume ce122690-9d74-455b-9e46-713809ccb4da backed by image 5eba314f-9adb-4fc7-aaad-9e9a3b7dae70 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5eba314f-9adb-4fc7-aaad-9e9a3b7dae70', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87230) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 09 14:42:42 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4a8ce24a-538e-49c6-822f-d77f2c9c9c62 tempest-VolumesGetTest-2096456054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbf849ad-0724-483d-8805-32e587274805) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce122690-9d74-455b-9e46-713809ccb4da', 'volume_size': 1, 'image_id': '5eba314f-9adb-4fc7-aaad-9e9a3b7dae70', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5eba314f-9adb-4fc7-aaad-9e9a3b7dae70', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '10a7640b39774d00a67b2de818bf4a10', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5eba314f-9adb-4fc7-aaad-9e9a3b7dae70', 'created_at': datetime.datetime(2026, 7, 9, 12, 24, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 12, 24, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5eba314f-9adb-4fc7-aaad-9e9a3b7dae70/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x720a5437d940>}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:42:42 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4a8ce24a-538e-49c6-822f-d77f2c9c9c62 tempest-VolumesGetTest-2096456054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab953192-5471-430b-85e3-7e6cd5a5653b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:42:42 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-4a8ce24a-538e-49c6-822f-d77f2c9c9c62 tempest-VolumesGetTest-2096456054 None] Volume volume-ce122690-9d74-455b-9e46-713809ccb4da (ce122690-9d74-455b-9e46-713809ccb4da): created successfully
Jul 09 14:42:42 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4a8ce24a-538e-49c6-822f-d77f2c9c9c62 tempest-VolumesGetTest-2096456054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab953192-5471-430b-85e3-7e6cd5a5653b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:42:42 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4a8ce24a-538e-49c6-822f-d77f2c9c9c62 tempest-VolumesGetTest-2096456054 None] Flow 'volume_create_manager' (e4ed4f48-fddc-4253-88c3-993c23b103ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:42:42 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-4a8ce24a-538e-49c6-822f-d77f2c9c9c62 tempest-VolumesGetTest-2096456054 None] Created volume successfully.
Jul 09 14:42:43 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-42c5d65c-2a21-448e-b9a4-adb4c821156e tempest-VolumesGetTest-2096456054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:42:43 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-42c5d65c-2a21-448e-b9a4-adb4c821156e tempest-VolumesGetTest-2096456054 None] Flow 'volume_create_manager' (65cbcade-517a-4193-a903-9d1cfa5de30a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:42:43 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-42c5d65c-2a21-448e-b9a4-adb4c821156e tempest-VolumesGetTest-2096456054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a72b225c-1be4-4e80-8d7a-1deb90bcff36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:42:43 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-42c5d65c-2a21-448e-b9a4-adb4c821156e tempest-VolumesGetTest-2096456054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a72b225c-1be4-4e80-8d7a-1deb90bcff36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:42:43Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2047475670',display_name='tempest-VolumesGetTest-Volume-361026397',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e8cf73a-1c26-4899-9372-031fbed9ac02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32af181c197945aeb61deace335c7961',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:42:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:42:44Z,use_quota=True,user_id='ba462433f4ed421ca2235f25668a482f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:42:43 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-42c5d65c-2a21-448e-b9a4-adb4c821156e tempest-VolumesGetTest-2096456054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f34f0dfc-5a1d-464e-8976-e884cae295ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:42:43 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-42c5d65c-2a21-448e-b9a4-adb4c821156e tempest-VolumesGetTest-2096456054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f34f0dfc-5a1d-464e-8976-e884cae295ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:42:43 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-42c5d65c-2a21-448e-b9a4-adb4c821156e tempest-VolumesGetTest-2096456054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (334360fb-fd42-4312-a76e-8d52ff9b5f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:42:43 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-42c5d65c-2a21-448e-b9a4-adb4c821156e tempest-VolumesGetTest-2096456054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (334360fb-fd42-4312-a76e-8d52ff9b5f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e8cf73a-1c26-4899-9372-031fbed9ac02', 'volume_name': 'volume-2e8cf73a-1c26-4899-9372-031fbed9ac02', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:42:43 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-42c5d65c-2a21-448e-b9a4-adb4c821156e tempest-VolumesGetTest-2096456054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d51321d8-7b6d-4eaf-a6d8-059d8b5046bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:42:43 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-42c5d65c-2a21-448e-b9a4-adb4c821156e tempest-VolumesGetTest-2096456054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d51321d8-7b6d-4eaf-a6d8-059d8b5046bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:42:44 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-42c5d65c-2a21-448e-b9a4-adb4c821156e tempest-VolumesGetTest-2096456054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (beefad4a-9eab-44a8-a7d7-c441b05786cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:42:44 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-42c5d65c-2a21-448e-b9a4-adb4c821156e tempest-VolumesGetTest-2096456054 None] Volume 2e8cf73a-1c26-4899-9372-031fbed9ac02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e8cf73a-1c26-4899-9372-031fbed9ac02', 'volume_size': 1}
Jul 09 14:42:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-42c5d65c-2a21-448e-b9a4-adb4c821156e tempest-VolumesGetTest-2096456054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:42:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-42c5d65c-2a21-448e-b9a4-adb4c821156e tempest-VolumesGetTest-2096456054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:42:44 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-42c5d65c-2a21-448e-b9a4-adb4c821156e tempest-VolumesGetTest-2096456054 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:42:43Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2047475670',display_name='tempest-VolumesGetTest-Volume-361026397',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e8cf73a-1c26-4899-9372-031fbed9ac02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32af181c197945aeb61deace335c7961',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:42:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:42:44Z,use_quota=True,user_id='ba462433f4ed421ca2235f25668a482f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:42:44 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-42c5d65c-2a21-448e-b9a4-adb4c821156e tempest-VolumesGetTest-2096456054 None] Creating volume 2e8cf73a-1c26-4899-9372-031fbed9ac02 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:42:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-42c5d65c-2a21-448e-b9a4-adb4c821156e tempest-VolumesGetTest-2096456054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:42:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-42c5d65c-2a21-448e-b9a4-adb4c821156e tempest-VolumesGetTest-2096456054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:42:44 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-42c5d65c-2a21-448e-b9a4-adb4c821156e tempest-VolumesGetTest-2096456054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:42:44 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-42c5d65c-2a21-448e-b9a4-adb4c821156e tempest-VolumesGetTest-2096456054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:42:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-42c5d65c-2a21-448e-b9a4-adb4c821156e tempest-VolumesGetTest-2096456054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:42:44 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-42c5d65c-2a21-448e-b9a4-adb4c821156e tempest-VolumesGetTest-2096456054 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:42:44 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-42c5d65c-2a21-448e-b9a4-adb4c821156e tempest-VolumesGetTest-2096456054 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:42:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-42c5d65c-2a21-448e-b9a4-adb4c821156e tempest-VolumesGetTest-2096456054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2e8cf73a-1c26-4899-9372-031fbed9ac02 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:42:44 devstack sudo[99207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2e8cf73a-1c26-4899-9372-031fbed9ac02 1073741824
Jul 09 14:42:44 devstack sudo[99207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:42:45 devstack sudo[99207]: pam_unix(sudo:session): session closed for user root
Jul 09 14:42:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-42c5d65c-2a21-448e-b9a4-adb4c821156e tempest-VolumesGetTest-2096456054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2e8cf73a-1c26-4899-9372-031fbed9ac02 1073741824" returned: 0 in 1.260s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:42:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-42c5d65c-2a21-448e-b9a4-adb4c821156e tempest-VolumesGetTest-2096456054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2e8cf73a-1c26-4899-9372-031fbed9ac02 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:42:45 devstack sudo[99219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2e8cf73a-1c26-4899-9372-031fbed9ac02
Jul 09 14:42:45 devstack sudo[99219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:42:46 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-ba61c214-5a6e-48e7-9099-2debc1cbcf77 req-f6151e4f-b6c7-4774-a64c-36fe6c709170 tempest-TestInstancesWithCinderVolumes-1507168999 None] Terminate volume connection completed successfully.
Jul 09 14:42:46 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-ba61c214-5a6e-48e7-9099-2debc1cbcf77 req-f6151e4f-b6c7-4774-a64c-36fe6c709170 tempest-TestInstancesWithCinderVolumes-1507168999 None] Deleting attachment b6cb2ed8-6148-4288-9a2a-fb014035743c. {{(pid=87230) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 09 14:42:46 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-47442dca-99dd-491c-8ca9-ae01ff43fe50 tempest-VolumesActionsTest-937364676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:42:46 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-47442dca-99dd-491c-8ca9-ae01ff43fe50 tempest-VolumesActionsTest-937364676 None] Flow 'volume_create_manager' (cfde8c82-9638-4a4e-90d2-090165c20b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:42:46 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-47442dca-99dd-491c-8ca9-ae01ff43fe50 tempest-VolumesActionsTest-937364676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63cdaa5c-faff-4f3c-92d5-34b892ccc68f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:42:46 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-47442dca-99dd-491c-8ca9-ae01ff43fe50 tempest-VolumesActionsTest-937364676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63cdaa5c-faff-4f3c-92d5-34b892ccc68f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:42:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1560898218',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2eee883-4515-4c2f-b2e0-8eff73e3f5c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='522e7febd7b6499d9f39419cabe064ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:42:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:42:46Z,use_quota=True,user_id='3802808ebeb5450cb366087caef84fcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:42:46 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-47442dca-99dd-491c-8ca9-ae01ff43fe50 tempest-VolumesActionsTest-937364676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae1e73ee-bbb4-4ac0-81a7-5bad66e70f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:42:46 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-47442dca-99dd-491c-8ca9-ae01ff43fe50 tempest-VolumesActionsTest-937364676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae1e73ee-bbb4-4ac0-81a7-5bad66e70f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:42:46 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-47442dca-99dd-491c-8ca9-ae01ff43fe50 tempest-VolumesActionsTest-937364676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64e0382e-f3cb-4425-a61b-c9876941b83f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:42:46 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-47442dca-99dd-491c-8ca9-ae01ff43fe50 tempest-VolumesActionsTest-937364676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64e0382e-f3cb-4425-a61b-c9876941b83f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2eee883-4515-4c2f-b2e0-8eff73e3f5c0', 'volume_name': 'volume-b2eee883-4515-4c2f-b2e0-8eff73e3f5c0', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:42:46 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-47442dca-99dd-491c-8ca9-ae01ff43fe50 tempest-VolumesActionsTest-937364676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (130bb9a1-b28b-4da3-a31c-405e801a9f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:42:46 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-47442dca-99dd-491c-8ca9-ae01ff43fe50 tempest-VolumesActionsTest-937364676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (130bb9a1-b28b-4da3-a31c-405e801a9f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:42:46 devstack sudo[99219]: pam_unix(sudo:session): session closed for user root
Jul 09 14:42:46 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-47442dca-99dd-491c-8ca9-ae01ff43fe50 tempest-VolumesActionsTest-937364676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d24d780b-5f94-42db-abdb-cb02075d2ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:42:46 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-47442dca-99dd-491c-8ca9-ae01ff43fe50 tempest-VolumesActionsTest-937364676 None] Volume b2eee883-4515-4c2f-b2e0-8eff73e3f5c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2eee883-4515-4c2f-b2e0-8eff73e3f5c0', 'volume_size': 1}
Jul 09 14:42:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-47442dca-99dd-491c-8ca9-ae01ff43fe50 tempest-VolumesActionsTest-937364676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:42:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-42c5d65c-2a21-448e-b9a4-adb4c821156e tempest-VolumesGetTest-2096456054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2e8cf73a-1c26-4899-9372-031fbed9ac02" returned: 0 in 0.974s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:42:46 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-42c5d65c-2a21-448e-b9a4-adb4c821156e tempest-VolumesGetTest-2096456054 None] <== create_volume: return (2320ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:42:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-42c5d65c-2a21-448e-b9a4-adb4c821156e tempest-VolumesGetTest-2096456054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.323s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:42:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-47442dca-99dd-491c-8ca9-ae01ff43fe50 tempest-VolumesActionsTest-937364676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:42:46 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-47442dca-99dd-491c-8ca9-ae01ff43fe50 tempest-VolumesActionsTest-937364676 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:42:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1560898218',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2eee883-4515-4c2f-b2e0-8eff73e3f5c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='522e7febd7b6499d9f39419cabe064ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:42:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:42:46Z,use_quota=True,user_id='3802808ebeb5450cb366087caef84fcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:42:46 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-47442dca-99dd-491c-8ca9-ae01ff43fe50 tempest-VolumesActionsTest-937364676 None] Creating volume b2eee883-4515-4c2f-b2e0-8eff73e3f5c0 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:42:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-47442dca-99dd-491c-8ca9-ae01ff43fe50 tempest-VolumesActionsTest-937364676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:42:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-47442dca-99dd-491c-8ca9-ae01ff43fe50 tempest-VolumesActionsTest-937364676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:42:46 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-47442dca-99dd-491c-8ca9-ae01ff43fe50 tempest-VolumesActionsTest-937364676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:42:46 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-47442dca-99dd-491c-8ca9-ae01ff43fe50 tempest-VolumesActionsTest-937364676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:42:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-47442dca-99dd-491c-8ca9-ae01ff43fe50 tempest-VolumesActionsTest-937364676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:42:46 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-47442dca-99dd-491c-8ca9-ae01ff43fe50 tempest-VolumesActionsTest-937364676 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:42:46 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-47442dca-99dd-491c-8ca9-ae01ff43fe50 tempest-VolumesActionsTest-937364676 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:42:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-47442dca-99dd-491c-8ca9-ae01ff43fe50 tempest-VolumesActionsTest-937364676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b2eee883-4515-4c2f-b2e0-8eff73e3f5c0 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:42:46 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-42c5d65c-2a21-448e-b9a4-adb4c821156e tempest-VolumesGetTest-2096456054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (beefad4a-9eab-44a8-a7d7-c441b05786cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e8cf73a-1c26-4899-9372-031fbed9ac02', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:42:46 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-42c5d65c-2a21-448e-b9a4-adb4c821156e tempest-VolumesGetTest-2096456054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73ce00d8-86b8-45b6-8f2f-ed1ed40c837a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:42:46 devstack sudo[99234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b2eee883-4515-4c2f-b2e0-8eff73e3f5c0 1073741824
Jul 09 14:42:46 devstack sudo[99234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:42:46 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-42c5d65c-2a21-448e-b9a4-adb4c821156e tempest-VolumesGetTest-2096456054 None] Volume volume-2e8cf73a-1c26-4899-9372-031fbed9ac02 (2e8cf73a-1c26-4899-9372-031fbed9ac02): created successfully
Jul 09 14:42:46 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-42c5d65c-2a21-448e-b9a4-adb4c821156e tempest-VolumesGetTest-2096456054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73ce00d8-86b8-45b6-8f2f-ed1ed40c837a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:42:46 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-42c5d65c-2a21-448e-b9a4-adb4c821156e tempest-VolumesGetTest-2096456054 None] Flow 'volume_create_manager' (65cbcade-517a-4193-a903-9d1cfa5de30a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:42:46 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-42c5d65c-2a21-448e-b9a4-adb4c821156e tempest-VolumesGetTest-2096456054 None] Created volume successfully.
Jul 09 14:42:47 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-20c61962-9a1a-498e-b064-1e7cb19d02a1 tempest-VolumesGetTest-2096456054 None] Acquiring lock "cinder-2e8cf73a-1c26-4899-9372-031fbed9ac02-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:42:47 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-20c61962-9a1a-498e-b064-1e7cb19d02a1 tempest-VolumesGetTest-2096456054 None] Lock "cinder-2e8cf73a-1c26-4899-9372-031fbed9ac02-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:42:47 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-20c61962-9a1a-498e-b064-1e7cb19d02a1 tempest-VolumesGetTest-2096456054 None] Acquiring lock "cinder-quobyte-2e8cf73a-1c26-4899-9372-031fbed9ac02" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:42:47 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-20c61962-9a1a-498e-b064-1e7cb19d02a1 tempest-VolumesGetTest-2096456054 None] Lock "cinder-quobyte-2e8cf73a-1c26-4899-9372-031fbed9ac02" acquired by "delete_volume" :: waited 0.016s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:42:47 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e065f2-ca7f-4529-9607-8ec82eeeb036]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:42:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-20c61962-9a1a-498e-b064-1e7cb19d02a1 tempest-VolumesGetTest-2096456054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2e8cf73a-1c26-4899-9372-031fbed9ac02 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:42:47 devstack sudo[99234]: pam_unix(sudo:session): session closed for user root
Jul 09 14:42:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-47442dca-99dd-491c-8ca9-ae01ff43fe50 tempest-VolumesActionsTest-937364676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b2eee883-4515-4c2f-b2e0-8eff73e3f5c0 1073741824" returned: 0 in 0.993s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:42:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-47442dca-99dd-491c-8ca9-ae01ff43fe50 tempest-VolumesActionsTest-937364676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b2eee883-4515-4c2f-b2e0-8eff73e3f5c0 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:42:47 devstack sudo[99241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b2eee883-4515-4c2f-b2e0-8eff73e3f5c0
Jul 09 14:42:47 devstack sudo[99241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:42:47 devstack sudo[99240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2e8cf73a-1c26-4899-9372-031fbed9ac02
Jul 09 14:42:47 devstack sudo[99240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:42:48 devstack sudo[99241]: pam_unix(sudo:session): session closed for user root
Jul 09 14:42:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-47442dca-99dd-491c-8ca9-ae01ff43fe50 tempest-VolumesActionsTest-937364676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b2eee883-4515-4c2f-b2e0-8eff73e3f5c0" returned: 0 in 0.717s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:42:48 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-47442dca-99dd-491c-8ca9-ae01ff43fe50 tempest-VolumesActionsTest-937364676 None] <== create_volume: return (1760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:42:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-47442dca-99dd-491c-8ca9-ae01ff43fe50 tempest-VolumesActionsTest-937364676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.763s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:42:48 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-47442dca-99dd-491c-8ca9-ae01ff43fe50 tempest-VolumesActionsTest-937364676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d24d780b-5f94-42db-abdb-cb02075d2ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2eee883-4515-4c2f-b2e0-8eff73e3f5c0', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:42:48 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-47442dca-99dd-491c-8ca9-ae01ff43fe50 tempest-VolumesActionsTest-937364676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f24f47d2-acb0-40fa-a1f6-5d83f30d2ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:42:48 devstack sudo[99240]: pam_unix(sudo:session): session closed for user root
Jul 09 14:42:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-20c61962-9a1a-498e-b064-1e7cb19d02a1 tempest-VolumesGetTest-2096456054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2e8cf73a-1c26-4899-9372-031fbed9ac02" returned: 0 in 0.831s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:42:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-20c61962-9a1a-498e-b064-1e7cb19d02a1 tempest-VolumesGetTest-2096456054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2e8cf73a-1c26-4899-9372-031fbed9ac02 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:42:48 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-47442dca-99dd-491c-8ca9-ae01ff43fe50 tempest-VolumesActionsTest-937364676 None] Volume volume-b2eee883-4515-4c2f-b2e0-8eff73e3f5c0 (b2eee883-4515-4c2f-b2e0-8eff73e3f5c0): created successfully
Jul 09 14:42:48 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-47442dca-99dd-491c-8ca9-ae01ff43fe50 tempest-VolumesActionsTest-937364676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f24f47d2-acb0-40fa-a1f6-5d83f30d2ed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:42:48 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-47442dca-99dd-491c-8ca9-ae01ff43fe50 tempest-VolumesActionsTest-937364676 None] Flow 'volume_create_manager' (cfde8c82-9638-4a4e-90d2-090165c20b33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:42:48 devstack sudo[99248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2e8cf73a-1c26-4899-9372-031fbed9ac02
Jul 09 14:42:48 devstack sudo[99248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:42:48 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-47442dca-99dd-491c-8ca9-ae01ff43fe50 tempest-VolumesActionsTest-937364676 None] Created volume successfully.
Jul 09 14:42:48 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f022f993-5ec6-4fc0-9d56-167086ac216c tempest-VolumesActionsTest-1951729172 None] Acquiring lock "cinder-b2eee883-4515-4c2f-b2e0-8eff73e3f5c0-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:42:48 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f022f993-5ec6-4fc0-9d56-167086ac216c tempest-VolumesActionsTest-1951729172 None] Lock "cinder-b2eee883-4515-4c2f-b2e0-8eff73e3f5c0-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:42:48 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f022f993-5ec6-4fc0-9d56-167086ac216c tempest-VolumesActionsTest-1951729172 None] Acquiring lock "cinder-quobyte-b2eee883-4515-4c2f-b2e0-8eff73e3f5c0" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:42:48 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f022f993-5ec6-4fc0-9d56-167086ac216c tempest-VolumesActionsTest-1951729172 None] Lock "cinder-quobyte-b2eee883-4515-4c2f-b2e0-8eff73e3f5c0" acquired by "delete_volume" :: waited 0.022s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:42:48 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d7b678-54ff-4eae-a662-bf43c43226a2]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:42:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f022f993-5ec6-4fc0-9d56-167086ac216c tempest-VolumesActionsTest-1951729172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b2eee883-4515-4c2f-b2e0-8eff73e3f5c0 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:42:48 devstack sudo[99250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b2eee883-4515-4c2f-b2e0-8eff73e3f5c0
Jul 09 14:42:48 devstack sudo[99250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:42:48 devstack sudo[99248]: pam_unix(sudo:session): session closed for user root
Jul 09 14:42:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-20c61962-9a1a-498e-b064-1e7cb19d02a1 tempest-VolumesGetTest-2096456054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2e8cf73a-1c26-4899-9372-031fbed9ac02" returned: 0 in 0.694s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:42:48 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-20c61962-9a1a-498e-b064-1e7cb19d02a1 tempest-VolumesGetTest-2096456054 None] Lock "cinder-quobyte-2e8cf73a-1c26-4899-9372-031fbed9ac02" released by "delete_volume" :: held 1.567s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:42:48 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-20c61962-9a1a-498e-b064-1e7cb19d02a1 tempest-VolumesGetTest-2096456054 None] Created reservations ['c9abc7fb-0ea6-4aa0-9622-527a3aab8839', '12309a91-d53a-4970-840d-1eacfae9d590', 'b31e4719-ea83-48a9-a2d3-4355d4c63762', 'ef1f2922-2724-42ae-98f5-46363cd13084'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:42:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-20c61962-9a1a-498e-b064-1e7cb19d02a1 tempest-VolumesGetTest-2096456054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:42:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-20c61962-9a1a-498e-b064-1e7cb19d02a1 tempest-VolumesGetTest-2096456054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:42:48 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-20c61962-9a1a-498e-b064-1e7cb19d02a1 tempest-VolumesGetTest-2096456054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:42:48 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-20c61962-9a1a-498e-b064-1e7cb19d02a1 tempest-VolumesGetTest-2096456054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:42:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-20c61962-9a1a-498e-b064-1e7cb19d02a1 tempest-VolumesGetTest-2096456054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:42:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-20c61962-9a1a-498e-b064-1e7cb19d02a1 tempest-VolumesGetTest-2096456054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:42:49 devstack sudo[99253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:42:49 devstack sudo[99253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:42:49 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-9e16a5fb-696b-407f-9244-a3ff005caea5 tempest-VolumesGetTest-2096456054 None] Acquiring lock "cinder-ce122690-9d74-455b-9e46-713809ccb4da-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:42:49 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-9e16a5fb-696b-407f-9244-a3ff005caea5 tempest-VolumesGetTest-2096456054 None] Lock "cinder-ce122690-9d74-455b-9e46-713809ccb4da-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:42:49 devstack sudo[99250]: pam_unix(sudo:session): session closed for user root
Jul 09 14:42:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f022f993-5ec6-4fc0-9d56-167086ac216c tempest-VolumesActionsTest-1951729172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b2eee883-4515-4c2f-b2e0-8eff73e3f5c0" returned: 0 in 1.106s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:42:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f022f993-5ec6-4fc0-9d56-167086ac216c tempest-VolumesActionsTest-1951729172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b2eee883-4515-4c2f-b2e0-8eff73e3f5c0 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:42:49 devstack sudo[99289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b2eee883-4515-4c2f-b2e0-8eff73e3f5c0
Jul 09 14:42:49 devstack sudo[99289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:42:49 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-9e16a5fb-696b-407f-9244-a3ff005caea5 tempest-VolumesGetTest-2096456054 None] Acquiring lock "cinder-quobyte-ce122690-9d74-455b-9e46-713809ccb4da" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:42:49 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-9e16a5fb-696b-407f-9244-a3ff005caea5 tempest-VolumesGetTest-2096456054 None] Lock "cinder-quobyte-ce122690-9d74-455b-9e46-713809ccb4da" acquired by "delete_volume" :: waited 0.036s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:42:49 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-03e67b61-f1a3-4e43-80c8-37cc746bbbb1 tempest-TestInstancesWithCinderVolumes-1507168999 None] Acquiring lock "cinder-2daa519b-cac8-4271-9ebc-dc62c34f83fb-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:42:49 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[0474a8a6-5601-454d-b9f5-0e8f6358338c]: (4, 'raw') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:42:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9e16a5fb-696b-407f-9244-a3ff005caea5 tempest-VolumesGetTest-2096456054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ce122690-9d74-455b-9e46-713809ccb4da {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:42:50 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-03e67b61-f1a3-4e43-80c8-37cc746bbbb1 tempest-TestInstancesWithCinderVolumes-1507168999 None] Lock "cinder-2daa519b-cac8-4271-9ebc-dc62c34f83fb-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:42:50 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-03e67b61-f1a3-4e43-80c8-37cc746bbbb1 tempest-TestInstancesWithCinderVolumes-1507168999 None] Acquiring lock "cinder-quobyte-2daa519b-cac8-4271-9ebc-dc62c34f83fb" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:42:50 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-03e67b61-f1a3-4e43-80c8-37cc746bbbb1 tempest-TestInstancesWithCinderVolumes-1507168999 None] Lock "cinder-quobyte-2daa519b-cac8-4271-9ebc-dc62c34f83fb" acquired by "delete_volume" :: waited 0.034s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:42:50 devstack sudo[99296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ce122690-9d74-455b-9e46-713809ccb4da
Jul 09 14:42:50 devstack sudo[99296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:42:50 devstack sudo[99253]: pam_unix(sudo:session): session closed for user root
Jul 09 14:42:50 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[335853d9-fc21-4328-816a-1496047f0a1d]: (4, 'raw') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:42:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-03e67b61-f1a3-4e43-80c8-37cc746bbbb1 tempest-TestInstancesWithCinderVolumes-1507168999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2daa519b-cac8-4271-9ebc-dc62c34f83fb {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:42:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-20c61962-9a1a-498e-b064-1e7cb19d02a1 tempest-VolumesGetTest-2096456054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 1.233s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:42:50 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-20c61962-9a1a-498e-b064-1e7cb19d02a1 tempest-VolumesGetTest-2096456054 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:42:50 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-20c61962-9a1a-498e-b064-1e7cb19d02a1 tempest-VolumesGetTest-2096456054 None] Deleted volume successfully.
Jul 09 14:42:50 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-20c61962-9a1a-498e-b064-1e7cb19d02a1 tempest-VolumesGetTest-2096456054 None] Lock "cinder-2e8cf73a-1c26-4899-9372-031fbed9ac02-delete_volume" released by "delete_volume" :: held 3.102s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:42:50 devstack sudo[99303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2daa519b-cac8-4271-9ebc-dc62c34f83fb
Jul 09 14:42:50 devstack sudo[99303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:42:50 devstack sudo[99289]: pam_unix(sudo:session): session closed for user root
Jul 09 14:42:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f022f993-5ec6-4fc0-9d56-167086ac216c tempest-VolumesActionsTest-1951729172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b2eee883-4515-4c2f-b2e0-8eff73e3f5c0" returned: 0 in 1.108s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:42:50 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f022f993-5ec6-4fc0-9d56-167086ac216c tempest-VolumesActionsTest-1951729172 None] Lock "cinder-quobyte-b2eee883-4515-4c2f-b2e0-8eff73e3f5c0" released by "delete_volume" :: held 2.275s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:42:50 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-f022f993-5ec6-4fc0-9d56-167086ac216c tempest-VolumesActionsTest-1951729172 None] Created reservations ['ec5575e4-95c2-42bd-bd53-fd4de561863c', '131d28a6-0017-4d5d-aef1-eefbec68fd08', 'c0dced2a-6140-41ad-aa1d-d2f92f6786af', 'b3d12512-b283-4d2e-ae2b-31aaed14a6e8'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:42:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f022f993-5ec6-4fc0-9d56-167086ac216c tempest-VolumesActionsTest-1951729172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:42:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f022f993-5ec6-4fc0-9d56-167086ac216c tempest-VolumesActionsTest-1951729172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:42:51 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f022f993-5ec6-4fc0-9d56-167086ac216c tempest-VolumesActionsTest-1951729172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:42:51 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f022f993-5ec6-4fc0-9d56-167086ac216c tempest-VolumesActionsTest-1951729172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:42:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f022f993-5ec6-4fc0-9d56-167086ac216c tempest-VolumesActionsTest-1951729172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:42:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f022f993-5ec6-4fc0-9d56-167086ac216c tempest-VolumesActionsTest-1951729172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:42:51 devstack sudo[99326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:42:51 devstack sudo[99326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:42:51 devstack sudo[99296]: pam_unix(sudo:session): session closed for user root
Jul 09 14:42:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9e16a5fb-696b-407f-9244-a3ff005caea5 tempest-VolumesGetTest-2096456054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ce122690-9d74-455b-9e46-713809ccb4da" returned: 0 in 1.146s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:42:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9e16a5fb-696b-407f-9244-a3ff005caea5 tempest-VolumesGetTest-2096456054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ce122690-9d74-455b-9e46-713809ccb4da {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:42:51 devstack sudo[99331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ce122690-9d74-455b-9e46-713809ccb4da
Jul 09 14:42:51 devstack sudo[99331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:42:51 devstack sudo[99303]: pam_unix(sudo:session): session closed for user root
Jul 09 14:42:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-03e67b61-f1a3-4e43-80c8-37cc746bbbb1 tempest-TestInstancesWithCinderVolumes-1507168999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2daa519b-cac8-4271-9ebc-dc62c34f83fb" returned: 0 in 1.173s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:42:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-03e67b61-f1a3-4e43-80c8-37cc746bbbb1 tempest-TestInstancesWithCinderVolumes-1507168999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2daa519b-cac8-4271-9ebc-dc62c34f83fb {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:42:51 devstack sudo[99343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2daa519b-cac8-4271-9ebc-dc62c34f83fb
Jul 09 14:42:51 devstack sudo[99343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:42:51 devstack sudo[99326]: pam_unix(sudo:session): session closed for user root
Jul 09 14:42:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f022f993-5ec6-4fc0-9d56-167086ac216c tempest-VolumesActionsTest-1951729172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.948s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:42:51 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-f022f993-5ec6-4fc0-9d56-167086ac216c tempest-VolumesActionsTest-1951729172 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:42:51 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-f022f993-5ec6-4fc0-9d56-167086ac216c tempest-VolumesActionsTest-1951729172 None] Deleted volume successfully.
Jul 09 14:42:52 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f022f993-5ec6-4fc0-9d56-167086ac216c tempest-VolumesActionsTest-1951729172 None] Lock "cinder-b2eee883-4515-4c2f-b2e0-8eff73e3f5c0-delete_volume" released by "delete_volume" :: held 3.520s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:42:52 devstack sudo[99331]: pam_unix(sudo:session): session closed for user root
Jul 09 14:42:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9e16a5fb-696b-407f-9244-a3ff005caea5 tempest-VolumesGetTest-2096456054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ce122690-9d74-455b-9e46-713809ccb4da" returned: 1 in 0.982s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:42:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9e16a5fb-696b-407f-9244-a3ff005caea5 tempest-VolumesGetTest-2096456054 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ce122690-9d74-455b-9e46-713809ccb4da' failed. Not Retrying. {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 09 14:42:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9e16a5fb-696b-407f-9244-a3ff005caea5 tempest-VolumesGetTest-2096456054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ce122690-9d74-455b-9e46-713809ccb4da {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:42:52 devstack sudo[99351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ce122690-9d74-455b-9e46-713809ccb4da
Jul 09 14:42:52 devstack sudo[99351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:42:52 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 14:42:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:42:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:42:52 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:42:52 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:42:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:42:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:42:52 devstack sudo[99343]: pam_unix(sudo:session): session closed for user root
Jul 09 14:42:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-03e67b61-f1a3-4e43-80c8-37cc746bbbb1 tempest-TestInstancesWithCinderVolumes-1507168999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2daa519b-cac8-4271-9ebc-dc62c34f83fb" returned: 1 in 1.073s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:42:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-03e67b61-f1a3-4e43-80c8-37cc746bbbb1 tempest-TestInstancesWithCinderVolumes-1507168999 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2daa519b-cac8-4271-9ebc-dc62c34f83fb' failed. Not Retrying. {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 09 14:42:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-03e67b61-f1a3-4e43-80c8-37cc746bbbb1 tempest-TestInstancesWithCinderVolumes-1507168999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2daa519b-cac8-4271-9ebc-dc62c34f83fb {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:42:52 devstack sudo[99356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:42:52 devstack sudo[99356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:42:52 devstack sudo[99357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2daa519b-cac8-4271-9ebc-dc62c34f83fb
Jul 09 14:42:52 devstack sudo[99357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:42:52 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a00ef3a-27df-4c22-90fe-9a211972b532 tempest-VolumesActionsTest-937364676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:42:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9a00ef3a-27df-4c22-90fe-9a211972b532 tempest-VolumesActionsTest-937364676 None] Flow 'volume_create_manager' (23951aec-9bcf-480f-a8f9-d3b4327f6ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:42:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9a00ef3a-27df-4c22-90fe-9a211972b532 tempest-VolumesActionsTest-937364676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (697c53c7-c920-4e0c-89bd-46f27c1ec8b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:42:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9a00ef3a-27df-4c22-90fe-9a211972b532 tempest-VolumesActionsTest-937364676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (697c53c7-c920-4e0c-89bd-46f27c1ec8b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:42:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-588020951',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7150d817-6e76-4f88-ac91-e53b2f97eda2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='522e7febd7b6499d9f39419cabe064ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:42:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:42:53Z,use_quota=True,user_id='3802808ebeb5450cb366087caef84fcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:42:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9a00ef3a-27df-4c22-90fe-9a211972b532 tempest-VolumesActionsTest-937364676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34778099-6a8e-4181-8f05-12249a3c5914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:42:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9a00ef3a-27df-4c22-90fe-9a211972b532 tempest-VolumesActionsTest-937364676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34778099-6a8e-4181-8f05-12249a3c5914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:42:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9a00ef3a-27df-4c22-90fe-9a211972b532 tempest-VolumesActionsTest-937364676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (988a253d-e4b4-498b-9fc0-79c3f7f6ecbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:42:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9a00ef3a-27df-4c22-90fe-9a211972b532 tempest-VolumesActionsTest-937364676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (988a253d-e4b4-498b-9fc0-79c3f7f6ecbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7150d817-6e76-4f88-ac91-e53b2f97eda2', 'volume_name': 'volume-7150d817-6e76-4f88-ac91-e53b2f97eda2', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:42:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9a00ef3a-27df-4c22-90fe-9a211972b532 tempest-VolumesActionsTest-937364676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3735264f-22a1-43f2-a636-5d7b0aacb7e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:42:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9a00ef3a-27df-4c22-90fe-9a211972b532 tempest-VolumesActionsTest-937364676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3735264f-22a1-43f2-a636-5d7b0aacb7e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:42:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9a00ef3a-27df-4c22-90fe-9a211972b532 tempest-VolumesActionsTest-937364676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7faef2d7-7f48-4127-8036-b85088b225f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:42:53 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-9a00ef3a-27df-4c22-90fe-9a211972b532 tempest-VolumesActionsTest-937364676 None] Volume 7150d817-6e76-4f88-ac91-e53b2f97eda2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7150d817-6e76-4f88-ac91-e53b2f97eda2', 'volume_size': 1}
Jul 09 14:42:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9a00ef3a-27df-4c22-90fe-9a211972b532 tempest-VolumesActionsTest-937364676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:42:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9a00ef3a-27df-4c22-90fe-9a211972b532 tempest-VolumesActionsTest-937364676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:42:53 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9a00ef3a-27df-4c22-90fe-9a211972b532 tempest-VolumesActionsTest-937364676 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:42:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-588020951',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7150d817-6e76-4f88-ac91-e53b2f97eda2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='522e7febd7b6499d9f39419cabe064ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:42:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:42:53Z,use_quota=True,user_id='3802808ebeb5450cb366087caef84fcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:42:53 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-9a00ef3a-27df-4c22-90fe-9a211972b532 tempest-VolumesActionsTest-937364676 None] Creating volume 7150d817-6e76-4f88-ac91-e53b2f97eda2 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:42:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9a00ef3a-27df-4c22-90fe-9a211972b532 tempest-VolumesActionsTest-937364676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:42:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9a00ef3a-27df-4c22-90fe-9a211972b532 tempest-VolumesActionsTest-937364676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:42:53 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9a00ef3a-27df-4c22-90fe-9a211972b532 tempest-VolumesActionsTest-937364676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:42:53 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9a00ef3a-27df-4c22-90fe-9a211972b532 tempest-VolumesActionsTest-937364676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:42:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9a00ef3a-27df-4c22-90fe-9a211972b532 tempest-VolumesActionsTest-937364676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:42:53 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9a00ef3a-27df-4c22-90fe-9a211972b532 tempest-VolumesActionsTest-937364676 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:42:53 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-9a00ef3a-27df-4c22-90fe-9a211972b532 tempest-VolumesActionsTest-937364676 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:42:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9a00ef3a-27df-4c22-90fe-9a211972b532 tempest-VolumesActionsTest-937364676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7150d817-6e76-4f88-ac91-e53b2f97eda2 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:42:53 devstack sudo[99361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7150d817-6e76-4f88-ac91-e53b2f97eda2 1073741824
Jul 09 14:42:53 devstack sudo[99361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:42:53 devstack sudo[99351]: pam_unix(sudo:session): session closed for user root
Jul 09 14:42:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9e16a5fb-696b-407f-9244-a3ff005caea5 tempest-VolumesGetTest-2096456054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ce122690-9d74-455b-9e46-713809ccb4da" returned: 0 in 1.394s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:42:53 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-9e16a5fb-696b-407f-9244-a3ff005caea5 tempest-VolumesGetTest-2096456054 None] Lock "cinder-quobyte-ce122690-9d74-455b-9e46-713809ccb4da" released by "delete_volume" :: held 3.666s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:42:53 devstack sudo[99357]: pam_unix(sudo:session): session closed for user root
Jul 09 14:42:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-03e67b61-f1a3-4e43-80c8-37cc746bbbb1 tempest-TestInstancesWithCinderVolumes-1507168999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2daa519b-cac8-4271-9ebc-dc62c34f83fb" returned: 0 in 1.199s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:42:53 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-03e67b61-f1a3-4e43-80c8-37cc746bbbb1 tempest-TestInstancesWithCinderVolumes-1507168999 None] Lock "cinder-quobyte-2daa519b-cac8-4271-9ebc-dc62c34f83fb" released by "delete_volume" :: held 3.579s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:42:53 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-9e16a5fb-696b-407f-9244-a3ff005caea5 tempest-VolumesGetTest-2096456054 None] Created reservations ['0aaada95-5d24-4502-99fa-a780c09efa64', '3203a24e-2679-489c-a55b-b7bbc65afb61', '6d742869-0eb4-4095-a72f-a644e1ba7492', 'e22ae571-96eb-4e55-864c-2bc629535522'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:42:53 devstack cinder-volume[87230]: WARNING cinder.quota [None req-03e67b61-f1a3-4e43-80c8-37cc746bbbb1 tempest-TestInstancesWithCinderVolumes-1507168999 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-198821352-1195275830 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-198821352-1195275830, it is now deprecated. Please use the default quota class for default quota.
Jul 09 14:42:53 devstack cinder-volume[87230]: WARNING cinder.quota [None req-03e67b61-f1a3-4e43-80c8-37cc746bbbb1 tempest-TestInstancesWithCinderVolumes-1507168999 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-198821352-1195275830 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-198821352-1195275830, it is now deprecated. Please use the default quota class for default quota.
Jul 09 14:42:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9e16a5fb-696b-407f-9244-a3ff005caea5 tempest-VolumesGetTest-2096456054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:42:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9e16a5fb-696b-407f-9244-a3ff005caea5 tempest-VolumesGetTest-2096456054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:42:53 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9e16a5fb-696b-407f-9244-a3ff005caea5 tempest-VolumesGetTest-2096456054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:42:53 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9e16a5fb-696b-407f-9244-a3ff005caea5 tempest-VolumesGetTest-2096456054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:42:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9e16a5fb-696b-407f-9244-a3ff005caea5 tempest-VolumesGetTest-2096456054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:42:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9e16a5fb-696b-407f-9244-a3ff005caea5 tempest-VolumesGetTest-2096456054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:42:53 devstack sudo[99356]: pam_unix(sudo:session): session closed for user root
Jul 09 14:42:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 1.429s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:42:53 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:42:53 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Running periodic task VolumeManager._thread_info {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 14:42:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] thread count: 28 {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 09 14:42:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] thread info: [<_MainThread(MainThread, started 125388812103808)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125388713797504)>, <Thread(Thread-3 (stat_writer), started daemon 125388699995392)>, <Thread(Rabbit-heartbeat, started daemon 125388700522560)>, <Thread(Thread-5 (_runner), started daemon 125388698545216)>, <Thread(Thread-7 (_runner), started daemon 125388698611264)>, <Thread(fd_logger, started daemon 125388703020672)>, <Thread(privsep_reader, started daemon 125388696441088)>, <Thread(tpool_thread_0, started daemon 125388687943360)>, <Thread(tpool_thread_1, started daemon 125388679550656)>, <Thread(tpool_thread_2, started daemon 125388671141568)>, <Thread(tpool_thread_3, started daemon 125388662732480)>, <Thread(tpool_thread_4, started daemon 125388654323392)>, <Thread(tpool_thread_5, started daemon 125388645914304)>, <Thread(tpool_thread_6, started daemon 125388637505216)>, <Thread(tpool_thread_7, started daemon 125388629096128)>, <Thread(tpool_thread_8, started daemon 125388620687040)>, <Thread(tpool_thread_9, started daemon 125388612277952)>, <Thread(tpool_thread_10, started daemon 125388603868864)>, <Thread(tpool_thread_11, started daemon 125388595459776)>, <Thread(tpool_thread_12, started daemon 125388587050688)>, <Thread(tpool_thread_13, started daemon 125388578641600)>, <Thread(tpool_thread_14, started daemon 125388570232512)>, <Thread(tpool_thread_15, started daemon 125388561823424)>, <Thread(tpool_thread_16, started daemon 125388553414336)>, <Thread(tpool_thread_17, started daemon 125388545005248)>, <Thread(tpool_thread_18, started daemon 125388536596160)>, <Thread(tpool_thread_19, started daemon 125388528187072)>] {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 09 14:42:53 devstack sudo[99366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:42:53 devstack sudo[99366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:42:53 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-03e67b61-f1a3-4e43-80c8-37cc746bbbb1 tempest-TestInstancesWithCinderVolumes-1507168999 None] Created reservations ['c73949c0-be69-4524-b6d7-d40dae3301cb', '79626993-f784-4383-937c-17023b8b11fd', 'fceeb639-2eee-41b1-a961-dd95e116e0c0', 'bdd2eec0-7ca7-4fba-8e22-ecda00b4c369'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:42:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-03e67b61-f1a3-4e43-80c8-37cc746bbbb1 tempest-TestInstancesWithCinderVolumes-1507168999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:42:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-03e67b61-f1a3-4e43-80c8-37cc746bbbb1 tempest-TestInstancesWithCinderVolumes-1507168999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:42:54 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-03e67b61-f1a3-4e43-80c8-37cc746bbbb1 tempest-TestInstancesWithCinderVolumes-1507168999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:42:54 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-03e67b61-f1a3-4e43-80c8-37cc746bbbb1 tempest-TestInstancesWithCinderVolumes-1507168999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:42:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-03e67b61-f1a3-4e43-80c8-37cc746bbbb1 tempest-TestInstancesWithCinderVolumes-1507168999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:42:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-03e67b61-f1a3-4e43-80c8-37cc746bbbb1 tempest-TestInstancesWithCinderVolumes-1507168999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:42:54 devstack sudo[99368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:42:54 devstack sudo[99368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:42:54 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-82ba3205-f560-42ce-870a-48256332638e tempest-VolumesActionsTest-1906998927 None] Acquiring lock "cinder-9c94308d-f5c8-4a1c-9fd3-eedf373f1b20" by "attach_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:42:54 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-82ba3205-f560-42ce-870a-48256332638e tempest-VolumesActionsTest-1906998927 None] Lock "cinder-9c94308d-f5c8-4a1c-9fd3-eedf373f1b20" acquired by "attach_volume" :: waited 0.037s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:42:54 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-82ba3205-f560-42ce-870a-48256332638e tempest-VolumesActionsTest-1906998927 None] Attaching volume 9c94308d-f5c8-4a1c-9fd3-eedf373f1b20 to instance bead28a5-6535-43ae-9a03-71a6dbdf16b6 at mountpoint /dev/vdb on host None.
Jul 09 14:42:54 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-82ba3205-f560-42ce-870a-48256332638e tempest-VolumesActionsTest-1906998927 None] Attach volume completed successfully.
Jul 09 14:42:54 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-82ba3205-f560-42ce-870a-48256332638e tempest-VolumesActionsTest-1906998927 None] Lock "cinder-9c94308d-f5c8-4a1c-9fd3-eedf373f1b20" released by "attach_volume" :: held 0.285s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:42:55 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-5e8e134a-ed6a-46ff-aa6f-bb905f3afedc tempest-VolumesActionsTest-1906998927 None] Acquiring lock "cinder-9c94308d-f5c8-4a1c-9fd3-eedf373f1b20-detach_volume" by "detach_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:42:55 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-5e8e134a-ed6a-46ff-aa6f-bb905f3afedc tempest-VolumesActionsTest-1906998927 None] Lock "cinder-9c94308d-f5c8-4a1c-9fd3-eedf373f1b20-detach_volume" acquired by "detach_volume" :: waited 0.043s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:42:55 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-5e8e134a-ed6a-46ff-aa6f-bb905f3afedc tempest-VolumesActionsTest-1906998927 None] Detaching volume 9c94308d-f5c8-4a1c-9fd3-eedf373f1b20 from instance bead28a5-6535-43ae-9a03-71a6dbdf16b6.
Jul 09 14:42:55 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-5e8e134a-ed6a-46ff-aa6f-bb905f3afedc tempest-VolumesActionsTest-1906998927 None] Detach volume completed successfully.
Jul 09 14:42:55 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-5e8e134a-ed6a-46ff-aa6f-bb905f3afedc tempest-VolumesActionsTest-1906998927 None] Lock "cinder-9c94308d-f5c8-4a1c-9fd3-eedf373f1b20-detach_volume" released by "detach_volume" :: held 0.160s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:42:55 devstack sudo[99366]: pam_unix(sudo:session): session closed for user root
Jul 09 14:42:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9e16a5fb-696b-407f-9244-a3ff005caea5 tempest-VolumesGetTest-2096456054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 1.520s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:42:55 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-9e16a5fb-696b-407f-9244-a3ff005caea5 tempest-VolumesGetTest-2096456054 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:42:55 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-9e16a5fb-696b-407f-9244-a3ff005caea5 tempest-VolumesGetTest-2096456054 None] Deleted volume successfully.
Jul 09 14:42:55 devstack sudo[99361]: pam_unix(sudo:session): session closed for user root
Jul 09 14:42:55 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-9e16a5fb-696b-407f-9244-a3ff005caea5 tempest-VolumesGetTest-2096456054 None] Lock "cinder-ce122690-9d74-455b-9e46-713809ccb4da-delete_volume" released by "delete_volume" :: held 5.715s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:42:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9a00ef3a-27df-4c22-90fe-9a211972b532 tempest-VolumesActionsTest-937364676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7150d817-6e76-4f88-ac91-e53b2f97eda2 1073741824" returned: 0 in 2.279s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:42:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9a00ef3a-27df-4c22-90fe-9a211972b532 tempest-VolumesActionsTest-937364676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7150d817-6e76-4f88-ac91-e53b2f97eda2 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:42:55 devstack sudo[99388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7150d817-6e76-4f88-ac91-e53b2f97eda2
Jul 09 14:42:55 devstack sudo[99388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:42:55 devstack sudo[99368]: pam_unix(sudo:session): session closed for user root
Jul 09 14:42:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-03e67b61-f1a3-4e43-80c8-37cc746bbbb1 tempest-TestInstancesWithCinderVolumes-1507168999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 1.624s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:42:55 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-03e67b61-f1a3-4e43-80c8-37cc746bbbb1 tempest-TestInstancesWithCinderVolumes-1507168999 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:42:55 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-03e67b61-f1a3-4e43-80c8-37cc746bbbb1 tempest-TestInstancesWithCinderVolumes-1507168999 None] Deleted volume successfully.
Jul 09 14:42:55 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-03e67b61-f1a3-4e43-80c8-37cc746bbbb1 tempest-TestInstancesWithCinderVolumes-1507168999 None] Lock "cinder-2daa519b-cac8-4271-9ebc-dc62c34f83fb-delete_volume" released by "delete_volume" :: held 5.758s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:42:56 devstack sudo[99388]: pam_unix(sudo:session): session closed for user root
Jul 09 14:42:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9a00ef3a-27df-4c22-90fe-9a211972b532 tempest-VolumesActionsTest-937364676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7150d817-6e76-4f88-ac91-e53b2f97eda2" returned: 0 in 1.148s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:42:56 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9a00ef3a-27df-4c22-90fe-9a211972b532 tempest-VolumesActionsTest-937364676 None] <== create_volume: return (3514ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:42:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9a00ef3a-27df-4c22-90fe-9a211972b532 tempest-VolumesActionsTest-937364676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.517s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:42:56 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9a00ef3a-27df-4c22-90fe-9a211972b532 tempest-VolumesActionsTest-937364676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7faef2d7-7f48-4127-8036-b85088b225f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7150d817-6e76-4f88-ac91-e53b2f97eda2', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:42:56 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9a00ef3a-27df-4c22-90fe-9a211972b532 tempest-VolumesActionsTest-937364676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7d347ed-1a13-40c0-ae6e-68b41f458790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:42:56 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-9a00ef3a-27df-4c22-90fe-9a211972b532 tempest-VolumesActionsTest-937364676 None] Volume volume-7150d817-6e76-4f88-ac91-e53b2f97eda2 (7150d817-6e76-4f88-ac91-e53b2f97eda2): created successfully
Jul 09 14:42:56 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9a00ef3a-27df-4c22-90fe-9a211972b532 tempest-VolumesActionsTest-937364676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7d347ed-1a13-40c0-ae6e-68b41f458790) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:42:56 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9a00ef3a-27df-4c22-90fe-9a211972b532 tempest-VolumesActionsTest-937364676 None] Flow 'volume_create_manager' (23951aec-9bcf-480f-a8f9-d3b4327f6ea0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:42:56 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-9a00ef3a-27df-4c22-90fe-9a211972b532 tempest-VolumesActionsTest-937364676 None] Created volume successfully.
Jul 09 14:42:57 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-0708c5c7-b85b-47a1-8e50-19e2088a953f tempest-VolumesActionsTest-1951729172 None] Acquiring lock "cinder-7150d817-6e76-4f88-ac91-e53b2f97eda2-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:42:57 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-0708c5c7-b85b-47a1-8e50-19e2088a953f tempest-VolumesActionsTest-1951729172 None] Lock "cinder-7150d817-6e76-4f88-ac91-e53b2f97eda2-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:42:57 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-0708c5c7-b85b-47a1-8e50-19e2088a953f tempest-VolumesActionsTest-1951729172 None] Acquiring lock "cinder-quobyte-7150d817-6e76-4f88-ac91-e53b2f97eda2" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:42:57 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-0708c5c7-b85b-47a1-8e50-19e2088a953f tempest-VolumesActionsTest-1951729172 None] Lock "cinder-quobyte-7150d817-6e76-4f88-ac91-e53b2f97eda2" acquired by "delete_volume" :: waited 0.019s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:42:57 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ce74f6-d99a-4e6a-8c48-e731364291ff]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:42:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0708c5c7-b85b-47a1-8e50-19e2088a953f tempest-VolumesActionsTest-1951729172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7150d817-6e76-4f88-ac91-e53b2f97eda2 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:42:58 devstack sudo[99397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7150d817-6e76-4f88-ac91-e53b2f97eda2
Jul 09 14:42:58 devstack sudo[99397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:42:59 devstack sudo[99397]: pam_unix(sudo:session): session closed for user root
Jul 09 14:42:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0708c5c7-b85b-47a1-8e50-19e2088a953f tempest-VolumesActionsTest-1951729172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7150d817-6e76-4f88-ac91-e53b2f97eda2" returned: 0 in 1.275s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:42:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0708c5c7-b85b-47a1-8e50-19e2088a953f tempest-VolumesActionsTest-1951729172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7150d817-6e76-4f88-ac91-e53b2f97eda2 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:42:59 devstack sudo[99418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7150d817-6e76-4f88-ac91-e53b2f97eda2
Jul 09 14:42:59 devstack sudo[99418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:43:00 devstack sudo[99418]: pam_unix(sudo:session): session closed for user root
Jul 09 14:43:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0708c5c7-b85b-47a1-8e50-19e2088a953f tempest-VolumesActionsTest-1951729172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7150d817-6e76-4f88-ac91-e53b2f97eda2" returned: 0 in 0.913s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:43:00 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-0708c5c7-b85b-47a1-8e50-19e2088a953f tempest-VolumesActionsTest-1951729172 None] Lock "cinder-quobyte-7150d817-6e76-4f88-ac91-e53b2f97eda2" released by "delete_volume" :: held 2.282s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:43:00 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-0708c5c7-b85b-47a1-8e50-19e2088a953f tempest-VolumesActionsTest-1951729172 None] Created reservations ['902bc894-663d-4ace-bebf-4232132d9e82', '7062274f-001f-42b0-ada2-c8bcc15d22d6', 'ceb8e112-692b-44a7-994c-d5ebae96a717', '8b82e753-4887-4782-904e-e2039088d456'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:43:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0708c5c7-b85b-47a1-8e50-19e2088a953f tempest-VolumesActionsTest-1951729172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:43:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0708c5c7-b85b-47a1-8e50-19e2088a953f tempest-VolumesActionsTest-1951729172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:43:00 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-0708c5c7-b85b-47a1-8e50-19e2088a953f tempest-VolumesActionsTest-1951729172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:43:00 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-0708c5c7-b85b-47a1-8e50-19e2088a953f tempest-VolumesActionsTest-1951729172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:43:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0708c5c7-b85b-47a1-8e50-19e2088a953f tempest-VolumesActionsTest-1951729172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:43:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0708c5c7-b85b-47a1-8e50-19e2088a953f tempest-VolumesActionsTest-1951729172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:43:00 devstack sudo[99425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:43:00 devstack sudo[99425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:43:01 devstack sudo[99425]: pam_unix(sudo:session): session closed for user root
Jul 09 14:43:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0708c5c7-b85b-47a1-8e50-19e2088a953f tempest-VolumesActionsTest-1951729172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.817s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:43:01 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-0708c5c7-b85b-47a1-8e50-19e2088a953f tempest-VolumesActionsTest-1951729172 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:43:01 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-0708c5c7-b85b-47a1-8e50-19e2088a953f tempest-VolumesActionsTest-1951729172 None] Deleted volume successfully.
Jul 09 14:43:01 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-0708c5c7-b85b-47a1-8e50-19e2088a953f tempest-VolumesActionsTest-1951729172 None] Lock "cinder-7150d817-6e76-4f88-ac91-e53b2f97eda2-delete_volume" released by "delete_volume" :: held 3.432s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:43:02 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-68aacd8f-4f00-4560-8f33-06fe8a98a2ed tempest-VolumesActionsTest-937364676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:43:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-68aacd8f-4f00-4560-8f33-06fe8a98a2ed tempest-VolumesActionsTest-937364676 None] Flow 'volume_create_manager' (f75f38f2-ac06-4eab-a7c9-c4af5469c9f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:43:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-68aacd8f-4f00-4560-8f33-06fe8a98a2ed tempest-VolumesActionsTest-937364676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06c8afa1-2eed-4a3b-ad65-5ff82992e658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:43:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-68aacd8f-4f00-4560-8f33-06fe8a98a2ed tempest-VolumesActionsTest-937364676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06c8afa1-2eed-4a3b-ad65-5ff82992e658) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:43:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1242591024',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eddb624e-2c6c-440c-a2e4-24d0f2bdbbf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='522e7febd7b6499d9f39419cabe064ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:43:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:43:02Z,use_quota=True,user_id='3802808ebeb5450cb366087caef84fcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:43:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-68aacd8f-4f00-4560-8f33-06fe8a98a2ed tempest-VolumesActionsTest-937364676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af6698eb-0e9b-4f01-8f3e-0acf680a7d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:43:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-68aacd8f-4f00-4560-8f33-06fe8a98a2ed tempest-VolumesActionsTest-937364676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af6698eb-0e9b-4f01-8f3e-0acf680a7d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:43:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-68aacd8f-4f00-4560-8f33-06fe8a98a2ed tempest-VolumesActionsTest-937364676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ffbd44f-2119-4cc1-9a3a-ead8b1aa99db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:43:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-68aacd8f-4f00-4560-8f33-06fe8a98a2ed tempest-VolumesActionsTest-937364676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ffbd44f-2119-4cc1-9a3a-ead8b1aa99db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eddb624e-2c6c-440c-a2e4-24d0f2bdbbf3', 'volume_name': 'volume-eddb624e-2c6c-440c-a2e4-24d0f2bdbbf3', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:43:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-68aacd8f-4f00-4560-8f33-06fe8a98a2ed tempest-VolumesActionsTest-937364676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09e7775d-efed-4c70-b40d-fdf66ad7b6ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:43:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-68aacd8f-4f00-4560-8f33-06fe8a98a2ed tempest-VolumesActionsTest-937364676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09e7775d-efed-4c70-b40d-fdf66ad7b6ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:43:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-68aacd8f-4f00-4560-8f33-06fe8a98a2ed tempest-VolumesActionsTest-937364676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3040c50-715c-4222-b896-575ccd8c8d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:43:02 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-68aacd8f-4f00-4560-8f33-06fe8a98a2ed tempest-VolumesActionsTest-937364676 None] Volume eddb624e-2c6c-440c-a2e4-24d0f2bdbbf3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eddb624e-2c6c-440c-a2e4-24d0f2bdbbf3', 'volume_size': 1}
Jul 09 14:43:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-68aacd8f-4f00-4560-8f33-06fe8a98a2ed tempest-VolumesActionsTest-937364676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:43:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-68aacd8f-4f00-4560-8f33-06fe8a98a2ed tempest-VolumesActionsTest-937364676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:43:02 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-68aacd8f-4f00-4560-8f33-06fe8a98a2ed tempest-VolumesActionsTest-937364676 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:43:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1242591024',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eddb624e-2c6c-440c-a2e4-24d0f2bdbbf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='522e7febd7b6499d9f39419cabe064ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:43:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:43:02Z,use_quota=True,user_id='3802808ebeb5450cb366087caef84fcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:43:02 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-68aacd8f-4f00-4560-8f33-06fe8a98a2ed tempest-VolumesActionsTest-937364676 None] Creating volume eddb624e-2c6c-440c-a2e4-24d0f2bdbbf3 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:43:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-68aacd8f-4f00-4560-8f33-06fe8a98a2ed tempest-VolumesActionsTest-937364676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:43:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-68aacd8f-4f00-4560-8f33-06fe8a98a2ed tempest-VolumesActionsTest-937364676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:43:02 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-68aacd8f-4f00-4560-8f33-06fe8a98a2ed tempest-VolumesActionsTest-937364676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:43:02 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-68aacd8f-4f00-4560-8f33-06fe8a98a2ed tempest-VolumesActionsTest-937364676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:43:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-68aacd8f-4f00-4560-8f33-06fe8a98a2ed tempest-VolumesActionsTest-937364676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:43:02 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-68aacd8f-4f00-4560-8f33-06fe8a98a2ed tempest-VolumesActionsTest-937364676 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:43:02 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-68aacd8f-4f00-4560-8f33-06fe8a98a2ed tempest-VolumesActionsTest-937364676 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:43:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-68aacd8f-4f00-4560-8f33-06fe8a98a2ed tempest-VolumesActionsTest-937364676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-eddb624e-2c6c-440c-a2e4-24d0f2bdbbf3 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:43:02 devstack sudo[99428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-eddb624e-2c6c-440c-a2e4-24d0f2bdbbf3 1073741824
Jul 09 14:43:02 devstack sudo[99428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:43:03 devstack sudo[99428]: pam_unix(sudo:session): session closed for user root
Jul 09 14:43:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-68aacd8f-4f00-4560-8f33-06fe8a98a2ed tempest-VolumesActionsTest-937364676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-eddb624e-2c6c-440c-a2e4-24d0f2bdbbf3 1073741824" returned: 0 in 1.262s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:43:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-68aacd8f-4f00-4560-8f33-06fe8a98a2ed tempest-VolumesActionsTest-937364676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-eddb624e-2c6c-440c-a2e4-24d0f2bdbbf3 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:43:03 devstack sudo[99436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-eddb624e-2c6c-440c-a2e4-24d0f2bdbbf3
Jul 09 14:43:03 devstack sudo[99436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:43:03 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4a2a034-d738-4c30-bbe2-883b62fc8feb tempest-CreateVolumesFromSnapshotTest-1270352026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:43:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a4a2a034-d738-4c30-bbe2-883b62fc8feb tempest-CreateVolumesFromSnapshotTest-1270352026 None] Flow 'volume_create_manager' (132cac43-e88c-4f27-abeb-984261891bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:43:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a4a2a034-d738-4c30-bbe2-883b62fc8feb tempest-CreateVolumesFromSnapshotTest-1270352026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63f53f80-4fd7-4bcd-ad87-7dece25e8939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:43:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a4a2a034-d738-4c30-bbe2-883b62fc8feb tempest-CreateVolumesFromSnapshotTest-1270352026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63f53f80-4fd7-4bcd-ad87-7dece25e8939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:43:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1906389821',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0368cc57-b3a4-4022-8890-ebb1d9b3e014,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcc84d3f22f74b258ac93ff6f3f8eb32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:43:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:43:04Z,use_quota=True,user_id='7b7e2ba8b4d44a71951bae570658fa00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:43:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a4a2a034-d738-4c30-bbe2-883b62fc8feb tempest-CreateVolumesFromSnapshotTest-1270352026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (030a376f-01c1-4b20-97d2-f6a5ad0618cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:43:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a4a2a034-d738-4c30-bbe2-883b62fc8feb tempest-CreateVolumesFromSnapshotTest-1270352026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (030a376f-01c1-4b20-97d2-f6a5ad0618cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:43:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a4a2a034-d738-4c30-bbe2-883b62fc8feb tempest-CreateVolumesFromSnapshotTest-1270352026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53019ba4-484e-4e35-9a7f-00b5b46bc1ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:43:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a4a2a034-d738-4c30-bbe2-883b62fc8feb tempest-CreateVolumesFromSnapshotTest-1270352026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53019ba4-484e-4e35-9a7f-00b5b46bc1ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0368cc57-b3a4-4022-8890-ebb1d9b3e014', 'volume_name': 'volume-0368cc57-b3a4-4022-8890-ebb1d9b3e014', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:43:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a4a2a034-d738-4c30-bbe2-883b62fc8feb tempest-CreateVolumesFromSnapshotTest-1270352026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f25b4c63-b527-4f40-af34-0344eb44d243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:43:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a4a2a034-d738-4c30-bbe2-883b62fc8feb tempest-CreateVolumesFromSnapshotTest-1270352026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f25b4c63-b527-4f40-af34-0344eb44d243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:43:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a4a2a034-d738-4c30-bbe2-883b62fc8feb tempest-CreateVolumesFromSnapshotTest-1270352026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b441ea6-abe8-4645-8e7a-e4ef9197c0c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:43:03 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-a4a2a034-d738-4c30-bbe2-883b62fc8feb tempest-CreateVolumesFromSnapshotTest-1270352026 None] Volume 0368cc57-b3a4-4022-8890-ebb1d9b3e014: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0368cc57-b3a4-4022-8890-ebb1d9b3e014', 'volume_size': 1}
Jul 09 14:43:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a4a2a034-d738-4c30-bbe2-883b62fc8feb tempest-CreateVolumesFromSnapshotTest-1270352026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:43:04 devstack sudo[99436]: pam_unix(sudo:session): session closed for user root
Jul 09 14:43:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-68aacd8f-4f00-4560-8f33-06fe8a98a2ed tempest-VolumesActionsTest-937364676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-eddb624e-2c6c-440c-a2e4-24d0f2bdbbf3" returned: 0 in 0.706s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:43:04 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-68aacd8f-4f00-4560-8f33-06fe8a98a2ed tempest-VolumesActionsTest-937364676 None] <== create_volume: return (2031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:43:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-68aacd8f-4f00-4560-8f33-06fe8a98a2ed tempest-VolumesActionsTest-937364676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.033s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:43:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a4a2a034-d738-4c30-bbe2-883b62fc8feb tempest-CreateVolumesFromSnapshotTest-1270352026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.475s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:43:04 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a4a2a034-d738-4c30-bbe2-883b62fc8feb tempest-CreateVolumesFromSnapshotTest-1270352026 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:43:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1906389821',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0368cc57-b3a4-4022-8890-ebb1d9b3e014,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcc84d3f22f74b258ac93ff6f3f8eb32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:43:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:43:04Z,use_quota=True,user_id='7b7e2ba8b4d44a71951bae570658fa00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:43:04 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-a4a2a034-d738-4c30-bbe2-883b62fc8feb tempest-CreateVolumesFromSnapshotTest-1270352026 None] Creating volume 0368cc57-b3a4-4022-8890-ebb1d9b3e014 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:43:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a4a2a034-d738-4c30-bbe2-883b62fc8feb tempest-CreateVolumesFromSnapshotTest-1270352026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:43:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a4a2a034-d738-4c30-bbe2-883b62fc8feb tempest-CreateVolumesFromSnapshotTest-1270352026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:43:04 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a4a2a034-d738-4c30-bbe2-883b62fc8feb tempest-CreateVolumesFromSnapshotTest-1270352026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:43:04 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a4a2a034-d738-4c30-bbe2-883b62fc8feb tempest-CreateVolumesFromSnapshotTest-1270352026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:43:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a4a2a034-d738-4c30-bbe2-883b62fc8feb tempest-CreateVolumesFromSnapshotTest-1270352026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:43:04 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a4a2a034-d738-4c30-bbe2-883b62fc8feb tempest-CreateVolumesFromSnapshotTest-1270352026 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:43:04 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-a4a2a034-d738-4c30-bbe2-883b62fc8feb tempest-CreateVolumesFromSnapshotTest-1270352026 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:43:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a4a2a034-d738-4c30-bbe2-883b62fc8feb tempest-CreateVolumesFromSnapshotTest-1270352026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0368cc57-b3a4-4022-8890-ebb1d9b3e014 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:43:04 devstack sudo[99439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0368cc57-b3a4-4022-8890-ebb1d9b3e014 1073741824
Jul 09 14:43:04 devstack sudo[99439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:43:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-68aacd8f-4f00-4560-8f33-06fe8a98a2ed tempest-VolumesActionsTest-937364676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3040c50-715c-4222-b896-575ccd8c8d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eddb624e-2c6c-440c-a2e4-24d0f2bdbbf3', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:43:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-68aacd8f-4f00-4560-8f33-06fe8a98a2ed tempest-VolumesActionsTest-937364676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20cb60d9-9aa1-4d69-9443-a5709e6e3c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:43:04 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-68aacd8f-4f00-4560-8f33-06fe8a98a2ed tempest-VolumesActionsTest-937364676 None] Volume volume-eddb624e-2c6c-440c-a2e4-24d0f2bdbbf3 (eddb624e-2c6c-440c-a2e4-24d0f2bdbbf3): created successfully
Jul 09 14:43:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-68aacd8f-4f00-4560-8f33-06fe8a98a2ed tempest-VolumesActionsTest-937364676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20cb60d9-9aa1-4d69-9443-a5709e6e3c38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:43:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-68aacd8f-4f00-4560-8f33-06fe8a98a2ed tempest-VolumesActionsTest-937364676 None] Flow 'volume_create_manager' (f75f38f2-ac06-4eab-a7c9-c4af5469c9f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:43:04 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-68aacd8f-4f00-4560-8f33-06fe8a98a2ed tempest-VolumesActionsTest-937364676 None] Created volume successfully.
Jul 09 14:43:05 devstack sudo[99439]: pam_unix(sudo:session): session closed for user root
Jul 09 14:43:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a4a2a034-d738-4c30-bbe2-883b62fc8feb tempest-CreateVolumesFromSnapshotTest-1270352026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0368cc57-b3a4-4022-8890-ebb1d9b3e014 1073741824" returned: 0 in 1.002s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:43:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a4a2a034-d738-4c30-bbe2-883b62fc8feb tempest-CreateVolumesFromSnapshotTest-1270352026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0368cc57-b3a4-4022-8890-ebb1d9b3e014 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:43:05 devstack sudo[99446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0368cc57-b3a4-4022-8890-ebb1d9b3e014
Jul 09 14:43:05 devstack sudo[99446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:43:05 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b884efd3-6418-4eda-aeb9-2fd4ba601180 tempest-VolumesActionsTest-1951729172 None] Acquiring lock "cinder-eddb624e-2c6c-440c-a2e4-24d0f2bdbbf3-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:43:05 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b884efd3-6418-4eda-aeb9-2fd4ba601180 tempest-VolumesActionsTest-1951729172 None] Lock "cinder-eddb624e-2c6c-440c-a2e4-24d0f2bdbbf3-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:43:05 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b884efd3-6418-4eda-aeb9-2fd4ba601180 tempest-VolumesActionsTest-1951729172 None] Acquiring lock "cinder-quobyte-eddb624e-2c6c-440c-a2e4-24d0f2bdbbf3" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:43:05 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b884efd3-6418-4eda-aeb9-2fd4ba601180 tempest-VolumesActionsTest-1951729172 None] Lock "cinder-quobyte-eddb624e-2c6c-440c-a2e4-24d0f2bdbbf3" acquired by "delete_volume" :: waited 0.036s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:43:05 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f26454f-5a92-4590-9e57-3014010a9457]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:43:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b884efd3-6418-4eda-aeb9-2fd4ba601180 tempest-VolumesActionsTest-1951729172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-eddb624e-2c6c-440c-a2e4-24d0f2bdbbf3 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:43:05 devstack sudo[99451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-eddb624e-2c6c-440c-a2e4-24d0f2bdbbf3
Jul 09 14:43:05 devstack sudo[99451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:43:06 devstack sudo[99446]: pam_unix(sudo:session): session closed for user root
Jul 09 14:43:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a4a2a034-d738-4c30-bbe2-883b62fc8feb tempest-CreateVolumesFromSnapshotTest-1270352026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0368cc57-b3a4-4022-8890-ebb1d9b3e014" returned: 0 in 0.854s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:43:06 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a4a2a034-d738-4c30-bbe2-883b62fc8feb tempest-CreateVolumesFromSnapshotTest-1270352026 None] <== create_volume: return (1963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:43:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a4a2a034-d738-4c30-bbe2-883b62fc8feb tempest-CreateVolumesFromSnapshotTest-1270352026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.968s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:43:06 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:UPDATE=150,cinder:SELECT=107,cinder:DELETE=16,cinder:INSERT=32 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 14:43:06 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a4a2a034-d738-4c30-bbe2-883b62fc8feb tempest-CreateVolumesFromSnapshotTest-1270352026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b441ea6-abe8-4645-8e7a-e4ef9197c0c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0368cc57-b3a4-4022-8890-ebb1d9b3e014', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:43:06 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a4a2a034-d738-4c30-bbe2-883b62fc8feb tempest-CreateVolumesFromSnapshotTest-1270352026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e0cdfc1-9f99-49f9-911b-53e75cd066f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:43:06 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:UPDATE=127,cinder:SELECT=113,cinder:INSERT=44,cinder:DELETE=6 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 14:43:06 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-a4a2a034-d738-4c30-bbe2-883b62fc8feb tempest-CreateVolumesFromSnapshotTest-1270352026 None] Volume volume-0368cc57-b3a4-4022-8890-ebb1d9b3e014 (0368cc57-b3a4-4022-8890-ebb1d9b3e014): created successfully
Jul 09 14:43:06 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a4a2a034-d738-4c30-bbe2-883b62fc8feb tempest-CreateVolumesFromSnapshotTest-1270352026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e0cdfc1-9f99-49f9-911b-53e75cd066f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:43:06 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a4a2a034-d738-4c30-bbe2-883b62fc8feb tempest-CreateVolumesFromSnapshotTest-1270352026 None] Flow 'volume_create_manager' (132cac43-e88c-4f27-abeb-984261891bcb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:43:06 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-a4a2a034-d738-4c30-bbe2-883b62fc8feb tempest-CreateVolumesFromSnapshotTest-1270352026 None] Created volume successfully.
Jul 09 14:43:06 devstack sudo[99451]: pam_unix(sudo:session): session closed for user root
Jul 09 14:43:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b884efd3-6418-4eda-aeb9-2fd4ba601180 tempest-VolumesActionsTest-1951729172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-eddb624e-2c6c-440c-a2e4-24d0f2bdbbf3" returned: 0 in 0.936s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:43:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b884efd3-6418-4eda-aeb9-2fd4ba601180 tempest-VolumesActionsTest-1951729172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-eddb624e-2c6c-440c-a2e4-24d0f2bdbbf3 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:43:06 devstack sudo[99457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-eddb624e-2c6c-440c-a2e4-24d0f2bdbbf3
Jul 09 14:43:06 devstack sudo[99457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:43:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5ae5a16b-dea9-41b2-a6e5-a33e97d3997b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:43:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5ae5a16b-dea9-41b2-a6e5-a33e97d3997b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:43:07 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-5ae5a16b-dea9-41b2-a6e5-a33e97d3997b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Creating offline snapshot 4c4f53fb-3933-438d-9e66-a1237f0c20c3 of volume 0368cc57-b3a4-4022-8890-ebb1d9b3e014 {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 14:43:07 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c5240a7-6d80-453b-830c-d3236730ad7c]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:43:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5ae5a16b-dea9-41b2-a6e5-a33e97d3997b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0368cc57-b3a4-4022-8890-ebb1d9b3e014 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:43:07 devstack sudo[99459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0368cc57-b3a4-4022-8890-ebb1d9b3e014
Jul 09 14:43:07 devstack sudo[99459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:43:07 devstack sudo[99457]: pam_unix(sudo:session): session closed for user root
Jul 09 14:43:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b884efd3-6418-4eda-aeb9-2fd4ba601180 tempest-VolumesActionsTest-1951729172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-eddb624e-2c6c-440c-a2e4-24d0f2bdbbf3" returned: 0 in 0.869s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:43:07 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b884efd3-6418-4eda-aeb9-2fd4ba601180 tempest-VolumesActionsTest-1951729172 None] Lock "cinder-quobyte-eddb624e-2c6c-440c-a2e4-24d0f2bdbbf3" released by "delete_volume" :: held 1.875s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:43:07 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-b884efd3-6418-4eda-aeb9-2fd4ba601180 tempest-VolumesActionsTest-1951729172 None] Created reservations ['277305c7-6ea0-49e2-b64d-b452a12656b2', '717fb934-1978-4f17-9461-310628b9b3fc', '884bd5f9-d999-440b-810f-7529726a10ad', 'fa0f0483-a36c-425d-baa3-d2613c77998a'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:43:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b884efd3-6418-4eda-aeb9-2fd4ba601180 tempest-VolumesActionsTest-1951729172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:43:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b884efd3-6418-4eda-aeb9-2fd4ba601180 tempest-VolumesActionsTest-1951729172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:43:07 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b884efd3-6418-4eda-aeb9-2fd4ba601180 tempest-VolumesActionsTest-1951729172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:43:07 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b884efd3-6418-4eda-aeb9-2fd4ba601180 tempest-VolumesActionsTest-1951729172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:43:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b884efd3-6418-4eda-aeb9-2fd4ba601180 tempest-VolumesActionsTest-1951729172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:43:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b884efd3-6418-4eda-aeb9-2fd4ba601180 tempest-VolumesActionsTest-1951729172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:43:07 devstack sudo[99462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:43:07 devstack sudo[99462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:43:08 devstack sudo[99459]: pam_unix(sudo:session): session closed for user root
Jul 09 14:43:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5ae5a16b-dea9-41b2-a6e5-a33e97d3997b tempest-CreateVolumesFromSnapshotTest-1270352026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0368cc57-b3a4-4022-8890-ebb1d9b3e014" returned: 0 in 1.101s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:43:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5ae5a16b-dea9-41b2-a6e5-a33e97d3997b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0368cc57-b3a4-4022-8890-ebb1d9b3e014,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0368cc57-b3a4-4022-8890-ebb1d9b3e014.4c4f53fb-3933-438d-9e66-a1237f0c20c3 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:43:08 devstack sudo[99469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0368cc57-b3a4-4022-8890-ebb1d9b3e014,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0368cc57-b3a4-4022-8890-ebb1d9b3e014.4c4f53fb-3933-438d-9e66-a1237f0c20c3 1G
Jul 09 14:43:08 devstack sudo[99469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:43:08 devstack sudo[99462]: pam_unix(sudo:session): session closed for user root
Jul 09 14:43:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b884efd3-6418-4eda-aeb9-2fd4ba601180 tempest-VolumesActionsTest-1951729172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.799s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:43:08 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-b884efd3-6418-4eda-aeb9-2fd4ba601180 tempest-VolumesActionsTest-1951729172 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:43:08 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-b884efd3-6418-4eda-aeb9-2fd4ba601180 tempest-VolumesActionsTest-1951729172 None] Deleted volume successfully.
Jul 09 14:43:08 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b884efd3-6418-4eda-aeb9-2fd4ba601180 tempest-VolumesActionsTest-1951729172 None] Lock "cinder-eddb624e-2c6c-440c-a2e4-24d0f2bdbbf3-delete_volume" released by "delete_volume" :: held 2.970s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:43:08 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-7886af67-fd47-4d49-925f-39992156b59e tempest-VolumesActionsTest-937364676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:43:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7886af67-fd47-4d49-925f-39992156b59e tempest-VolumesActionsTest-937364676 None] Flow 'volume_create_manager' (7e07a15f-23fc-423a-b5a8-967d2dc4dbc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:43:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7886af67-fd47-4d49-925f-39992156b59e tempest-VolumesActionsTest-937364676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8dd09f4-261d-4139-9233-8b5d5047cf97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:43:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7886af67-fd47-4d49-925f-39992156b59e tempest-VolumesActionsTest-937364676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8dd09f4-261d-4139-9233-8b5d5047cf97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:43:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-700413996',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13312504-3719-47a7-af64-6ae92e5e2d46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='522e7febd7b6499d9f39419cabe064ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:43:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:43:09Z,use_quota=True,user_id='3802808ebeb5450cb366087caef84fcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:43:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7886af67-fd47-4d49-925f-39992156b59e tempest-VolumesActionsTest-937364676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bafd710-b54e-4eae-9198-f5b1ddaadd24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:43:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7886af67-fd47-4d49-925f-39992156b59e tempest-VolumesActionsTest-937364676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bafd710-b54e-4eae-9198-f5b1ddaadd24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:43:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7886af67-fd47-4d49-925f-39992156b59e tempest-VolumesActionsTest-937364676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b488486-5785-40ce-b28a-a347a95b4d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:43:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7886af67-fd47-4d49-925f-39992156b59e tempest-VolumesActionsTest-937364676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b488486-5785-40ce-b28a-a347a95b4d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13312504-3719-47a7-af64-6ae92e5e2d46', 'volume_name': 'volume-13312504-3719-47a7-af64-6ae92e5e2d46', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:43:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7886af67-fd47-4d49-925f-39992156b59e tempest-VolumesActionsTest-937364676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a5c6329-1659-4992-aa5f-2d0bafc3d88f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:43:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7886af67-fd47-4d49-925f-39992156b59e tempest-VolumesActionsTest-937364676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a5c6329-1659-4992-aa5f-2d0bafc3d88f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:43:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7886af67-fd47-4d49-925f-39992156b59e tempest-VolumesActionsTest-937364676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9abc5df8-5879-46d9-8199-d03c38d78a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:43:08 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-7886af67-fd47-4d49-925f-39992156b59e tempest-VolumesActionsTest-937364676 None] Volume 13312504-3719-47a7-af64-6ae92e5e2d46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13312504-3719-47a7-af64-6ae92e5e2d46', 'volume_size': 1}
Jul 09 14:43:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7886af67-fd47-4d49-925f-39992156b59e tempest-VolumesActionsTest-937364676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:43:09 devstack sudo[99469]: pam_unix(sudo:session): session closed for user root
Jul 09 14:43:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5ae5a16b-dea9-41b2-a6e5-a33e97d3997b tempest-CreateVolumesFromSnapshotTest-1270352026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0368cc57-b3a4-4022-8890-ebb1d9b3e014,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0368cc57-b3a4-4022-8890-ebb1d9b3e014.4c4f53fb-3933-438d-9e66-a1237f0c20c3 1G" returned: 0 in 0.956s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:43:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5ae5a16b-dea9-41b2-a6e5-a33e97d3997b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0368cc57-b3a4-4022-8890-ebb1d9b3e014 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0368cc57-b3a4-4022-8890-ebb1d9b3e014.4c4f53fb-3933-438d-9e66-a1237f0c20c3 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:43:09 devstack sudo[99475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0368cc57-b3a4-4022-8890-ebb1d9b3e014 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0368cc57-b3a4-4022-8890-ebb1d9b3e014.4c4f53fb-3933-438d-9e66-a1237f0c20c3
Jul 09 14:43:09 devstack sudo[99475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:43:10 devstack sudo[99475]: pam_unix(sudo:session): session closed for user root
Jul 09 14:43:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5ae5a16b-dea9-41b2-a6e5-a33e97d3997b tempest-CreateVolumesFromSnapshotTest-1270352026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0368cc57-b3a4-4022-8890-ebb1d9b3e014 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0368cc57-b3a4-4022-8890-ebb1d9b3e014.4c4f53fb-3933-438d-9e66-a1237f0c20c3" returned: 0 in 0.756s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:43:10 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-5ae5a16b-dea9-41b2-a6e5-a33e97d3997b tempest-CreateVolumesFromSnapshotTest-1270352026 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0368cc57-b3a4-4022-8890-ebb1d9b3e014.4c4f53fb-3933-438d-9e66-a1237f0c20c3 is being set with open permissions: ugo+rw
Jul 09 14:43:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5ae5a16b-dea9-41b2-a6e5-a33e97d3997b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0368cc57-b3a4-4022-8890-ebb1d9b3e014.4c4f53fb-3933-438d-9e66-a1237f0c20c3 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:43:10 devstack sudo[99480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0368cc57-b3a4-4022-8890-ebb1d9b3e014.4c4f53fb-3933-438d-9e66-a1237f0c20c3
Jul 09 14:43:10 devstack sudo[99480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:43:10 devstack sudo[99480]: pam_unix(sudo:session): session closed for user root
Jul 09 14:43:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5ae5a16b-dea9-41b2-a6e5-a33e97d3997b tempest-CreateVolumesFromSnapshotTest-1270352026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0368cc57-b3a4-4022-8890-ebb1d9b3e014.4c4f53fb-3933-438d-9e66-a1237f0c20c3" returned: 0 in 0.745s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:43:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5ae5a16b-dea9-41b2-a6e5-a33e97d3997b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0368cc57-b3a4-4022-8890-ebb1d9b3e014.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:43:10 devstack sudo[99484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0368cc57-b3a4-4022-8890-ebb1d9b3e014.info
Jul 09 14:43:10 devstack sudo[99484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:43:11 devstack sudo[99484]: pam_unix(sudo:session): session closed for user root
Jul 09 14:43:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5ae5a16b-dea9-41b2-a6e5-a33e97d3997b tempest-CreateVolumesFromSnapshotTest-1270352026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0368cc57-b3a4-4022-8890-ebb1d9b3e014.info" returned: 0 in 0.809s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:43:11 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-5ae5a16b-dea9-41b2-a6e5-a33e97d3997b tempest-CreateVolumesFromSnapshotTest-1270352026 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0368cc57-b3a4-4022-8890-ebb1d9b3e014.info is being set with open permissions: ugo+rw
Jul 09 14:43:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5ae5a16b-dea9-41b2-a6e5-a33e97d3997b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0368cc57-b3a4-4022-8890-ebb1d9b3e014.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:43:11 devstack sudo[99487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0368cc57-b3a4-4022-8890-ebb1d9b3e014.info
Jul 09 14:43:11 devstack sudo[99487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:43:12 devstack sudo[99487]: pam_unix(sudo:session): session closed for user root
Jul 09 14:43:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5ae5a16b-dea9-41b2-a6e5-a33e97d3997b tempest-CreateVolumesFromSnapshotTest-1270352026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0368cc57-b3a4-4022-8890-ebb1d9b3e014.info" returned: 0 in 0.895s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:43:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5ae5a16b-dea9-41b2-a6e5-a33e97d3997b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.375s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:43:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7886af67-fd47-4d49-925f-39992156b59e tempest-VolumesActionsTest-937364676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.878s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:43:12 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7886af67-fd47-4d49-925f-39992156b59e tempest-VolumesActionsTest-937364676 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:43:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-700413996',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13312504-3719-47a7-af64-6ae92e5e2d46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='522e7febd7b6499d9f39419cabe064ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:43:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:43:09Z,use_quota=True,user_id='3802808ebeb5450cb366087caef84fcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:43:12 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-7886af67-fd47-4d49-925f-39992156b59e tempest-VolumesActionsTest-937364676 None] Creating volume 13312504-3719-47a7-af64-6ae92e5e2d46 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:43:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7886af67-fd47-4d49-925f-39992156b59e tempest-VolumesActionsTest-937364676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:43:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7886af67-fd47-4d49-925f-39992156b59e tempest-VolumesActionsTest-937364676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:43:12 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7886af67-fd47-4d49-925f-39992156b59e tempest-VolumesActionsTest-937364676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:43:12 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7886af67-fd47-4d49-925f-39992156b59e tempest-VolumesActionsTest-937364676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:43:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7886af67-fd47-4d49-925f-39992156b59e tempest-VolumesActionsTest-937364676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:43:12 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7886af67-fd47-4d49-925f-39992156b59e tempest-VolumesActionsTest-937364676 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:43:12 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-7886af67-fd47-4d49-925f-39992156b59e tempest-VolumesActionsTest-937364676 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:43:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7886af67-fd47-4d49-925f-39992156b59e tempest-VolumesActionsTest-937364676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-13312504-3719-47a7-af64-6ae92e5e2d46 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:43:12 devstack sudo[99500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-13312504-3719-47a7-af64-6ae92e5e2d46 1073741824
Jul 09 14:43:12 devstack sudo[99500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:43:12 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-5ae5a16b-dea9-41b2-a6e5-a33e97d3997b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Create snapshot completed successfully
Jul 09 14:43:13 devstack sudo[99500]: pam_unix(sudo:session): session closed for user root
Jul 09 14:43:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7886af67-fd47-4d49-925f-39992156b59e tempest-VolumesActionsTest-937364676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-13312504-3719-47a7-af64-6ae92e5e2d46 1073741824" returned: 0 in 0.962s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:43:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7886af67-fd47-4d49-925f-39992156b59e tempest-VolumesActionsTest-937364676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-13312504-3719-47a7-af64-6ae92e5e2d46 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:43:13 devstack sudo[99512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-13312504-3719-47a7-af64-6ae92e5e2d46
Jul 09 14:43:13 devstack sudo[99512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:43:14 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-b413c07d-7711-4d05-a453-41c0901b4cd7 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:43:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b413c07d-7711-4d05-a453-41c0901b4cd7 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Flow 'volume_create_manager' (738106f0-a4c0-459a-911a-59d12993e2e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:43:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b413c07d-7711-4d05-a453-41c0901b4cd7 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bc49b1e-7552-446c-b185-1ac2168e1927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:43:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b413c07d-7711-4d05-a453-41c0901b4cd7 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bc49b1e-7552-446c-b185-1ac2168e1927) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:43:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1937022827',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=823621c1-f07e-4abd-8cae-155c6d1e5854,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcc84d3f22f74b258ac93ff6f3f8eb32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:43:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:43:14Z,use_quota=True,user_id='7b7e2ba8b4d44a71951bae570658fa00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:43:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b413c07d-7711-4d05-a453-41c0901b4cd7 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68891380-2eb8-4022-ad73-7ef99330eff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:43:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b413c07d-7711-4d05-a453-41c0901b4cd7 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68891380-2eb8-4022-ad73-7ef99330eff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:43:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b413c07d-7711-4d05-a453-41c0901b4cd7 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f567a244-a234-4440-b35a-32e6b35f7528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:43:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b413c07d-7711-4d05-a453-41c0901b4cd7 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f567a244-a234-4440-b35a-32e6b35f7528) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '823621c1-f07e-4abd-8cae-155c6d1e5854', 'volume_name': 'volume-823621c1-f07e-4abd-8cae-155c6d1e5854', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:43:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b413c07d-7711-4d05-a453-41c0901b4cd7 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d28de5e9-04d8-49dd-acb7-67e6687f94be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:43:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b413c07d-7711-4d05-a453-41c0901b4cd7 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d28de5e9-04d8-49dd-acb7-67e6687f94be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:43:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b413c07d-7711-4d05-a453-41c0901b4cd7 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47bd9f8c-28a5-4679-a6e0-a939718b0ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:43:14 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-b413c07d-7711-4d05-a453-41c0901b4cd7 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Volume 823621c1-f07e-4abd-8cae-155c6d1e5854: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-823621c1-f07e-4abd-8cae-155c6d1e5854', 'volume_size': 1}
Jul 09 14:43:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b413c07d-7711-4d05-a453-41c0901b4cd7 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:43:14 devstack sudo[99512]: pam_unix(sudo:session): session closed for user root
Jul 09 14:43:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7886af67-fd47-4d49-925f-39992156b59e tempest-VolumesActionsTest-937364676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-13312504-3719-47a7-af64-6ae92e5e2d46" returned: 0 in 0.854s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:43:14 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7886af67-fd47-4d49-925f-39992156b59e tempest-VolumesActionsTest-937364676 None] <== create_volume: return (1882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:43:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7886af67-fd47-4d49-925f-39992156b59e tempest-VolumesActionsTest-937364676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.891s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:43:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b413c07d-7711-4d05-a453-41c0901b4cd7 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.166s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:43:14 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b413c07d-7711-4d05-a453-41c0901b4cd7 tempest-CreateVolumesFromSnapshotTest-1270352026 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:43:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1937022827',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=823621c1-f07e-4abd-8cae-155c6d1e5854,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcc84d3f22f74b258ac93ff6f3f8eb32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:43:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:43:14Z,use_quota=True,user_id='7b7e2ba8b4d44a71951bae570658fa00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:43:14 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-b413c07d-7711-4d05-a453-41c0901b4cd7 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Creating volume 823621c1-f07e-4abd-8cae-155c6d1e5854 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:43:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b413c07d-7711-4d05-a453-41c0901b4cd7 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:43:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b413c07d-7711-4d05-a453-41c0901b4cd7 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:43:14 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b413c07d-7711-4d05-a453-41c0901b4cd7 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:43:14 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b413c07d-7711-4d05-a453-41c0901b4cd7 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:43:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b413c07d-7711-4d05-a453-41c0901b4cd7 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:43:14 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b413c07d-7711-4d05-a453-41c0901b4cd7 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:43:14 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-b413c07d-7711-4d05-a453-41c0901b4cd7 tempest-CreateVolumesFromSnapshotTest-1270352026 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:43:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b413c07d-7711-4d05-a453-41c0901b4cd7 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-823621c1-f07e-4abd-8cae-155c6d1e5854 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:43:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7886af67-fd47-4d49-925f-39992156b59e tempest-VolumesActionsTest-937364676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9abc5df8-5879-46d9-8199-d03c38d78a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13312504-3719-47a7-af64-6ae92e5e2d46', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:43:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7886af67-fd47-4d49-925f-39992156b59e tempest-VolumesActionsTest-937364676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2c9bf26-9a11-4a64-99ad-92017ca60469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:43:14 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-7886af67-fd47-4d49-925f-39992156b59e tempest-VolumesActionsTest-937364676 None] Volume volume-13312504-3719-47a7-af64-6ae92e5e2d46 (13312504-3719-47a7-af64-6ae92e5e2d46): created successfully
Jul 09 14:43:14 devstack sudo[99515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-823621c1-f07e-4abd-8cae-155c6d1e5854 1073741824
Jul 09 14:43:14 devstack sudo[99515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:43:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7886af67-fd47-4d49-925f-39992156b59e tempest-VolumesActionsTest-937364676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2c9bf26-9a11-4a64-99ad-92017ca60469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:43:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7886af67-fd47-4d49-925f-39992156b59e tempest-VolumesActionsTest-937364676 None] Flow 'volume_create_manager' (7e07a15f-23fc-423a-b5a8-967d2dc4dbc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:43:14 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-7886af67-fd47-4d49-925f-39992156b59e tempest-VolumesActionsTest-937364676 None] Created volume successfully.
Jul 09 14:43:14 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-73e12265-a3d8-4f20-9d4f-a5fc93bb996c tempest-CreateVolumesFromSnapshotTest-1270352026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:43:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-73e12265-a3d8-4f20-9d4f-a5fc93bb996c tempest-CreateVolumesFromSnapshotTest-1270352026 None] Flow 'volume_create_manager' (f8bb501c-e45b-42cf-97bd-a188eac7a4c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:43:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-73e12265-a3d8-4f20-9d4f-a5fc93bb996c tempest-CreateVolumesFromSnapshotTest-1270352026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (063b3f2a-7e50-44c4-a4ea-52ab8ffe3167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:43:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-73e12265-a3d8-4f20-9d4f-a5fc93bb996c tempest-CreateVolumesFromSnapshotTest-1270352026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (063b3f2a-7e50-44c4-a4ea-52ab8ffe3167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:43:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1327164955',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c39f3c2f-1ade-47fa-877b-0b4d1c7bcee8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcc84d3f22f74b258ac93ff6f3f8eb32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:43:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:43:15Z,use_quota=True,user_id='7b7e2ba8b4d44a71951bae570658fa00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:43:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-73e12265-a3d8-4f20-9d4f-a5fc93bb996c tempest-CreateVolumesFromSnapshotTest-1270352026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b54677c-a107-4a2b-a31d-72a519290c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:43:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-73e12265-a3d8-4f20-9d4f-a5fc93bb996c tempest-CreateVolumesFromSnapshotTest-1270352026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b54677c-a107-4a2b-a31d-72a519290c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:43:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-73e12265-a3d8-4f20-9d4f-a5fc93bb996c tempest-CreateVolumesFromSnapshotTest-1270352026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61d4ab54-1c9d-47bd-bdc2-28f0f92cdfdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:43:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-73e12265-a3d8-4f20-9d4f-a5fc93bb996c tempest-CreateVolumesFromSnapshotTest-1270352026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61d4ab54-1c9d-47bd-bdc2-28f0f92cdfdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c39f3c2f-1ade-47fa-877b-0b4d1c7bcee8', 'volume_name': 'volume-c39f3c2f-1ade-47fa-877b-0b4d1c7bcee8', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:43:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-73e12265-a3d8-4f20-9d4f-a5fc93bb996c tempest-CreateVolumesFromSnapshotTest-1270352026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1065099f-37bd-4469-826e-313044ded599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:43:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-73e12265-a3d8-4f20-9d4f-a5fc93bb996c tempest-CreateVolumesFromSnapshotTest-1270352026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1065099f-37bd-4469-826e-313044ded599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:43:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-73e12265-a3d8-4f20-9d4f-a5fc93bb996c tempest-CreateVolumesFromSnapshotTest-1270352026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f159aca3-6072-4d15-8f35-027801248356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:43:14 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-73e12265-a3d8-4f20-9d4f-a5fc93bb996c tempest-CreateVolumesFromSnapshotTest-1270352026 None] Volume c39f3c2f-1ade-47fa-877b-0b4d1c7bcee8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c39f3c2f-1ade-47fa-877b-0b4d1c7bcee8', 'volume_size': 1}
Jul 09 14:43:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-73e12265-a3d8-4f20-9d4f-a5fc93bb996c tempest-CreateVolumesFromSnapshotTest-1270352026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:43:15 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d97ca62-01d6-47d8-9388-c8ba9c89064b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:43:15 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0d97ca62-01d6-47d8-9388-c8ba9c89064b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Flow 'volume_create_manager' (b44a50cb-6479-4420-9537-156ee2bfca32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:43:15 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0d97ca62-01d6-47d8-9388-c8ba9c89064b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79e248e4-e187-42ea-b389-aa3c2bfb4fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:43:15 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0d97ca62-01d6-47d8-9388-c8ba9c89064b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79e248e4-e187-42ea-b389-aa3c2bfb4fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:43:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1620201309',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd5b127a-53e1-432e-b516-ec75931bfee9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcc84d3f22f74b258ac93ff6f3f8eb32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:43:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:43:15Z,use_quota=True,user_id='7b7e2ba8b4d44a71951bae570658fa00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:43:15 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0d97ca62-01d6-47d8-9388-c8ba9c89064b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e096f34d-c609-46c5-b912-509e6efc82d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:43:15 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0d97ca62-01d6-47d8-9388-c8ba9c89064b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e096f34d-c609-46c5-b912-509e6efc82d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:43:15 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0d97ca62-01d6-47d8-9388-c8ba9c89064b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7b928ba-6dac-4adb-8907-d68971b1e935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:43:15 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0d97ca62-01d6-47d8-9388-c8ba9c89064b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7b928ba-6dac-4adb-8907-d68971b1e935) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd5b127a-53e1-432e-b516-ec75931bfee9', 'volume_name': 'volume-bd5b127a-53e1-432e-b516-ec75931bfee9', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:43:15 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0d97ca62-01d6-47d8-9388-c8ba9c89064b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f024bb9e-deb8-4da5-b959-6d28ac452a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:43:15 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0d97ca62-01d6-47d8-9388-c8ba9c89064b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f024bb9e-deb8-4da5-b959-6d28ac452a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:43:15 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0d97ca62-01d6-47d8-9388-c8ba9c89064b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (483122a9-02bf-4073-a247-ce24883ffb95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:43:15 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-0d97ca62-01d6-47d8-9388-c8ba9c89064b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Volume bd5b127a-53e1-432e-b516-ec75931bfee9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd5b127a-53e1-432e-b516-ec75931bfee9', 'volume_size': 1}
Jul 09 14:43:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0d97ca62-01d6-47d8-9388-c8ba9c89064b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:43:15 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-15d84242-6b8a-479d-8666-12153349ede0 tempest-VolumesActionsTest-1951729172 None] Acquiring lock "cinder-13312504-3719-47a7-af64-6ae92e5e2d46-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:43:15 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-15d84242-6b8a-479d-8666-12153349ede0 tempest-VolumesActionsTest-1951729172 None] Lock "cinder-13312504-3719-47a7-af64-6ae92e5e2d46-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:43:15 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-15d84242-6b8a-479d-8666-12153349ede0 tempest-VolumesActionsTest-1951729172 None] Acquiring lock "cinder-quobyte-13312504-3719-47a7-af64-6ae92e5e2d46" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:43:15 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-15d84242-6b8a-479d-8666-12153349ede0 tempest-VolumesActionsTest-1951729172 None] Lock "cinder-quobyte-13312504-3719-47a7-af64-6ae92e5e2d46" acquired by "delete_volume" :: waited 0.019s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:43:15 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad922f2-0716-41c1-9fe8-68d21059c026]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:43:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-15d84242-6b8a-479d-8666-12153349ede0 tempest-VolumesActionsTest-1951729172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-13312504-3719-47a7-af64-6ae92e5e2d46 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:43:15 devstack sudo[99521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-13312504-3719-47a7-af64-6ae92e5e2d46
Jul 09 14:43:15 devstack sudo[99521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:43:15 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-75b7fec1-0fa8-4c50-842a-2732e399d94b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:43:15 devstack sudo[99515]: pam_unix(sudo:session): session closed for user root
Jul 09 14:43:15 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-75b7fec1-0fa8-4c50-842a-2732e399d94b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Flow 'volume_create_manager' (93ecc873-2077-4199-bab2-2a8d4f473098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:43:15 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-75b7fec1-0fa8-4c50-842a-2732e399d94b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72e33c87-4721-41e7-b5dd-ac29a544aa8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:43:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b413c07d-7711-4d05-a453-41c0901b4cd7 tempest-CreateVolumesFromSnapshotTest-1270352026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-823621c1-f07e-4abd-8cae-155c6d1e5854 1073741824" returned: 0 in 1.385s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:43:15 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-75b7fec1-0fa8-4c50-842a-2732e399d94b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72e33c87-4721-41e7-b5dd-ac29a544aa8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:43:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-349360560',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cc70d9b-1092-4022-a46b-c8143c2799a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcc84d3f22f74b258ac93ff6f3f8eb32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:43:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:43:16Z,use_quota=True,user_id='7b7e2ba8b4d44a71951bae570658fa00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:43:15 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-75b7fec1-0fa8-4c50-842a-2732e399d94b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (856ec5c2-2a2e-4794-b381-6617a8dbbcd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:43:15 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-75b7fec1-0fa8-4c50-842a-2732e399d94b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (856ec5c2-2a2e-4794-b381-6617a8dbbcd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:43:15 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-75b7fec1-0fa8-4c50-842a-2732e399d94b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (931ac6d5-1723-4177-884f-21bceb2a2eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:43:15 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-75b7fec1-0fa8-4c50-842a-2732e399d94b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (931ac6d5-1723-4177-884f-21bceb2a2eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cc70d9b-1092-4022-a46b-c8143c2799a6', 'volume_name': 'volume-1cc70d9b-1092-4022-a46b-c8143c2799a6', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:43:15 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-75b7fec1-0fa8-4c50-842a-2732e399d94b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c978920-214b-41ce-8540-6fbfebb3d4d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:43:15 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-75b7fec1-0fa8-4c50-842a-2732e399d94b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c978920-214b-41ce-8540-6fbfebb3d4d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:43:15 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-75b7fec1-0fa8-4c50-842a-2732e399d94b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c2584fa-da02-4116-a122-52cb2fbbb8ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:43:15 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-75b7fec1-0fa8-4c50-842a-2732e399d94b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Volume 1cc70d9b-1092-4022-a46b-c8143c2799a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cc70d9b-1092-4022-a46b-c8143c2799a6', 'volume_size': 1}
Jul 09 14:43:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-75b7fec1-0fa8-4c50-842a-2732e399d94b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:43:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b413c07d-7711-4d05-a453-41c0901b4cd7 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-823621c1-f07e-4abd-8cae-155c6d1e5854 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:43:16 devstack sudo[99523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-823621c1-f07e-4abd-8cae-155c6d1e5854
Jul 09 14:43:16 devstack sudo[99523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:43:16 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc68a2ac-74d5-478c-bf69-aa1ea911e47b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:43:16 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-bc68a2ac-74d5-478c-bf69-aa1ea911e47b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Flow 'volume_create_manager' (717b0c40-96a7-428d-abf6-c9d32145dd8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:43:16 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-bc68a2ac-74d5-478c-bf69-aa1ea911e47b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4044d7e1-5ecf-4ec2-902c-b1ffba39983c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:43:16 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-bc68a2ac-74d5-478c-bf69-aa1ea911e47b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4044d7e1-5ecf-4ec2-902c-b1ffba39983c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:43:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-198105716',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8c46a1e-ab93-4c10-ac43-1082f24d629b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcc84d3f22f74b258ac93ff6f3f8eb32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:43:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:43:16Z,use_quota=True,user_id='7b7e2ba8b4d44a71951bae570658fa00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:43:16 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-bc68a2ac-74d5-478c-bf69-aa1ea911e47b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c5da442-6300-4172-a28e-f3888f7c069f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:43:16 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-bc68a2ac-74d5-478c-bf69-aa1ea911e47b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c5da442-6300-4172-a28e-f3888f7c069f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:43:16 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-bc68a2ac-74d5-478c-bf69-aa1ea911e47b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4486f3f-201e-422b-96fd-9b69adbb93b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:43:16 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-bc68a2ac-74d5-478c-bf69-aa1ea911e47b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4486f3f-201e-422b-96fd-9b69adbb93b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8c46a1e-ab93-4c10-ac43-1082f24d629b', 'volume_name': 'volume-d8c46a1e-ab93-4c10-ac43-1082f24d629b', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:43:16 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-bc68a2ac-74d5-478c-bf69-aa1ea911e47b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99670cc2-66c7-42a9-8d90-d843d8f755e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:43:16 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-bc68a2ac-74d5-478c-bf69-aa1ea911e47b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99670cc2-66c7-42a9-8d90-d843d8f755e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:43:16 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-bc68a2ac-74d5-478c-bf69-aa1ea911e47b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98a8fff8-e7e6-402f-9115-65e833a97fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:43:16 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-bc68a2ac-74d5-478c-bf69-aa1ea911e47b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Volume d8c46a1e-ab93-4c10-ac43-1082f24d629b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8c46a1e-ab93-4c10-ac43-1082f24d629b', 'volume_size': 1}
Jul 09 14:43:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-bc68a2ac-74d5-478c-bf69-aa1ea911e47b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:43:17 devstack sudo[99523]: pam_unix(sudo:session): session closed for user root
Jul 09 14:43:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b413c07d-7711-4d05-a453-41c0901b4cd7 tempest-CreateVolumesFromSnapshotTest-1270352026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-823621c1-f07e-4abd-8cae-155c6d1e5854" returned: 0 in 1.132s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:43:17 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b413c07d-7711-4d05-a453-41c0901b4cd7 tempest-CreateVolumesFromSnapshotTest-1270352026 None] <== create_volume: return (2641ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:43:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b413c07d-7711-4d05-a453-41c0901b4cd7 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.646s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:43:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-73e12265-a3d8-4f20-9d4f-a5fc93bb996c tempest-CreateVolumesFromSnapshotTest-1270352026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.294s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:43:17 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-73e12265-a3d8-4f20-9d4f-a5fc93bb996c tempest-CreateVolumesFromSnapshotTest-1270352026 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:43:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1327164955',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c39f3c2f-1ade-47fa-877b-0b4d1c7bcee8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcc84d3f22f74b258ac93ff6f3f8eb32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:43:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:43:15Z,use_quota=True,user_id='7b7e2ba8b4d44a71951bae570658fa00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:43:17 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-73e12265-a3d8-4f20-9d4f-a5fc93bb996c tempest-CreateVolumesFromSnapshotTest-1270352026 None] Creating volume c39f3c2f-1ade-47fa-877b-0b4d1c7bcee8 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:43:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-73e12265-a3d8-4f20-9d4f-a5fc93bb996c tempest-CreateVolumesFromSnapshotTest-1270352026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:43:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-73e12265-a3d8-4f20-9d4f-a5fc93bb996c tempest-CreateVolumesFromSnapshotTest-1270352026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:43:17 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-73e12265-a3d8-4f20-9d4f-a5fc93bb996c tempest-CreateVolumesFromSnapshotTest-1270352026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:43:17 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-73e12265-a3d8-4f20-9d4f-a5fc93bb996c tempest-CreateVolumesFromSnapshotTest-1270352026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:43:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-73e12265-a3d8-4f20-9d4f-a5fc93bb996c tempest-CreateVolumesFromSnapshotTest-1270352026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:43:17 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-73e12265-a3d8-4f20-9d4f-a5fc93bb996c tempest-CreateVolumesFromSnapshotTest-1270352026 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:43:17 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-73e12265-a3d8-4f20-9d4f-a5fc93bb996c tempest-CreateVolumesFromSnapshotTest-1270352026 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:43:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-73e12265-a3d8-4f20-9d4f-a5fc93bb996c tempest-CreateVolumesFromSnapshotTest-1270352026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-c39f3c2f-1ade-47fa-877b-0b4d1c7bcee8 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:43:17 devstack sudo[99521]: pam_unix(sudo:session): session closed for user root
Jul 09 14:43:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-15d84242-6b8a-479d-8666-12153349ede0 tempest-VolumesActionsTest-1951729172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-13312504-3719-47a7-af64-6ae92e5e2d46" returned: 0 in 1.551s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:43:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-15d84242-6b8a-479d-8666-12153349ede0 tempest-VolumesActionsTest-1951729172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-13312504-3719-47a7-af64-6ae92e5e2d46 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:43:17 devstack sudo[99572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-c39f3c2f-1ade-47fa-877b-0b4d1c7bcee8 1073741824
Jul 09 14:43:17 devstack sudo[99572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:43:17 devstack sudo[99573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-13312504-3719-47a7-af64-6ae92e5e2d46
Jul 09 14:43:17 devstack sudo[99573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:43:17 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b413c07d-7711-4d05-a453-41c0901b4cd7 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47bd9f8c-28a5-4679-a6e0-a939718b0ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-823621c1-f07e-4abd-8cae-155c6d1e5854', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:43:17 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b413c07d-7711-4d05-a453-41c0901b4cd7 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cde1049b-59e0-4594-85d1-a8788ccd1c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:43:17 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-b413c07d-7711-4d05-a453-41c0901b4cd7 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Volume volume-823621c1-f07e-4abd-8cae-155c6d1e5854 (823621c1-f07e-4abd-8cae-155c6d1e5854): created successfully
Jul 09 14:43:17 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b413c07d-7711-4d05-a453-41c0901b4cd7 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cde1049b-59e0-4594-85d1-a8788ccd1c05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:43:17 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b413c07d-7711-4d05-a453-41c0901b4cd7 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Flow 'volume_create_manager' (738106f0-a4c0-459a-911a-59d12993e2e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:43:17 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-b413c07d-7711-4d05-a453-41c0901b4cd7 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Created volume successfully.
Jul 09 14:43:18 devstack sudo[99573]: pam_unix(sudo:session): session closed for user root
Jul 09 14:43:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-15d84242-6b8a-479d-8666-12153349ede0 tempest-VolumesActionsTest-1951729172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-13312504-3719-47a7-af64-6ae92e5e2d46" returned: 0 in 1.010s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:43:18 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-15d84242-6b8a-479d-8666-12153349ede0 tempest-VolumesActionsTest-1951729172 None] Lock "cinder-quobyte-13312504-3719-47a7-af64-6ae92e5e2d46" released by "delete_volume" :: held 2.629s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:43:18 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-15d84242-6b8a-479d-8666-12153349ede0 tempest-VolumesActionsTest-1951729172 None] Created reservations ['991a259f-28fb-45ce-9528-4741fefb07b0', 'ae212ca8-e2ea-48c6-abdb-2417e0748b0a', 'f57e2b16-ad56-4da0-a224-5c80f04b3539', '88c90689-8b81-41cd-b3d4-47b63704679c'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:43:18 devstack sudo[99572]: pam_unix(sudo:session): session closed for user root
Jul 09 14:43:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-73e12265-a3d8-4f20-9d4f-a5fc93bb996c tempest-CreateVolumesFromSnapshotTest-1270352026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-c39f3c2f-1ade-47fa-877b-0b4d1c7bcee8 1073741824" returned: 0 in 1.342s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:43:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-15d84242-6b8a-479d-8666-12153349ede0 tempest-VolumesActionsTest-1951729172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:43:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-15d84242-6b8a-479d-8666-12153349ede0 tempest-VolumesActionsTest-1951729172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:43:18 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-15d84242-6b8a-479d-8666-12153349ede0 tempest-VolumesActionsTest-1951729172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:43:18 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-15d84242-6b8a-479d-8666-12153349ede0 tempest-VolumesActionsTest-1951729172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:43:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-15d84242-6b8a-479d-8666-12153349ede0 tempest-VolumesActionsTest-1951729172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:43:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-15d84242-6b8a-479d-8666-12153349ede0 tempest-VolumesActionsTest-1951729172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:43:18 devstack sudo[99606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:43:18 devstack sudo[99606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:43:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-73e12265-a3d8-4f20-9d4f-a5fc93bb996c tempest-CreateVolumesFromSnapshotTest-1270352026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-c39f3c2f-1ade-47fa-877b-0b4d1c7bcee8 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:43:18 devstack sudo[99608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-c39f3c2f-1ade-47fa-877b-0b4d1c7bcee8
Jul 09 14:43:18 devstack sudo[99608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:43:19 devstack sudo[99606]: pam_unix(sudo:session): session closed for user root
Jul 09 14:43:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-15d84242-6b8a-479d-8666-12153349ede0 tempest-VolumesActionsTest-1951729172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 1.497s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:43:19 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-15d84242-6b8a-479d-8666-12153349ede0 tempest-VolumesActionsTest-1951729172 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:43:20 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-15d84242-6b8a-479d-8666-12153349ede0 tempest-VolumesActionsTest-1951729172 None] Deleted volume successfully.
Jul 09 14:43:20 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-15d84242-6b8a-479d-8666-12153349ede0 tempest-VolumesActionsTest-1951729172 None] Lock "cinder-13312504-3719-47a7-af64-6ae92e5e2d46-delete_volume" released by "delete_volume" :: held 4.612s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:43:20 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-90655e25-1ac2-49f8-9395-43ffb74bcfc9 tempest-VolumesActionsTest-937364676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:43:20 devstack sudo[99608]: pam_unix(sudo:session): session closed for user root
Jul 09 14:43:20 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-90655e25-1ac2-49f8-9395-43ffb74bcfc9 tempest-VolumesActionsTest-937364676 None] Flow 'volume_create_manager' (293bd489-d19e-4c7c-b0dc-9eedd8fde98f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:43:20 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-90655e25-1ac2-49f8-9395-43ffb74bcfc9 tempest-VolumesActionsTest-937364676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9433f54e-38be-4914-90e9-3d4687e468ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:43:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-73e12265-a3d8-4f20-9d4f-a5fc93bb996c tempest-CreateVolumesFromSnapshotTest-1270352026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-c39f3c2f-1ade-47fa-877b-0b4d1c7bcee8" returned: 0 in 1.560s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:43:20 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-73e12265-a3d8-4f20-9d4f-a5fc93bb996c tempest-CreateVolumesFromSnapshotTest-1270352026 None] <== create_volume: return (3040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:43:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-73e12265-a3d8-4f20-9d4f-a5fc93bb996c tempest-CreateVolumesFromSnapshotTest-1270352026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.043s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:43:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0d97ca62-01d6-47d8-9388-c8ba9c89064b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.946s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:43:20 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-0d97ca62-01d6-47d8-9388-c8ba9c89064b tempest-CreateVolumesFromSnapshotTest-1270352026 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:43:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1620201309',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd5b127a-53e1-432e-b516-ec75931bfee9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcc84d3f22f74b258ac93ff6f3f8eb32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:43:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:43:15Z,use_quota=True,user_id='7b7e2ba8b4d44a71951bae570658fa00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:43:20 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-0d97ca62-01d6-47d8-9388-c8ba9c89064b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Creating volume bd5b127a-53e1-432e-b516-ec75931bfee9 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:43:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0d97ca62-01d6-47d8-9388-c8ba9c89064b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:43:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0d97ca62-01d6-47d8-9388-c8ba9c89064b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:43:20 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-0d97ca62-01d6-47d8-9388-c8ba9c89064b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:43:20 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-0d97ca62-01d6-47d8-9388-c8ba9c89064b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:43:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0d97ca62-01d6-47d8-9388-c8ba9c89064b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:43:20 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-0d97ca62-01d6-47d8-9388-c8ba9c89064b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:43:20 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-0d97ca62-01d6-47d8-9388-c8ba9c89064b tempest-CreateVolumesFromSnapshotTest-1270352026 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:43:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0d97ca62-01d6-47d8-9388-c8ba9c89064b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bd5b127a-53e1-432e-b516-ec75931bfee9 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:43:20 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-90655e25-1ac2-49f8-9395-43ffb74bcfc9 tempest-VolumesActionsTest-937364676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9433f54e-38be-4914-90e9-3d4687e468ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:43:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1437829505',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=701f5f71-867f-4c4b-9524-e5dca0369763,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='522e7febd7b6499d9f39419cabe064ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:43:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:43:20Z,use_quota=True,user_id='3802808ebeb5450cb366087caef84fcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:43:20 devstack sudo[99616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bd5b127a-53e1-432e-b516-ec75931bfee9 1073741824
Jul 09 14:43:20 devstack sudo[99616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:43:20 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-90655e25-1ac2-49f8-9395-43ffb74bcfc9 tempest-VolumesActionsTest-937364676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e10b7b78-d72d-45c4-8b5b-d12b32fc4a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:43:20 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-90655e25-1ac2-49f8-9395-43ffb74bcfc9 tempest-VolumesActionsTest-937364676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e10b7b78-d72d-45c4-8b5b-d12b32fc4a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:43:20 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-90655e25-1ac2-49f8-9395-43ffb74bcfc9 tempest-VolumesActionsTest-937364676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0decda3-9d93-4faf-82ae-f73a2c73db50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:43:20 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-90655e25-1ac2-49f8-9395-43ffb74bcfc9 tempest-VolumesActionsTest-937364676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0decda3-9d93-4faf-82ae-f73a2c73db50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '701f5f71-867f-4c4b-9524-e5dca0369763', 'volume_name': 'volume-701f5f71-867f-4c4b-9524-e5dca0369763', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:43:20 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-90655e25-1ac2-49f8-9395-43ffb74bcfc9 tempest-VolumesActionsTest-937364676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07fafad3-9cb5-4826-884e-c07b06d09660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:43:20 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-90655e25-1ac2-49f8-9395-43ffb74bcfc9 tempest-VolumesActionsTest-937364676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07fafad3-9cb5-4826-884e-c07b06d09660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:43:20 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-90655e25-1ac2-49f8-9395-43ffb74bcfc9 tempest-VolumesActionsTest-937364676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74c207c8-452b-48ab-91bf-3d823c759504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:43:20 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-90655e25-1ac2-49f8-9395-43ffb74bcfc9 tempest-VolumesActionsTest-937364676 None] Volume 701f5f71-867f-4c4b-9524-e5dca0369763: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-701f5f71-867f-4c4b-9524-e5dca0369763', 'volume_size': 1}
Jul 09 14:43:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-90655e25-1ac2-49f8-9395-43ffb74bcfc9 tempest-VolumesActionsTest-937364676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:43:20 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-73e12265-a3d8-4f20-9d4f-a5fc93bb996c tempest-CreateVolumesFromSnapshotTest-1270352026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f159aca3-6072-4d15-8f35-027801248356) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c39f3c2f-1ade-47fa-877b-0b4d1c7bcee8', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:43:20 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-73e12265-a3d8-4f20-9d4f-a5fc93bb996c tempest-CreateVolumesFromSnapshotTest-1270352026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b50e710c-29dc-433c-8f49-b34da7a4b563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:43:20 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-73e12265-a3d8-4f20-9d4f-a5fc93bb996c tempest-CreateVolumesFromSnapshotTest-1270352026 None] Volume volume-c39f3c2f-1ade-47fa-877b-0b4d1c7bcee8 (c39f3c2f-1ade-47fa-877b-0b4d1c7bcee8): created successfully
Jul 09 14:43:20 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-73e12265-a3d8-4f20-9d4f-a5fc93bb996c tempest-CreateVolumesFromSnapshotTest-1270352026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b50e710c-29dc-433c-8f49-b34da7a4b563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:43:20 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-73e12265-a3d8-4f20-9d4f-a5fc93bb996c tempest-CreateVolumesFromSnapshotTest-1270352026 None] Flow 'volume_create_manager' (f8bb501c-e45b-42cf-97bd-a188eac7a4c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:43:20 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-73e12265-a3d8-4f20-9d4f-a5fc93bb996c tempest-CreateVolumesFromSnapshotTest-1270352026 None] Created volume successfully.
Jul 09 14:43:21 devstack sudo[99616]: pam_unix(sudo:session): session closed for user root
Jul 09 14:43:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0d97ca62-01d6-47d8-9388-c8ba9c89064b tempest-CreateVolumesFromSnapshotTest-1270352026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bd5b127a-53e1-432e-b516-ec75931bfee9 1073741824" returned: 0 in 1.223s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:43:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0d97ca62-01d6-47d8-9388-c8ba9c89064b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bd5b127a-53e1-432e-b516-ec75931bfee9 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:43:21 devstack sudo[99625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bd5b127a-53e1-432e-b516-ec75931bfee9
Jul 09 14:43:21 devstack sudo[99625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:43:21 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-667e1b79-912e-4843-a587-a4784735cc9f tempest-VolumesActionsTest-1906998927 None] Acquiring lock "cinder-9c94308d-f5c8-4a1c-9fd3-eedf373f1b20" by "attach_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:43:21 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-667e1b79-912e-4843-a587-a4784735cc9f tempest-VolumesActionsTest-1906998927 None] Lock "cinder-9c94308d-f5c8-4a1c-9fd3-eedf373f1b20" acquired by "attach_volume" :: waited 0.036s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:43:22 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-667e1b79-912e-4843-a587-a4784735cc9f tempest-VolumesActionsTest-1906998927 None] Attaching volume 9c94308d-f5c8-4a1c-9fd3-eedf373f1b20 to instance 4a260a19-50c6-41c3-ad27-3c33a0bab1c8 at mountpoint /dev/vdb on host None.
Jul 09 14:43:22 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-667e1b79-912e-4843-a587-a4784735cc9f tempest-VolumesActionsTest-1906998927 None] Attach volume completed successfully.
Jul 09 14:43:22 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-667e1b79-912e-4843-a587-a4784735cc9f tempest-VolumesActionsTest-1906998927 None] Lock "cinder-9c94308d-f5c8-4a1c-9fd3-eedf373f1b20" released by "attach_volume" :: held 0.168s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:43:22 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-59a27208-3aba-448b-bff7-ed023e98297b tempest-VolumesActionsTest-1906998927 None] Acquiring lock "cinder-9c94308d-f5c8-4a1c-9fd3-eedf373f1b20-detach_volume" by "detach_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:43:22 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-59a27208-3aba-448b-bff7-ed023e98297b tempest-VolumesActionsTest-1906998927 None] Lock "cinder-9c94308d-f5c8-4a1c-9fd3-eedf373f1b20-detach_volume" acquired by "detach_volume" :: waited 0.029s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:43:22 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-59a27208-3aba-448b-bff7-ed023e98297b tempest-VolumesActionsTest-1906998927 None] Detaching volume 9c94308d-f5c8-4a1c-9fd3-eedf373f1b20 from instance 4a260a19-50c6-41c3-ad27-3c33a0bab1c8.
Jul 09 14:43:22 devstack sudo[99625]: pam_unix(sudo:session): session closed for user root
Jul 09 14:43:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0d97ca62-01d6-47d8-9388-c8ba9c89064b tempest-CreateVolumesFromSnapshotTest-1270352026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bd5b127a-53e1-432e-b516-ec75931bfee9" returned: 0 in 1.104s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:43:22 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-0d97ca62-01d6-47d8-9388-c8ba9c89064b tempest-CreateVolumesFromSnapshotTest-1270352026 None] <== create_volume: return (2393ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:43:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0d97ca62-01d6-47d8-9388-c8ba9c89064b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.398s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:43:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-75b7fec1-0fa8-4c50-842a-2732e399d94b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.731s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:43:22 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-75b7fec1-0fa8-4c50-842a-2732e399d94b tempest-CreateVolumesFromSnapshotTest-1270352026 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:43:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-349360560',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cc70d9b-1092-4022-a46b-c8143c2799a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcc84d3f22f74b258ac93ff6f3f8eb32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:43:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:43:16Z,use_quota=True,user_id='7b7e2ba8b4d44a71951bae570658fa00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:43:22 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-75b7fec1-0fa8-4c50-842a-2732e399d94b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Creating volume 1cc70d9b-1092-4022-a46b-c8143c2799a6 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:43:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-75b7fec1-0fa8-4c50-842a-2732e399d94b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:43:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-75b7fec1-0fa8-4c50-842a-2732e399d94b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:43:22 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-75b7fec1-0fa8-4c50-842a-2732e399d94b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:43:22 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-75b7fec1-0fa8-4c50-842a-2732e399d94b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:43:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-75b7fec1-0fa8-4c50-842a-2732e399d94b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:43:22 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-75b7fec1-0fa8-4c50-842a-2732e399d94b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:43:22 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-75b7fec1-0fa8-4c50-842a-2732e399d94b tempest-CreateVolumesFromSnapshotTest-1270352026 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:43:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-75b7fec1-0fa8-4c50-842a-2732e399d94b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1cc70d9b-1092-4022-a46b-c8143c2799a6 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:43:22 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-59a27208-3aba-448b-bff7-ed023e98297b tempest-VolumesActionsTest-1906998927 None] Detach volume completed successfully.
Jul 09 14:43:22 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-59a27208-3aba-448b-bff7-ed023e98297b tempest-VolumesActionsTest-1906998927 None] Lock "cinder-9c94308d-f5c8-4a1c-9fd3-eedf373f1b20-detach_volume" released by "detach_volume" :: held 0.121s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:43:22 devstack sudo[99630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1cc70d9b-1092-4022-a46b-c8143c2799a6 1073741824
Jul 09 14:43:22 devstack sudo[99630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:43:22 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0d97ca62-01d6-47d8-9388-c8ba9c89064b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (483122a9-02bf-4073-a247-ce24883ffb95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd5b127a-53e1-432e-b516-ec75931bfee9', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:43:22 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0d97ca62-01d6-47d8-9388-c8ba9c89064b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2fefbac-24a3-41b7-b27c-dc34c573d2e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:43:22 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-0d97ca62-01d6-47d8-9388-c8ba9c89064b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Volume volume-bd5b127a-53e1-432e-b516-ec75931bfee9 (bd5b127a-53e1-432e-b516-ec75931bfee9): created successfully
Jul 09 14:43:22 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0d97ca62-01d6-47d8-9388-c8ba9c89064b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2fefbac-24a3-41b7-b27c-dc34c573d2e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:43:22 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0d97ca62-01d6-47d8-9388-c8ba9c89064b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Flow 'volume_create_manager' (b44a50cb-6479-4420-9537-156ee2bfca32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:43:22 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-0d97ca62-01d6-47d8-9388-c8ba9c89064b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Created volume successfully.
Jul 09 14:43:23 devstack sudo[99630]: pam_unix(sudo:session): session closed for user root
Jul 09 14:43:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-75b7fec1-0fa8-4c50-842a-2732e399d94b tempest-CreateVolumesFromSnapshotTest-1270352026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1cc70d9b-1092-4022-a46b-c8143c2799a6 1073741824" returned: 0 in 1.168s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:43:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-75b7fec1-0fa8-4c50-842a-2732e399d94b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1cc70d9b-1092-4022-a46b-c8143c2799a6 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:43:23 devstack sudo[99636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1cc70d9b-1092-4022-a46b-c8143c2799a6
Jul 09 14:43:23 devstack sudo[99636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:43:24 devstack sudo[99636]: pam_unix(sudo:session): session closed for user root
Jul 09 14:43:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-75b7fec1-0fa8-4c50-842a-2732e399d94b tempest-CreateVolumesFromSnapshotTest-1270352026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1cc70d9b-1092-4022-a46b-c8143c2799a6" returned: 0 in 0.728s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:43:24 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-75b7fec1-0fa8-4c50-842a-2732e399d94b tempest-CreateVolumesFromSnapshotTest-1270352026 None] <== create_volume: return (1940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:43:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-75b7fec1-0fa8-4c50-842a-2732e399d94b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.943s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:43:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-bc68a2ac-74d5-478c-bf69-aa1ea911e47b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.798s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:43:24 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-bc68a2ac-74d5-478c-bf69-aa1ea911e47b tempest-CreateVolumesFromSnapshotTest-1270352026 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:43:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-198105716',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8c46a1e-ab93-4c10-ac43-1082f24d629b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcc84d3f22f74b258ac93ff6f3f8eb32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:43:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:43:16Z,use_quota=True,user_id='7b7e2ba8b4d44a71951bae570658fa00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:43:24 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-bc68a2ac-74d5-478c-bf69-aa1ea911e47b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Creating volume d8c46a1e-ab93-4c10-ac43-1082f24d629b {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:43:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-bc68a2ac-74d5-478c-bf69-aa1ea911e47b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:43:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-bc68a2ac-74d5-478c-bf69-aa1ea911e47b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:43:24 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-bc68a2ac-74d5-478c-bf69-aa1ea911e47b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:43:24 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-bc68a2ac-74d5-478c-bf69-aa1ea911e47b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:43:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-bc68a2ac-74d5-478c-bf69-aa1ea911e47b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:43:24 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-bc68a2ac-74d5-478c-bf69-aa1ea911e47b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:43:24 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-bc68a2ac-74d5-478c-bf69-aa1ea911e47b tempest-CreateVolumesFromSnapshotTest-1270352026 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:43:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-bc68a2ac-74d5-478c-bf69-aa1ea911e47b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d8c46a1e-ab93-4c10-ac43-1082f24d629b 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:43:24 devstack sudo[99640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d8c46a1e-ab93-4c10-ac43-1082f24d629b 1073741824
Jul 09 14:43:24 devstack sudo[99640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:43:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-75b7fec1-0fa8-4c50-842a-2732e399d94b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c2584fa-da02-4116-a122-52cb2fbbb8ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cc70d9b-1092-4022-a46b-c8143c2799a6', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:43:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-75b7fec1-0fa8-4c50-842a-2732e399d94b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a1cdde0-f08a-4710-ba47-f7c90941dbcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:43:24 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-75b7fec1-0fa8-4c50-842a-2732e399d94b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Volume volume-1cc70d9b-1092-4022-a46b-c8143c2799a6 (1cc70d9b-1092-4022-a46b-c8143c2799a6): created successfully
Jul 09 14:43:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-75b7fec1-0fa8-4c50-842a-2732e399d94b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a1cdde0-f08a-4710-ba47-f7c90941dbcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:43:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-75b7fec1-0fa8-4c50-842a-2732e399d94b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Flow 'volume_create_manager' (93ecc873-2077-4199-bab2-2a8d4f473098) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:43:24 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-75b7fec1-0fa8-4c50-842a-2732e399d94b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Created volume successfully.
Jul 09 14:43:25 devstack sudo[99640]: pam_unix(sudo:session): session closed for user root
Jul 09 14:43:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-bc68a2ac-74d5-478c-bf69-aa1ea911e47b tempest-CreateVolumesFromSnapshotTest-1270352026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d8c46a1e-ab93-4c10-ac43-1082f24d629b 1073741824" returned: 0 in 1.197s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:43:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-bc68a2ac-74d5-478c-bf69-aa1ea911e47b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d8c46a1e-ab93-4c10-ac43-1082f24d629b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:43:25 devstack sudo[99665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d8c46a1e-ab93-4c10-ac43-1082f24d629b
Jul 09 14:43:25 devstack sudo[99665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:43:26 devstack sudo[99665]: pam_unix(sudo:session): session closed for user root
Jul 09 14:43:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-bc68a2ac-74d5-478c-bf69-aa1ea911e47b tempest-CreateVolumesFromSnapshotTest-1270352026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d8c46a1e-ab93-4c10-ac43-1082f24d629b" returned: 0 in 0.812s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:43:26 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-bc68a2ac-74d5-478c-bf69-aa1ea911e47b tempest-CreateVolumesFromSnapshotTest-1270352026 None] <== create_volume: return (2059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:43:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-bc68a2ac-74d5-478c-bf69-aa1ea911e47b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.062s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:43:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-90655e25-1ac2-49f8-9395-43ffb74bcfc9 tempest-VolumesActionsTest-937364676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.240s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:43:26 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-90655e25-1ac2-49f8-9395-43ffb74bcfc9 tempest-VolumesActionsTest-937364676 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:43:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1437829505',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=701f5f71-867f-4c4b-9524-e5dca0369763,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='522e7febd7b6499d9f39419cabe064ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:43:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:43:20Z,use_quota=True,user_id='3802808ebeb5450cb366087caef84fcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:43:26 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-90655e25-1ac2-49f8-9395-43ffb74bcfc9 tempest-VolumesActionsTest-937364676 None] Creating volume 701f5f71-867f-4c4b-9524-e5dca0369763 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:43:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-90655e25-1ac2-49f8-9395-43ffb74bcfc9 tempest-VolumesActionsTest-937364676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:43:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-90655e25-1ac2-49f8-9395-43ffb74bcfc9 tempest-VolumesActionsTest-937364676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:43:26 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-90655e25-1ac2-49f8-9395-43ffb74bcfc9 tempest-VolumesActionsTest-937364676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:43:26 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-90655e25-1ac2-49f8-9395-43ffb74bcfc9 tempest-VolumesActionsTest-937364676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:43:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-90655e25-1ac2-49f8-9395-43ffb74bcfc9 tempest-VolumesActionsTest-937364676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:43:26 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-90655e25-1ac2-49f8-9395-43ffb74bcfc9 tempest-VolumesActionsTest-937364676 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:43:26 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-90655e25-1ac2-49f8-9395-43ffb74bcfc9 tempest-VolumesActionsTest-937364676 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:43:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-90655e25-1ac2-49f8-9395-43ffb74bcfc9 tempest-VolumesActionsTest-937364676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-701f5f71-867f-4c4b-9524-e5dca0369763 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:43:26 devstack sudo[99669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-701f5f71-867f-4c4b-9524-e5dca0369763 1073741824
Jul 09 14:43:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-bc68a2ac-74d5-478c-bf69-aa1ea911e47b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98a8fff8-e7e6-402f-9115-65e833a97fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8c46a1e-ab93-4c10-ac43-1082f24d629b', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:43:26 devstack sudo[99669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:43:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-bc68a2ac-74d5-478c-bf69-aa1ea911e47b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81750d2c-2c60-4481-9534-6ed8743ce5bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:43:26 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-bc68a2ac-74d5-478c-bf69-aa1ea911e47b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Volume volume-d8c46a1e-ab93-4c10-ac43-1082f24d629b (d8c46a1e-ab93-4c10-ac43-1082f24d629b): created successfully
Jul 09 14:43:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-bc68a2ac-74d5-478c-bf69-aa1ea911e47b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81750d2c-2c60-4481-9534-6ed8743ce5bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:43:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-bc68a2ac-74d5-478c-bf69-aa1ea911e47b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Flow 'volume_create_manager' (717b0c40-96a7-428d-abf6-c9d32145dd8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:43:26 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-bc68a2ac-74d5-478c-bf69-aa1ea911e47b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Created volume successfully.
Jul 09 14:43:26 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-02cfc9cd-df68-4e1a-b38e-a53c98d27a4b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Acquiring lock "cinder-d8c46a1e-ab93-4c10-ac43-1082f24d629b-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:43:26 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-02cfc9cd-df68-4e1a-b38e-a53c98d27a4b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Lock "cinder-d8c46a1e-ab93-4c10-ac43-1082f24d629b-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:43:26 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-02cfc9cd-df68-4e1a-b38e-a53c98d27a4b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Acquiring lock "cinder-quobyte-d8c46a1e-ab93-4c10-ac43-1082f24d629b" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:43:26 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-02cfc9cd-df68-4e1a-b38e-a53c98d27a4b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Lock "cinder-quobyte-d8c46a1e-ab93-4c10-ac43-1082f24d629b" acquired by "delete_volume" :: waited 0.022s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:43:27 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db0f83b-b072-431f-8077-64186a5c5fe7]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:43:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-02cfc9cd-df68-4e1a-b38e-a53c98d27a4b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d8c46a1e-ab93-4c10-ac43-1082f24d629b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:43:27 devstack sudo[99671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d8c46a1e-ab93-4c10-ac43-1082f24d629b
Jul 09 14:43:27 devstack sudo[99671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:43:27 devstack sudo[99669]: pam_unix(sudo:session): session closed for user root
Jul 09 14:43:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-90655e25-1ac2-49f8-9395-43ffb74bcfc9 tempest-VolumesActionsTest-937364676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-701f5f71-867f-4c4b-9524-e5dca0369763 1073741824" returned: 0 in 1.081s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:43:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-90655e25-1ac2-49f8-9395-43ffb74bcfc9 tempest-VolumesActionsTest-937364676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-701f5f71-867f-4c4b-9524-e5dca0369763 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:43:27 devstack sudo[99678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-701f5f71-867f-4c4b-9524-e5dca0369763
Jul 09 14:43:27 devstack sudo[99678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:43:28 devstack sudo[99671]: pam_unix(sudo:session): session closed for user root
Jul 09 14:43:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-02cfc9cd-df68-4e1a-b38e-a53c98d27a4b tempest-CreateVolumesFromSnapshotTest-1270352026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d8c46a1e-ab93-4c10-ac43-1082f24d629b" returned: 0 in 0.992s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:43:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-02cfc9cd-df68-4e1a-b38e-a53c98d27a4b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d8c46a1e-ab93-4c10-ac43-1082f24d629b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:43:28 devstack sudo[99683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d8c46a1e-ab93-4c10-ac43-1082f24d629b
Jul 09 14:43:28 devstack sudo[99683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:43:28 devstack sudo[99678]: pam_unix(sudo:session): session closed for user root
Jul 09 14:43:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-90655e25-1ac2-49f8-9395-43ffb74bcfc9 tempest-VolumesActionsTest-937364676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-701f5f71-867f-4c4b-9524-e5dca0369763" returned: 0 in 0.734s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:43:28 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-90655e25-1ac2-49f8-9395-43ffb74bcfc9 tempest-VolumesActionsTest-937364676 None] <== create_volume: return (1862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:43:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-90655e25-1ac2-49f8-9395-43ffb74bcfc9 tempest-VolumesActionsTest-937364676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.869s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:43:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-90655e25-1ac2-49f8-9395-43ffb74bcfc9 tempest-VolumesActionsTest-937364676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74c207c8-452b-48ab-91bf-3d823c759504) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-701f5f71-867f-4c4b-9524-e5dca0369763', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:43:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-90655e25-1ac2-49f8-9395-43ffb74bcfc9 tempest-VolumesActionsTest-937364676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a217eefa-582b-4f9c-815b-4cfdeb56650c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:43:28 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-90655e25-1ac2-49f8-9395-43ffb74bcfc9 tempest-VolumesActionsTest-937364676 None] Volume volume-701f5f71-867f-4c4b-9524-e5dca0369763 (701f5f71-867f-4c4b-9524-e5dca0369763): created successfully
Jul 09 14:43:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-90655e25-1ac2-49f8-9395-43ffb74bcfc9 tempest-VolumesActionsTest-937364676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a217eefa-582b-4f9c-815b-4cfdeb56650c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:43:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-90655e25-1ac2-49f8-9395-43ffb74bcfc9 tempest-VolumesActionsTest-937364676 None] Flow 'volume_create_manager' (293bd489-d19e-4c7c-b0dc-9eedd8fde98f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:43:28 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-90655e25-1ac2-49f8-9395-43ffb74bcfc9 tempest-VolumesActionsTest-937364676 None] Created volume successfully.
Jul 09 14:43:28 devstack sudo[99683]: pam_unix(sudo:session): session closed for user root
Jul 09 14:43:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-02cfc9cd-df68-4e1a-b38e-a53c98d27a4b tempest-CreateVolumesFromSnapshotTest-1270352026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d8c46a1e-ab93-4c10-ac43-1082f24d629b" returned: 0 in 0.745s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:43:28 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-02cfc9cd-df68-4e1a-b38e-a53c98d27a4b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Lock "cinder-quobyte-d8c46a1e-ab93-4c10-ac43-1082f24d629b" released by "delete_volume" :: held 1.787s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:43:28 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-02cfc9cd-df68-4e1a-b38e-a53c98d27a4b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Created reservations ['8835ca21-245f-4a74-b68e-65c5e6c7e935', 'f44212ad-354a-4140-a50e-cb936a8c6b0c', 'c63c5047-9173-443f-964e-0c0887e90ad9', '0f34b027-1535-4b41-94da-66a7c89f773c'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:43:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-02cfc9cd-df68-4e1a-b38e-a53c98d27a4b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:43:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-02cfc9cd-df68-4e1a-b38e-a53c98d27a4b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:43:28 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-02cfc9cd-df68-4e1a-b38e-a53c98d27a4b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:43:28 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-02cfc9cd-df68-4e1a-b38e-a53c98d27a4b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:43:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-02cfc9cd-df68-4e1a-b38e-a53c98d27a4b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:43:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-02cfc9cd-df68-4e1a-b38e-a53c98d27a4b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:43:28 devstack sudo[99687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:43:28 devstack sudo[99687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:43:29 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-21a3085c-cefb-450f-b59f-9d5b5eb70500 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Acquiring lock "cinder-1cc70d9b-1092-4022-a46b-c8143c2799a6-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:43:29 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-21a3085c-cefb-450f-b59f-9d5b5eb70500 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Lock "cinder-1cc70d9b-1092-4022-a46b-c8143c2799a6-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:43:29 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-21a3085c-cefb-450f-b59f-9d5b5eb70500 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Acquiring lock "cinder-quobyte-1cc70d9b-1092-4022-a46b-c8143c2799a6" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:43:29 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-21a3085c-cefb-450f-b59f-9d5b5eb70500 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Lock "cinder-quobyte-1cc70d9b-1092-4022-a46b-c8143c2799a6" acquired by "delete_volume" :: waited 0.022s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:43:29 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[4761e7f0-ce77-4678-986e-3feb876eab89]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:43:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-21a3085c-cefb-450f-b59f-9d5b5eb70500 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1cc70d9b-1092-4022-a46b-c8143c2799a6 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:43:29 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3ae09761-4c47-48fb-8c07-a4b57c532e02 tempest-VolumesActionsTest-937364676 None] Acquiring lock "cinder-701f5f71-867f-4c4b-9524-e5dca0369763-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:43:29 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3ae09761-4c47-48fb-8c07-a4b57c532e02 tempest-VolumesActionsTest-937364676 None] Lock "cinder-701f5f71-867f-4c4b-9524-e5dca0369763-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:43:29 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3ae09761-4c47-48fb-8c07-a4b57c532e02 tempest-VolumesActionsTest-937364676 None] Acquiring lock "cinder-quobyte-701f5f71-867f-4c4b-9524-e5dca0369763" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:43:29 devstack sudo[99689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1cc70d9b-1092-4022-a46b-c8143c2799a6
Jul 09 14:43:29 devstack sudo[99689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:43:29 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3ae09761-4c47-48fb-8c07-a4b57c532e02 tempest-VolumesActionsTest-937364676 None] Lock "cinder-quobyte-701f5f71-867f-4c4b-9524-e5dca0369763" acquired by "delete_volume" :: waited 0.021s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:43:29 devstack sudo[99687]: pam_unix(sudo:session): session closed for user root
Jul 09 14:43:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-02cfc9cd-df68-4e1a-b38e-a53c98d27a4b tempest-CreateVolumesFromSnapshotTest-1270352026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.815s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:43:29 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-02cfc9cd-df68-4e1a-b38e-a53c98d27a4b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:43:29 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[5981f3d7-bd2f-4863-8da6-7c0ecc046132]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:43:29 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-02cfc9cd-df68-4e1a-b38e-a53c98d27a4b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Deleted volume successfully.
Jul 09 14:43:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3ae09761-4c47-48fb-8c07-a4b57c532e02 tempest-VolumesActionsTest-937364676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-701f5f71-867f-4c4b-9524-e5dca0369763 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:43:29 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-02cfc9cd-df68-4e1a-b38e-a53c98d27a4b tempest-CreateVolumesFromSnapshotTest-1270352026 None] Lock "cinder-d8c46a1e-ab93-4c10-ac43-1082f24d629b-delete_volume" released by "delete_volume" :: held 2.876s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:43:29 devstack sudo[99692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-701f5f71-867f-4c4b-9524-e5dca0369763
Jul 09 14:43:29 devstack sudo[99692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:43:30 devstack sudo[99689]: pam_unix(sudo:session): session closed for user root
Jul 09 14:43:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-21a3085c-cefb-450f-b59f-9d5b5eb70500 tempest-CreateVolumesFromSnapshotTest-1270352026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1cc70d9b-1092-4022-a46b-c8143c2799a6" returned: 0 in 1.099s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:43:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-21a3085c-cefb-450f-b59f-9d5b5eb70500 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1cc70d9b-1092-4022-a46b-c8143c2799a6 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:43:30 devstack sudo[99701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1cc70d9b-1092-4022-a46b-c8143c2799a6
Jul 09 14:43:30 devstack sudo[99701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:43:30 devstack sudo[99692]: pam_unix(sudo:session): session closed for user root
Jul 09 14:43:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3ae09761-4c47-48fb-8c07-a4b57c532e02 tempest-VolumesActionsTest-937364676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-701f5f71-867f-4c4b-9524-e5dca0369763" returned: 0 in 1.046s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:43:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3ae09761-4c47-48fb-8c07-a4b57c532e02 tempest-VolumesActionsTest-937364676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-701f5f71-867f-4c4b-9524-e5dca0369763 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:43:30 devstack sudo[99703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-701f5f71-867f-4c4b-9524-e5dca0369763
Jul 09 14:43:30 devstack sudo[99703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:43:31 devstack sudo[99701]: pam_unix(sudo:session): session closed for user root
Jul 09 14:43:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-21a3085c-cefb-450f-b59f-9d5b5eb70500 tempest-CreateVolumesFromSnapshotTest-1270352026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1cc70d9b-1092-4022-a46b-c8143c2799a6" returned: 0 in 0.786s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:43:31 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-21a3085c-cefb-450f-b59f-9d5b5eb70500 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Lock "cinder-quobyte-1cc70d9b-1092-4022-a46b-c8143c2799a6" released by "delete_volume" :: held 1.954s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:43:31 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-21a3085c-cefb-450f-b59f-9d5b5eb70500 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Created reservations ['4398d34a-d31e-434f-9be1-d4d09cb21975', '3c95b462-abd2-4851-88ba-2b8667d35301', '7f563cdd-addd-4b9e-9688-9e91e5d3eb24', '92797376-f11c-4ebf-8dbb-787f2cb9eb3d'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:43:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-21a3085c-cefb-450f-b59f-9d5b5eb70500 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:43:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-21a3085c-cefb-450f-b59f-9d5b5eb70500 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:43:31 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-21a3085c-cefb-450f-b59f-9d5b5eb70500 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:43:31 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-21a3085c-cefb-450f-b59f-9d5b5eb70500 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:43:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-21a3085c-cefb-450f-b59f-9d5b5eb70500 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:43:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-21a3085c-cefb-450f-b59f-9d5b5eb70500 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:43:31 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-023ca790-f800-4550-bcb4-b80b0429e155 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Acquiring lock "cinder-bd5b127a-53e1-432e-b516-ec75931bfee9-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:43:31 devstack sudo[99707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:43:31 devstack sudo[99707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:43:31 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-023ca790-f800-4550-bcb4-b80b0429e155 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Lock "cinder-bd5b127a-53e1-432e-b516-ec75931bfee9-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:43:31 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-023ca790-f800-4550-bcb4-b80b0429e155 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Acquiring lock "cinder-quobyte-bd5b127a-53e1-432e-b516-ec75931bfee9" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:43:31 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-023ca790-f800-4550-bcb4-b80b0429e155 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Lock "cinder-quobyte-bd5b127a-53e1-432e-b516-ec75931bfee9" acquired by "delete_volume" :: waited 0.045s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:43:31 devstack sudo[99703]: pam_unix(sudo:session): session closed for user root
Jul 09 14:43:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3ae09761-4c47-48fb-8c07-a4b57c532e02 tempest-VolumesActionsTest-937364676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-701f5f71-867f-4c4b-9524-e5dca0369763" returned: 0 in 1.096s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:43:31 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[a61bd1bd-d5d1-4ea8-90ba-55c79866a2ec]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:43:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-023ca790-f800-4550-bcb4-b80b0429e155 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bd5b127a-53e1-432e-b516-ec75931bfee9 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:43:31 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3ae09761-4c47-48fb-8c07-a4b57c532e02 tempest-VolumesActionsTest-937364676 None] Lock "cinder-quobyte-701f5f71-867f-4c4b-9524-e5dca0369763" released by "delete_volume" :: held 2.250s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:43:32 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-3ae09761-4c47-48fb-8c07-a4b57c532e02 tempest-VolumesActionsTest-937364676 None] Created reservations ['2ad1d769-b2bf-4288-942d-13561175b8d7', 'd38a1dc3-82e6-4bb5-ac34-06fc8e46b9bd', '843a5f2b-10bc-4f33-abda-2b7775ecd29f', 'a472f280-5fd6-48d6-b5bf-5f00cab82975'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:43:32 devstack sudo[99709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bd5b127a-53e1-432e-b516-ec75931bfee9
Jul 09 14:43:32 devstack sudo[99709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:43:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3ae09761-4c47-48fb-8c07-a4b57c532e02 tempest-VolumesActionsTest-937364676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:43:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3ae09761-4c47-48fb-8c07-a4b57c532e02 tempest-VolumesActionsTest-937364676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:43:32 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3ae09761-4c47-48fb-8c07-a4b57c532e02 tempest-VolumesActionsTest-937364676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:43:32 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3ae09761-4c47-48fb-8c07-a4b57c532e02 tempest-VolumesActionsTest-937364676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:43:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3ae09761-4c47-48fb-8c07-a4b57c532e02 tempest-VolumesActionsTest-937364676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:43:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3ae09761-4c47-48fb-8c07-a4b57c532e02 tempest-VolumesActionsTest-937364676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:43:32 devstack sudo[99711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:43:32 devstack sudo[99711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:43:32 devstack sudo[99707]: pam_unix(sudo:session): session closed for user root
Jul 09 14:43:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-21a3085c-cefb-450f-b59f-9d5b5eb70500 tempest-CreateVolumesFromSnapshotTest-1270352026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 1.097s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:43:32 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-21a3085c-cefb-450f-b59f-9d5b5eb70500 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:43:32 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-21a3085c-cefb-450f-b59f-9d5b5eb70500 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Deleted volume successfully.
Jul 09 14:43:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-899ade91-3ddd-4440-a867-4b32907b2154 tempest-VolumesActionsTest-1906998927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:43:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-899ade91-3ddd-4440-a867-4b32907b2154 tempest-VolumesActionsTest-1906998927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:43:32 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-21a3085c-cefb-450f-b59f-9d5b5eb70500 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Lock "cinder-1cc70d9b-1092-4022-a46b-c8143c2799a6-delete_volume" released by "delete_volume" :: held 3.422s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:43:32 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[350d31b6-669a-4df3-b7ef-19d4d30860c2]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:43:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-899ade91-3ddd-4440-a867-4b32907b2154 tempest-VolumesActionsTest-1906998927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-9c94308d-f5c8-4a1c-9fd3-eedf373f1b20 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:43:32 devstack sudo[99717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-9c94308d-f5c8-4a1c-9fd3-eedf373f1b20
Jul 09 14:43:32 devstack sudo[99717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:43:33 devstack sudo[99709]: pam_unix(sudo:session): session closed for user root
Jul 09 14:43:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-023ca790-f800-4550-bcb4-b80b0429e155 tempest-CreateVolumesFromSnapshotTest-1270352026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bd5b127a-53e1-432e-b516-ec75931bfee9" returned: 0 in 1.135s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:43:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-023ca790-f800-4550-bcb4-b80b0429e155 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bd5b127a-53e1-432e-b516-ec75931bfee9 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:43:33 devstack sudo[99711]: pam_unix(sudo:session): session closed for user root
Jul 09 14:43:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3ae09761-4c47-48fb-8c07-a4b57c532e02 tempest-VolumesActionsTest-937364676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.894s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:43:33 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-3ae09761-4c47-48fb-8c07-a4b57c532e02 tempest-VolumesActionsTest-937364676 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:43:33 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-3ae09761-4c47-48fb-8c07-a4b57c532e02 tempest-VolumesActionsTest-937364676 None] Deleted volume successfully.
Jul 09 14:43:33 devstack sudo[99720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bd5b127a-53e1-432e-b516-ec75931bfee9
Jul 09 14:43:33 devstack sudo[99720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:43:33 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3ae09761-4c47-48fb-8c07-a4b57c532e02 tempest-VolumesActionsTest-937364676 None] Lock "cinder-701f5f71-867f-4c4b-9524-e5dca0369763-delete_volume" released by "delete_volume" :: held 3.523s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:43:33 devstack sudo[99717]: pam_unix(sudo:session): session closed for user root
Jul 09 14:43:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-899ade91-3ddd-4440-a867-4b32907b2154 tempest-VolumesActionsTest-1906998927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-9c94308d-f5c8-4a1c-9fd3-eedf373f1b20" returned: 0 in 1.126s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:43:34 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5726495-6b3d-4c05-8c4f-67ac5833b915]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:43:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-899ade91-3ddd-4440-a867-4b32907b2154 tempest-VolumesActionsTest-1906998927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-9c94308d-f5c8-4a1c-9fd3-eedf373f1b20 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:43:34 devstack sudo[99720]: pam_unix(sudo:session): session closed for user root
Jul 09 14:43:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-023ca790-f800-4550-bcb4-b80b0429e155 tempest-CreateVolumesFromSnapshotTest-1270352026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bd5b127a-53e1-432e-b516-ec75931bfee9" returned: 0 in 0.999s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:43:34 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-023ca790-f800-4550-bcb4-b80b0429e155 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Lock "cinder-quobyte-bd5b127a-53e1-432e-b516-ec75931bfee9" released by "delete_volume" :: held 2.234s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:43:34 devstack sudo[99726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-9c94308d-f5c8-4a1c-9fd3-eedf373f1b20
Jul 09 14:43:34 devstack sudo[99726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:43:34 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-023ca790-f800-4550-bcb4-b80b0429e155 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Created reservations ['ec87d05e-8b64-4de0-a6e7-46538c4e04b4', 'eaf786b6-493e-477f-ade4-84d7fc609297', '479cde64-d60c-4b4f-a1ad-e773c756269a', 'baaacec9-9d28-463b-8375-0f93269bc0a6'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:43:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-023ca790-f800-4550-bcb4-b80b0429e155 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:43:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-023ca790-f800-4550-bcb4-b80b0429e155 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:43:34 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-023ca790-f800-4550-bcb4-b80b0429e155 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:43:34 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-023ca790-f800-4550-bcb4-b80b0429e155 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:43:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-023ca790-f800-4550-bcb4-b80b0429e155 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:43:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-023ca790-f800-4550-bcb4-b80b0429e155 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:43:34 devstack sudo[99728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:43:34 devstack sudo[99728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:43:34 devstack sudo[99726]: pam_unix(sudo:session): session closed for user root
Jul 09 14:43:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-899ade91-3ddd-4440-a867-4b32907b2154 tempest-VolumesActionsTest-1906998927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-9c94308d-f5c8-4a1c-9fd3-eedf373f1b20" returned: 0 in 0.983s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:43:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-899ade91-3ddd-4440-a867-4b32907b2154 tempest-VolumesActionsTest-1906998927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-9c94308d-f5c8-4a1c-9fd3-eedf373f1b20 /opt/stack/data/cinder/conversion/9c94308d-f5c8-4a1c-9fd3-eedf373f1b20.temp_image.8213f7e2-68f5-4dbf-bfe8-df8912b7dff4no1ujd1n.img {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:43:35 devstack sudo[99734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-9c94308d-f5c8-4a1c-9fd3-eedf373f1b20 /opt/stack/data/cinder/conversion/9c94308d-f5c8-4a1c-9fd3-eedf373f1b20.temp_image.8213f7e2-68f5-4dbf-bfe8-df8912b7dff4no1ujd1n.img
Jul 09 14:43:35 devstack sudo[99734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:43:35 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e2aa36cd-7039-4ea9-a7ef-85cf6c885f12 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Acquiring lock "cinder-c39f3c2f-1ade-47fa-877b-0b4d1c7bcee8-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:43:35 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e2aa36cd-7039-4ea9-a7ef-85cf6c885f12 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Lock "cinder-c39f3c2f-1ade-47fa-877b-0b4d1c7bcee8-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:43:35 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e2aa36cd-7039-4ea9-a7ef-85cf6c885f12 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Acquiring lock "cinder-quobyte-c39f3c2f-1ade-47fa-877b-0b4d1c7bcee8" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:43:35 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e2aa36cd-7039-4ea9-a7ef-85cf6c885f12 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Lock "cinder-quobyte-c39f3c2f-1ade-47fa-877b-0b4d1c7bcee8" acquired by "delete_volume" :: waited 0.018s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:43:35 devstack sudo[99728]: pam_unix(sudo:session): session closed for user root
Jul 09 14:43:35 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[c516ebde-ccd2-4785-b4c5-abc05a456cff]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:43:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e2aa36cd-7039-4ea9-a7ef-85cf6c885f12 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-c39f3c2f-1ade-47fa-877b-0b4d1c7bcee8 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:43:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-023ca790-f800-4550-bcb4-b80b0429e155 tempest-CreateVolumesFromSnapshotTest-1270352026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 1.121s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:43:35 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-023ca790-f800-4550-bcb4-b80b0429e155 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:43:35 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-023ca790-f800-4550-bcb4-b80b0429e155 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Deleted volume successfully.
Jul 09 14:43:35 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-023ca790-f800-4550-bcb4-b80b0429e155 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Lock "cinder-bd5b127a-53e1-432e-b516-ec75931bfee9-delete_volume" released by "delete_volume" :: held 3.762s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:43:35 devstack sudo[99737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-c39f3c2f-1ade-47fa-877b-0b4d1c7bcee8
Jul 09 14:43:35 devstack sudo[99737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:43:37 devstack sudo[99737]: pam_unix(sudo:session): session closed for user root
Jul 09 14:43:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e2aa36cd-7039-4ea9-a7ef-85cf6c885f12 tempest-CreateVolumesFromSnapshotTest-1270352026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-c39f3c2f-1ade-47fa-877b-0b4d1c7bcee8" returned: 0 in 1.662s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:43:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e2aa36cd-7039-4ea9-a7ef-85cf6c885f12 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-c39f3c2f-1ade-47fa-877b-0b4d1c7bcee8 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:43:37 devstack sudo[99753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-c39f3c2f-1ade-47fa-877b-0b4d1c7bcee8
Jul 09 14:43:37 devstack sudo[99753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:43:38 devstack sudo[99753]: pam_unix(sudo:session): session closed for user root
Jul 09 14:43:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e2aa36cd-7039-4ea9-a7ef-85cf6c885f12 tempest-CreateVolumesFromSnapshotTest-1270352026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-c39f3c2f-1ade-47fa-877b-0b4d1c7bcee8" returned: 0 in 1.832s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:43:38 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e2aa36cd-7039-4ea9-a7ef-85cf6c885f12 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Lock "cinder-quobyte-c39f3c2f-1ade-47fa-877b-0b4d1c7bcee8" released by "delete_volume" :: held 3.583s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:43:39 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-e2aa36cd-7039-4ea9-a7ef-85cf6c885f12 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Created reservations ['7b2b8a0d-6c9f-4e51-8641-b4e238dab664', '5074b226-d003-4f4a-8afe-e2514779c83d', '4f4794b3-b8ca-42b8-8234-bb0388c37afd', '53d84d92-05bc-48a8-a4bb-da2a35f99cd3'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:43:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e2aa36cd-7039-4ea9-a7ef-85cf6c885f12 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:43:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e2aa36cd-7039-4ea9-a7ef-85cf6c885f12 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:43:39 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-e2aa36cd-7039-4ea9-a7ef-85cf6c885f12 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:43:39 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-e2aa36cd-7039-4ea9-a7ef-85cf6c885f12 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:43:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e2aa36cd-7039-4ea9-a7ef-85cf6c885f12 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:43:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e2aa36cd-7039-4ea9-a7ef-85cf6c885f12 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:43:39 devstack sudo[99756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:43:39 devstack sudo[99756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:43:40 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1a540ec0-b56d-426b-8b4f-31d20b235c6f tempest-CreateVolumesFromSnapshotTest-1270352026 None] Acquiring lock "cinder-823621c1-f07e-4abd-8cae-155c6d1e5854-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:43:40 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1a540ec0-b56d-426b-8b4f-31d20b235c6f tempest-CreateVolumesFromSnapshotTest-1270352026 None] Lock "cinder-823621c1-f07e-4abd-8cae-155c6d1e5854-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:43:40 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1a540ec0-b56d-426b-8b4f-31d20b235c6f tempest-CreateVolumesFromSnapshotTest-1270352026 None] Acquiring lock "cinder-quobyte-823621c1-f07e-4abd-8cae-155c6d1e5854" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:43:40 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1a540ec0-b56d-426b-8b4f-31d20b235c6f tempest-CreateVolumesFromSnapshotTest-1270352026 None] Lock "cinder-quobyte-823621c1-f07e-4abd-8cae-155c6d1e5854" acquired by "delete_volume" :: waited 0.032s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:43:40 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[12bf0634-318d-4e92-a4db-576c832fb97a]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:43:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1a540ec0-b56d-426b-8b4f-31d20b235c6f tempest-CreateVolumesFromSnapshotTest-1270352026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-823621c1-f07e-4abd-8cae-155c6d1e5854 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:43:40 devstack sudo[99759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-823621c1-f07e-4abd-8cae-155c6d1e5854
Jul 09 14:43:40 devstack sudo[99759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:43:41 devstack sudo[99756]: pam_unix(sudo:session): session closed for user root
Jul 09 14:43:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e2aa36cd-7039-4ea9-a7ef-85cf6c885f12 tempest-CreateVolumesFromSnapshotTest-1270352026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 1.870s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:43:41 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-e2aa36cd-7039-4ea9-a7ef-85cf6c885f12 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:43:41 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-e2aa36cd-7039-4ea9-a7ef-85cf6c885f12 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Deleted volume successfully.
Jul 09 14:43:41 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e2aa36cd-7039-4ea9-a7ef-85cf6c885f12 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Lock "cinder-c39f3c2f-1ade-47fa-877b-0b4d1c7bcee8-delete_volume" released by "delete_volume" :: held 6.063s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:43:42 devstack sudo[99734]: pam_unix(sudo:session): session closed for user root
Jul 09 14:43:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-899ade91-3ddd-4440-a867-4b32907b2154 tempest-VolumesActionsTest-1906998927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-9c94308d-f5c8-4a1c-9fd3-eedf373f1b20 /opt/stack/data/cinder/conversion/9c94308d-f5c8-4a1c-9fd3-eedf373f1b20.temp_image.8213f7e2-68f5-4dbf-bfe8-df8912b7dff4no1ujd1n.img" returned: 0 in 7.331s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:43:42 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[041774a0-afdc-4ddb-b389-69a2ab2915a7]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:43:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-899ade91-3ddd-4440-a867-4b32907b2154 tempest-VolumesActionsTest-1906998927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-9c94308d-f5c8-4a1c-9fd3-eedf373f1b20 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:43:42 devstack sudo[99759]: pam_unix(sudo:session): session closed for user root
Jul 09 14:43:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1a540ec0-b56d-426b-8b4f-31d20b235c6f tempest-CreateVolumesFromSnapshotTest-1270352026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-823621c1-f07e-4abd-8cae-155c6d1e5854" returned: 0 in 1.892s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:43:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1a540ec0-b56d-426b-8b4f-31d20b235c6f tempest-CreateVolumesFromSnapshotTest-1270352026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-823621c1-f07e-4abd-8cae-155c6d1e5854 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:43:42 devstack sudo[99802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-823621c1-f07e-4abd-8cae-155c6d1e5854
Jul 09 14:43:42 devstack sudo[99802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:43:42 devstack sudo[99800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-9c94308d-f5c8-4a1c-9fd3-eedf373f1b20
Jul 09 14:43:42 devstack sudo[99800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:43:43 devstack sudo[99802]: pam_unix(sudo:session): session closed for user root
Jul 09 14:43:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1a540ec0-b56d-426b-8b4f-31d20b235c6f tempest-CreateVolumesFromSnapshotTest-1270352026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-823621c1-f07e-4abd-8cae-155c6d1e5854" returned: 0 in 0.891s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:43:43 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1a540ec0-b56d-426b-8b4f-31d20b235c6f tempest-CreateVolumesFromSnapshotTest-1270352026 None] Lock "cinder-quobyte-823621c1-f07e-4abd-8cae-155c6d1e5854" released by "delete_volume" :: held 2.933s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:43:43 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-1a540ec0-b56d-426b-8b4f-31d20b235c6f tempest-CreateVolumesFromSnapshotTest-1270352026 None] Created reservations ['2d507f2f-2326-4579-8187-9c17f48a5989', '800bcc2a-9194-4fc3-bd20-547a6b69d3cb', 'a95dbc19-858b-44a8-9163-7b19a9a8da15', '173943e5-5ade-4059-8d9a-ade690fd7aa4'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:43:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1a540ec0-b56d-426b-8b4f-31d20b235c6f tempest-CreateVolumesFromSnapshotTest-1270352026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:43:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1a540ec0-b56d-426b-8b4f-31d20b235c6f tempest-CreateVolumesFromSnapshotTest-1270352026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:43:43 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-1a540ec0-b56d-426b-8b4f-31d20b235c6f tempest-CreateVolumesFromSnapshotTest-1270352026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:43:43 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-1a540ec0-b56d-426b-8b4f-31d20b235c6f tempest-CreateVolumesFromSnapshotTest-1270352026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:43:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1a540ec0-b56d-426b-8b4f-31d20b235c6f tempest-CreateVolumesFromSnapshotTest-1270352026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:43:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1a540ec0-b56d-426b-8b4f-31d20b235c6f tempest-CreateVolumesFromSnapshotTest-1270352026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:43:43 devstack sudo[99810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:43:43 devstack sudo[99810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:43:43 devstack sudo[99800]: pam_unix(sudo:session): session closed for user root
Jul 09 14:43:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-899ade91-3ddd-4440-a867-4b32907b2154 tempest-VolumesActionsTest-1906998927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-9c94308d-f5c8-4a1c-9fd3-eedf373f1b20" returned: 0 in 1.337s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:43:43 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-899ade91-3ddd-4440-a867-4b32907b2154 tempest-VolumesActionsTest-1906998927 None] Image conversion details: src /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-9c94308d-f5c8-4a1c-9fd3-eedf373f1b20, size 1024.00 MB, duration 7.33 sec, destination /opt/stack/data/cinder/conversion/9c94308d-f5c8-4a1c-9fd3-eedf373f1b20.temp_image.8213f7e2-68f5-4dbf-bfe8-df8912b7dff4no1ujd1n.img {{(pid=87230) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 09 14:43:43 devstack cinder-volume[87230]: INFO cinder.image.image_utils [None req-899ade91-3ddd-4440-a867-4b32907b2154 tempest-VolumesActionsTest-1906998927 None] Converted 1024.00 MB image at 139.65 MB/s
Jul 09 14:43:43 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-899ade91-3ddd-4440-a867-4b32907b2154 tempest-VolumesActionsTest-1906998927 None] 8213f7e2-68f5-4dbf-bfe8-df8912b7dff4 was raw, no need to convert to raw {{(pid=87230) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}}
Jul 09 14:43:43 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-36ed46d6-f45d-43df-82b7-cfd8c5a27c45 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Acquiring lock "cinder-4c4f53fb-3933-438d-9e66-a1237f0c20c3-delete_snapshot" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:43:43 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-36ed46d6-f45d-43df-82b7-cfd8c5a27c45 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Lock "cinder-4c4f53fb-3933-438d-9e66-a1237f0c20c3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:43:43 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-36ed46d6-f45d-43df-82b7-cfd8c5a27c45 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Acquiring lock "cinder-quobyte-0368cc57-b3a4-4022-8890-ebb1d9b3e014" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:43:43 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-36ed46d6-f45d-43df-82b7-cfd8c5a27c45 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Lock "cinder-quobyte-0368cc57-b3a4-4022-8890-ebb1d9b3e014" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:43:43 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-36ed46d6-f45d-43df-82b7-cfd8c5a27c45 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Acquiring lock "cinder-quobyte-4c4f53fb-3933-438d-9e66-a1237f0c20c3" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:43:43 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-36ed46d6-f45d-43df-82b7-cfd8c5a27c45 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Lock "cinder-quobyte-4c4f53fb-3933-438d-9e66-a1237f0c20c3" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:43:44 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-36ed46d6-f45d-43df-82b7-cfd8c5a27c45 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Deleting offline snapshot 4c4f53fb-3933-438d-9e66-a1237f0c20c3 of volume 0368cc57-b3a4-4022-8890-ebb1d9b3e014 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 14:43:44 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-36ed46d6-f45d-43df-82b7-cfd8c5a27c45 tempest-CreateVolumesFromSnapshotTest-1270352026 None] snapshot_file for this snap is: volume-0368cc57-b3a4-4022-8890-ebb1d9b3e014.4c4f53fb-3933-438d-9e66-a1237f0c20c3 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 14:43:44 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[645b080a-6c0f-48f2-80b8-618b35e69978]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:43:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-36ed46d6-f45d-43df-82b7-cfd8c5a27c45 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0368cc57-b3a4-4022-8890-ebb1d9b3e014.4c4f53fb-3933-438d-9e66-a1237f0c20c3 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:43:44 devstack sudo[99812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0368cc57-b3a4-4022-8890-ebb1d9b3e014.4c4f53fb-3933-438d-9e66-a1237f0c20c3
Jul 09 14:43:44 devstack sudo[99812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:43:44 devstack sudo[99810]: pam_unix(sudo:session): session closed for user root
Jul 09 14:43:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1a540ec0-b56d-426b-8b4f-31d20b235c6f tempest-CreateVolumesFromSnapshotTest-1270352026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 1.092s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:43:44 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-1a540ec0-b56d-426b-8b4f-31d20b235c6f tempest-CreateVolumesFromSnapshotTest-1270352026 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:43:44 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-1a540ec0-b56d-426b-8b4f-31d20b235c6f tempest-CreateVolumesFromSnapshotTest-1270352026 None] Deleted volume successfully.
Jul 09 14:43:44 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1a540ec0-b56d-426b-8b4f-31d20b235c6f tempest-CreateVolumesFromSnapshotTest-1270352026 None] Lock "cinder-823621c1-f07e-4abd-8cae-155c6d1e5854-delete_volume" released by "delete_volume" :: held 4.418s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:43:45 devstack sudo[99812]: pam_unix(sudo:session): session closed for user root
Jul 09 14:43:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-36ed46d6-f45d-43df-82b7-cfd8c5a27c45 tempest-CreateVolumesFromSnapshotTest-1270352026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0368cc57-b3a4-4022-8890-ebb1d9b3e014.4c4f53fb-3933-438d-9e66-a1237f0c20c3" returned: 0 in 1.059s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:43:45 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-36ed46d6-f45d-43df-82b7-cfd8c5a27c45 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0368cc57-b3a4-4022-8890-ebb1d9b3e014(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 14:43:45 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[775e423f-981e-4035-bea9-a29e7bced943]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:43:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-36ed46d6-f45d-43df-82b7-cfd8c5a27c45 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0368cc57-b3a4-4022-8890-ebb1d9b3e014 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:43:45 devstack sudo[99819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0368cc57-b3a4-4022-8890-ebb1d9b3e014
Jul 09 14:43:45 devstack sudo[99819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:43:46 devstack sudo[99819]: pam_unix(sudo:session): session closed for user root
Jul 09 14:43:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-36ed46d6-f45d-43df-82b7-cfd8c5a27c45 tempest-CreateVolumesFromSnapshotTest-1270352026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0368cc57-b3a4-4022-8890-ebb1d9b3e014" returned: 0 in 1.070s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:43:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-36ed46d6-f45d-43df-82b7-cfd8c5a27c45 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0368cc57-b3a4-4022-8890-ebb1d9b3e014.4c4f53fb-3933-438d-9e66-a1237f0c20c3 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:43:46 devstack sudo[99824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0368cc57-b3a4-4022-8890-ebb1d9b3e014.4c4f53fb-3933-438d-9e66-a1237f0c20c3
Jul 09 14:43:46 devstack sudo[99824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:43:47 devstack sudo[99824]: pam_unix(sudo:session): session closed for user root
Jul 09 14:43:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-36ed46d6-f45d-43df-82b7-cfd8c5a27c45 tempest-CreateVolumesFromSnapshotTest-1270352026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0368cc57-b3a4-4022-8890-ebb1d9b3e014.4c4f53fb-3933-438d-9e66-a1237f0c20c3" returned: 0 in 1.266s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:43:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-36ed46d6-f45d-43df-82b7-cfd8c5a27c45 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0368cc57-b3a4-4022-8890-ebb1d9b3e014.4c4f53fb-3933-438d-9e66-a1237f0c20c3 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:43:47 devstack sudo[99830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0368cc57-b3a4-4022-8890-ebb1d9b3e014.4c4f53fb-3933-438d-9e66-a1237f0c20c3
Jul 09 14:43:47 devstack sudo[99830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:43:48 devstack sudo[99830]: pam_unix(sudo:session): session closed for user root
Jul 09 14:43:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-36ed46d6-f45d-43df-82b7-cfd8c5a27c45 tempest-CreateVolumesFromSnapshotTest-1270352026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0368cc57-b3a4-4022-8890-ebb1d9b3e014.4c4f53fb-3933-438d-9e66-a1237f0c20c3" returned: 0 in 0.972s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:43:48 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-36ed46d6-f45d-43df-82b7-cfd8c5a27c45 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Lock "cinder-quobyte-4c4f53fb-3933-438d-9e66-a1237f0c20c3" released by "_delete_snapshot" :: held 4.581s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:43:48 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-36ed46d6-f45d-43df-82b7-cfd8c5a27c45 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Lock "cinder-quobyte-0368cc57-b3a4-4022-8890-ebb1d9b3e014" released by "delete_snapshot" :: held 4.632s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:43:48 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-36ed46d6-f45d-43df-82b7-cfd8c5a27c45 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Created reservations ['a8fc563e-de3c-44c5-80f9-ce75177ded83', 'ae5f9f75-747e-4ec2-be6e-8d16f692139c', '93a75d67-1a09-4998-89e1-d5e19ba81491', '9c0d5179-3f13-46db-926e-1cd1d5957019'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:43:48 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-36ed46d6-f45d-43df-82b7-cfd8c5a27c45 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Delete snapshot completed successfully.
Jul 09 14:43:48 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-36ed46d6-f45d-43df-82b7-cfd8c5a27c45 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Lock "cinder-4c4f53fb-3933-438d-9e66-a1237f0c20c3-delete_snapshot" released by "delete_snapshot" :: held 4.796s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:43:49 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-676b4449-8f40-4f41-ae86-67e48d9adfa6 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Acquiring lock "cinder-0368cc57-b3a4-4022-8890-ebb1d9b3e014-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:43:49 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-676b4449-8f40-4f41-ae86-67e48d9adfa6 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Lock "cinder-0368cc57-b3a4-4022-8890-ebb1d9b3e014-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:43:49 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-676b4449-8f40-4f41-ae86-67e48d9adfa6 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Acquiring lock "cinder-quobyte-0368cc57-b3a4-4022-8890-ebb1d9b3e014" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:43:49 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-676b4449-8f40-4f41-ae86-67e48d9adfa6 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Lock "cinder-quobyte-0368cc57-b3a4-4022-8890-ebb1d9b3e014" acquired by "delete_volume" :: waited 0.027s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:43:49 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[58cd564c-bf24-4dcf-988e-50a32aeb1902]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:43:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-676b4449-8f40-4f41-ae86-67e48d9adfa6 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0368cc57-b3a4-4022-8890-ebb1d9b3e014 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:43:49 devstack sudo[99834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0368cc57-b3a4-4022-8890-ebb1d9b3e014
Jul 09 14:43:49 devstack sudo[99834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:43:50 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-d51b2cdb-a41c-4448-97cc-4a63e92a7727 tempest-TestShelveInstance-1427794981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:43:50 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d51b2cdb-a41c-4448-97cc-4a63e92a7727 tempest-TestShelveInstance-1427794981 None] Flow 'volume_create_manager' (701d4866-c203-4b8d-96dd-155cb44dfa94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:43:50 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d51b2cdb-a41c-4448-97cc-4a63e92a7727 tempest-TestShelveInstance-1427794981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cff60b15-72b3-438b-a1b3-fbfb38cfc808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:43:50 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d51b2cdb-a41c-4448-97cc-4a63e92a7727 tempest-TestShelveInstance-1427794981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cff60b15-72b3-438b-a1b3-fbfb38cfc808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:43:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-335716710',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cda2942f-b3a7-4c7a-a361-bd744f42b5b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c01606ea586403fb4da6666c2c0c082',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:43:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:43:50Z,use_quota=True,user_id='c193850d5cee405082c364988b5a20f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:43:50 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d51b2cdb-a41c-4448-97cc-4a63e92a7727 tempest-TestShelveInstance-1427794981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6db432e-a351-4539-a554-560eb65eff65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:43:50 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d51b2cdb-a41c-4448-97cc-4a63e92a7727 tempest-TestShelveInstance-1427794981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6db432e-a351-4539-a554-560eb65eff65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:43:50 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d51b2cdb-a41c-4448-97cc-4a63e92a7727 tempest-TestShelveInstance-1427794981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53708c91-b598-42d5-bb0f-ddedb0149c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:43:50 devstack cinder-volume[87230]: DEBUG cinder.image.glance [None req-d51b2cdb-a41c-4448-97cc-4a63e92a7727 tempest-TestShelveInstance-1427794981 None] Creating Keystone auth plugin from conf {{(pid=87230) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 09 14:43:50 devstack sudo[99834]: pam_unix(sudo:session): session closed for user root
Jul 09 14:43:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-676b4449-8f40-4f41-ae86-67e48d9adfa6 tempest-CreateVolumesFromSnapshotTest-1270352026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0368cc57-b3a4-4022-8890-ebb1d9b3e014" returned: 0 in 1.173s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:43:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-676b4449-8f40-4f41-ae86-67e48d9adfa6 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0368cc57-b3a4-4022-8890-ebb1d9b3e014 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:43:50 devstack sudo[99840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0368cc57-b3a4-4022-8890-ebb1d9b3e014
Jul 09 14:43:50 devstack sudo[99840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:43:51 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d51b2cdb-a41c-4448-97cc-4a63e92a7727 tempest-TestShelveInstance-1427794981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53708c91-b598-42d5-bb0f-ddedb0149c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cda2942f-b3a7-4c7a-a361-bd744f42b5b2', 'volume_name': 'volume-cda2942f-b3a7-4c7a-a361-bd744f42b5b2', 'volume_size': 1, 'image_id': '5eba314f-9adb-4fc7-aaad-9e9a3b7dae70', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5eba314f-9adb-4fc7-aaad-9e9a3b7dae70', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '10a7640b39774d00a67b2de818bf4a10', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5eba314f-9adb-4fc7-aaad-9e9a3b7dae70', 'created_at': datetime.datetime(2026, 7, 9, 12, 24, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 12, 24, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5eba314f-9adb-4fc7-aaad-9e9a3b7dae70/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x720a54507890>}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:43:51 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d51b2cdb-a41c-4448-97cc-4a63e92a7727 tempest-TestShelveInstance-1427794981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48a72f97-87cb-41d7-8a97-29f8345fe40c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:43:51 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d51b2cdb-a41c-4448-97cc-4a63e92a7727 tempest-TestShelveInstance-1427794981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48a72f97-87cb-41d7-8a97-29f8345fe40c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:43:51 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d51b2cdb-a41c-4448-97cc-4a63e92a7727 tempest-TestShelveInstance-1427794981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00f597c7-b1cf-434b-af4f-c70aa7247acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:43:51 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-d51b2cdb-a41c-4448-97cc-4a63e92a7727 tempest-TestShelveInstance-1427794981 None] Volume cda2942f-b3a7-4c7a-a361-bd744f42b5b2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cda2942f-b3a7-4c7a-a361-bd744f42b5b2', 'volume_size': 1, 'image_id': '5eba314f-9adb-4fc7-aaad-9e9a3b7dae70', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5eba314f-9adb-4fc7-aaad-9e9a3b7dae70', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '10a7640b39774d00a67b2de818bf4a10', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5eba314f-9adb-4fc7-aaad-9e9a3b7dae70', 'created_at': datetime.datetime(2026, 7, 9, 12, 24, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 12, 24, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5eba314f-9adb-4fc7-aaad-9e9a3b7dae70/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x720a54507890>}
Jul 09 14:43:51 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-d51b2cdb-a41c-4448-97cc-4a63e92a7727 tempest-TestShelveInstance-1427794981 None] Trying to clone cda2942f-b3a7-4c7a-a361-bd744f42b5b2 from image 5eba314f-9adb-4fc7-aaad-9e9a3b7dae70 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5eba314f-9adb-4fc7-aaad-9e9a3b7dae70', 'metadata': {}}]). {{(pid=87230) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 09 14:43:51 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-d51b2cdb-a41c-4448-97cc-4a63e92a7727 tempest-TestShelveInstance-1427794981 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5eba314f-9adb-4fc7-aaad-9e9a3b7dae70_pg1vhdlkdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87230) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 09 14:43:51 devstack cinder-volume[87230]: INFO cinder.image.image_utils [None req-d51b2cdb-a41c-4448-97cc-4a63e92a7727 tempest-TestShelveInstance-1427794981 None] Image download 20.69 MB at 20.69 MB/s
Jul 09 14:43:51 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[8366eac4-536e-4131-8cce-b96fa830aa90]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:43:51 devstack sudo[99840]: pam_unix(sudo:session): session closed for user root
Jul 09 14:43:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d51b2cdb-a41c-4448-97cc-4a63e92a7727 tempest-TestShelveInstance-1427794981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5eba314f-9adb-4fc7-aaad-9e9a3b7dae70_pg1vhdlkdevstack@QuobyteHD {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:43:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-676b4449-8f40-4f41-ae86-67e48d9adfa6 tempest-CreateVolumesFromSnapshotTest-1270352026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0368cc57-b3a4-4022-8890-ebb1d9b3e014" returned: 0 in 1.046s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:43:51 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-676b4449-8f40-4f41-ae86-67e48d9adfa6 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Lock "cinder-quobyte-0368cc57-b3a4-4022-8890-ebb1d9b3e014" released by "delete_volume" :: held 2.324s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:43:51 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-676b4449-8f40-4f41-ae86-67e48d9adfa6 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Created reservations ['eff75096-1fd5-42af-8fef-785eb20738d2', '373b99aa-dc2d-498d-8824-d9409b774e71', '23b536c7-c216-4257-929f-c6fbf657d9f9', '55612eba-d9b2-42f4-a55a-099456317e49'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:43:51 devstack sudo[99844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5eba314f-9adb-4fc7-aaad-9e9a3b7dae70_pg1vhdlkdevstack@QuobyteHD
Jul 09 14:43:51 devstack sudo[99844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:43:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-676b4449-8f40-4f41-ae86-67e48d9adfa6 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:43:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-676b4449-8f40-4f41-ae86-67e48d9adfa6 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:43:51 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-676b4449-8f40-4f41-ae86-67e48d9adfa6 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:43:51 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-676b4449-8f40-4f41-ae86-67e48d9adfa6 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:43:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-676b4449-8f40-4f41-ae86-67e48d9adfa6 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:43:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-676b4449-8f40-4f41-ae86-67e48d9adfa6 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:43:52 devstack sudo[99847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:43:52 devstack sudo[99847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:43:52 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 14:43:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:43:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:43:52 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:43:52 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:43:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:43:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:43:52 devstack sudo[99849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:43:52 devstack sudo[99849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:43:52 devstack sudo[99844]: pam_unix(sudo:session): session closed for user root
Jul 09 14:43:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d51b2cdb-a41c-4448-97cc-4a63e92a7727 tempest-TestShelveInstance-1427794981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5eba314f-9adb-4fc7-aaad-9e9a3b7dae70_pg1vhdlkdevstack@QuobyteHD" returned: 0 in 0.919s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:43:52 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-d51b2cdb-a41c-4448-97cc-4a63e92a7727 tempest-TestShelveInstance-1427794981 None] Temporary image 5eba314f-9adb-4fc7-aaad-9e9a3b7dae70 is fetched for user c193850d5cee405082c364988b5a20f2. {{(pid=87230) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 09 14:43:52 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[12705370-9865-4dea-98a2-e94d697ebb34]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:43:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d51b2cdb-a41c-4448-97cc-4a63e92a7727 tempest-TestShelveInstance-1427794981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5eba314f-9adb-4fc7-aaad-9e9a3b7dae70_pg1vhdlkdevstack@QuobyteHD {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:43:53 devstack sudo[99847]: pam_unix(sudo:session): session closed for user root
Jul 09 14:43:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-676b4449-8f40-4f41-ae86-67e48d9adfa6 tempest-CreateVolumesFromSnapshotTest-1270352026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 1.038s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:43:53 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-676b4449-8f40-4f41-ae86-67e48d9adfa6 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:43:53 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-676b4449-8f40-4f41-ae86-67e48d9adfa6 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Deleted volume successfully.
Jul 09 14:43:53 devstack sudo[99855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5eba314f-9adb-4fc7-aaad-9e9a3b7dae70_pg1vhdlkdevstack@QuobyteHD
Jul 09 14:43:53 devstack sudo[99855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:43:53 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-676b4449-8f40-4f41-ae86-67e48d9adfa6 tempest-CreateVolumesFromSnapshotTest-1270352026 None] Lock "cinder-0368cc57-b3a4-4022-8890-ebb1d9b3e014-delete_volume" released by "delete_volume" :: held 3.715s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:43:53 devstack sudo[99849]: pam_unix(sudo:session): session closed for user root
Jul 09 14:43:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.883s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:43:53 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:43:53 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Running periodic task VolumeManager._thread_info {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 14:43:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] thread count: 28 {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 09 14:43:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] thread info: [<_MainThread(MainThread, started 125388812103808)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125388713797504)>, <Thread(Thread-3 (stat_writer), started daemon 125388699995392)>, <Thread(Rabbit-heartbeat, started daemon 125388700522560)>, <Thread(Thread-5 (_runner), started daemon 125388698545216)>, <Thread(Thread-7 (_runner), started daemon 125388698611264)>, <Thread(fd_logger, started daemon 125388703020672)>, <Thread(privsep_reader, started daemon 125388696441088)>, <Thread(tpool_thread_0, started daemon 125388687943360)>, <Thread(tpool_thread_1, started daemon 125388679550656)>, <Thread(tpool_thread_2, started daemon 125388671141568)>, <Thread(tpool_thread_3, started daemon 125388662732480)>, <Thread(tpool_thread_4, started daemon 125388654323392)>, <Thread(tpool_thread_5, started daemon 125388645914304)>, <Thread(tpool_thread_6, started daemon 125388637505216)>, <Thread(tpool_thread_7, started daemon 125388629096128)>, <Thread(tpool_thread_8, started daemon 125388620687040)>, <Thread(tpool_thread_9, started daemon 125388612277952)>, <Thread(tpool_thread_10, started daemon 125388603868864)>, <Thread(tpool_thread_11, started daemon 125388595459776)>, <Thread(tpool_thread_12, started daemon 125388587050688)>, <Thread(tpool_thread_13, started daemon 125388578641600)>, <Thread(tpool_thread_14, started daemon 125388570232512)>, <Thread(tpool_thread_15, started daemon 125388561823424)>, <Thread(tpool_thread_16, started daemon 125388553414336)>, <Thread(tpool_thread_17, started daemon 125388545005248)>, <Thread(tpool_thread_18, started daemon 125388536596160)>, <Thread(tpool_thread_19, started daemon 125388528187072)>] {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 09 14:43:53 devstack sudo[99855]: pam_unix(sudo:session): session closed for user root
Jul 09 14:43:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d51b2cdb-a41c-4448-97cc-4a63e92a7727 tempest-TestShelveInstance-1427794981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5eba314f-9adb-4fc7-aaad-9e9a3b7dae70_pg1vhdlkdevstack@QuobyteHD" returned: 0 in 1.068s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:43:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d51b2cdb-a41c-4448-97cc-4a63e92a7727 tempest-TestShelveInstance-1427794981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:43:54 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb396dce-ef95-4320-9925-be1b52611519 tempest-VolumesListAdminTestJSON-1929470986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:43:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-fb396dce-ef95-4320-9925-be1b52611519 tempest-VolumesListAdminTestJSON-1929470986 None] Flow 'volume_create_manager' (988347c9-7be6-4c31-8d99-d073e0177ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:43:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-fb396dce-ef95-4320-9925-be1b52611519 tempest-VolumesListAdminTestJSON-1929470986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b7733d4-b9d5-41ee-990d-cb51fa7ad8f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:43:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-fb396dce-ef95-4320-9925-be1b52611519 tempest-VolumesListAdminTestJSON-1929470986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b7733d4-b9d5-41ee-990d-cb51fa7ad8f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:43:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-179093048',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0c12292-d3c1-43bc-8095-27e2112c0146,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0bce8cd27e74f4fa893b3a927d6cce9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:43:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:43:54Z,use_quota=True,user_id='276d6d8cb9654d80a06aa07272ef5873',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:43:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-fb396dce-ef95-4320-9925-be1b52611519 tempest-VolumesListAdminTestJSON-1929470986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98a37f75-9d5b-4cb9-8940-a875ce98f4a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:43:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-fb396dce-ef95-4320-9925-be1b52611519 tempest-VolumesListAdminTestJSON-1929470986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98a37f75-9d5b-4cb9-8940-a875ce98f4a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:43:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-fb396dce-ef95-4320-9925-be1b52611519 tempest-VolumesListAdminTestJSON-1929470986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf6e5b5b-68c9-474a-8965-e9b7a1616b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:43:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-fb396dce-ef95-4320-9925-be1b52611519 tempest-VolumesListAdminTestJSON-1929470986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf6e5b5b-68c9-474a-8965-e9b7a1616b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0c12292-d3c1-43bc-8095-27e2112c0146', 'volume_name': 'volume-e0c12292-d3c1-43bc-8095-27e2112c0146', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:43:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-fb396dce-ef95-4320-9925-be1b52611519 tempest-VolumesListAdminTestJSON-1929470986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afead728-b697-46cc-9cab-e6caf296022d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:43:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-fb396dce-ef95-4320-9925-be1b52611519 tempest-VolumesListAdminTestJSON-1929470986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afead728-b697-46cc-9cab-e6caf296022d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:43:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-fb396dce-ef95-4320-9925-be1b52611519 tempest-VolumesListAdminTestJSON-1929470986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a6cfb81-0641-4dae-bc4e-2406b5419b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:43:54 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-fb396dce-ef95-4320-9925-be1b52611519 tempest-VolumesListAdminTestJSON-1929470986 None] Volume e0c12292-d3c1-43bc-8095-27e2112c0146: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0c12292-d3c1-43bc-8095-27e2112c0146', 'volume_size': 1}
Jul 09 14:43:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-fb396dce-ef95-4320-9925-be1b52611519 tempest-VolumesListAdminTestJSON-1929470986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:43:57 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f22a078-82de-4e2d-8b9b-f5fd9d450606 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:43:57 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1f22a078-82de-4e2d-8b9b-f5fd9d450606 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Flow 'volume_create_manager' (b47aee3b-8a73-43b3-b6bf-c209c4aa76ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:43:57 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1f22a078-82de-4e2d-8b9b-f5fd9d450606 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c63df184-6409-452e-896a-9a8e6b1fdbb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:43:57 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1f22a078-82de-4e2d-8b9b-f5fd9d450606 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c63df184-6409-452e-896a-9a8e6b1fdbb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:43:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-487931642',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a958d548-4193-4939-bab6-c48f7ac4f0c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3de20aa9426041e1892eb47b451973b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:43:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:43:57Z,use_quota=True,user_id='fe3d03e0cfa34c4d9fd5681af5a0b160',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:43:57 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1f22a078-82de-4e2d-8b9b-f5fd9d450606 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bded9fa-5aa6-489e-b407-6c377a2360e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:43:57 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1f22a078-82de-4e2d-8b9b-f5fd9d450606 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bded9fa-5aa6-489e-b407-6c377a2360e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:43:57 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1f22a078-82de-4e2d-8b9b-f5fd9d450606 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a11cb2de-973c-4da7-bd39-d77cf5d38b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:43:57 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1f22a078-82de-4e2d-8b9b-f5fd9d450606 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a11cb2de-973c-4da7-bd39-d77cf5d38b96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a958d548-4193-4939-bab6-c48f7ac4f0c0', 'volume_name': 'volume-a958d548-4193-4939-bab6-c48f7ac4f0c0', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:43:57 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1f22a078-82de-4e2d-8b9b-f5fd9d450606 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c096bb74-5835-40a3-b0ac-f52d79fbf719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:43:57 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1f22a078-82de-4e2d-8b9b-f5fd9d450606 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c096bb74-5835-40a3-b0ac-f52d79fbf719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:43:57 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1f22a078-82de-4e2d-8b9b-f5fd9d450606 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d980504a-ea93-4b95-b6aa-a915760922b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:43:57 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-1f22a078-82de-4e2d-8b9b-f5fd9d450606 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Volume a958d548-4193-4939-bab6-c48f7ac4f0c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a958d548-4193-4939-bab6-c48f7ac4f0c0', 'volume_size': 1}
Jul 09 14:43:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1f22a078-82de-4e2d-8b9b-f5fd9d450606 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:44:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-899ade91-3ddd-4440-a867-4b32907b2154 tempest-VolumesActionsTest-1906998927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 33.742s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:44:06 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-899ade91-3ddd-4440-a867-4b32907b2154 tempest-VolumesActionsTest-1906998927 None] Uploaded volume to glance image-id: 8213f7e2-68f5-4dbf-bfe8-df8912b7dff4. {{(pid=87230) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Jul 09 14:44:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d51b2cdb-a41c-4448-97cc-4a63e92a7727 tempest-TestShelveInstance-1427794981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.618s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:44:06 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-d51b2cdb-a41c-4448-97cc-4a63e92a7727 tempest-TestShelveInstance-1427794981 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:43:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-335716710',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cda2942f-b3a7-4c7a-a361-bd744f42b5b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c01606ea586403fb4da6666c2c0c082',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:43:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:43:50Z,use_quota=True,user_id='c193850d5cee405082c364988b5a20f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:44:06 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-d51b2cdb-a41c-4448-97cc-4a63e92a7727 tempest-TestShelveInstance-1427794981 None] Creating volume cda2942f-b3a7-4c7a-a361-bd744f42b5b2 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:44:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d51b2cdb-a41c-4448-97cc-4a63e92a7727 tempest-TestShelveInstance-1427794981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:44:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d51b2cdb-a41c-4448-97cc-4a63e92a7727 tempest-TestShelveInstance-1427794981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:44:06 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-d51b2cdb-a41c-4448-97cc-4a63e92a7727 tempest-TestShelveInstance-1427794981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:44:06 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-d51b2cdb-a41c-4448-97cc-4a63e92a7727 tempest-TestShelveInstance-1427794981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:44:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d51b2cdb-a41c-4448-97cc-4a63e92a7727 tempest-TestShelveInstance-1427794981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:44:06 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-d51b2cdb-a41c-4448-97cc-4a63e92a7727 tempest-TestShelveInstance-1427794981 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:44:06 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-d51b2cdb-a41c-4448-97cc-4a63e92a7727 tempest-TestShelveInstance-1427794981 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:44:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d51b2cdb-a41c-4448-97cc-4a63e92a7727 tempest-TestShelveInstance-1427794981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-cda2942f-b3a7-4c7a-a361-bd744f42b5b2 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:44:06 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:UPDATE=94,cinder:DELETE=9,cinder:SELECT=72,cinder:INSERT=27 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 14:44:06 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=88,cinder:UPDATE=117,cinder:INSERT=24,cinder:DELETE=9 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 14:44:06 devstack sudo[99870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-cda2942f-b3a7-4c7a-a361-bd744f42b5b2 1073741824
Jul 09 14:44:06 devstack sudo[99870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:44:06 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-899ade91-3ddd-4440-a867-4b32907b2154 tempest-VolumesActionsTest-1906998927 None] Copy volume to image completed successfully.
Jul 09 14:44:07 devstack sudo[99870]: pam_unix(sudo:session): session closed for user root
Jul 09 14:44:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d51b2cdb-a41c-4448-97cc-4a63e92a7727 tempest-TestShelveInstance-1427794981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-cda2942f-b3a7-4c7a-a361-bd744f42b5b2 1073741824" returned: 0 in 0.897s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:44:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-68e43187-acb7-439c-b7f8-699e0e3085eb tempest-VolumesActionsTest-1906998927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:44:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d51b2cdb-a41c-4448-97cc-4a63e92a7727 tempest-TestShelveInstance-1427794981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-cda2942f-b3a7-4c7a-a361-bd744f42b5b2 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:44:07 devstack sudo[99876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-cda2942f-b3a7-4c7a-a361-bd744f42b5b2
Jul 09 14:44:07 devstack sudo[99876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:44:08 devstack sudo[99876]: pam_unix(sudo:session): session closed for user root
Jul 09 14:44:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d51b2cdb-a41c-4448-97cc-4a63e92a7727 tempest-TestShelveInstance-1427794981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-cda2942f-b3a7-4c7a-a361-bd744f42b5b2" returned: 0 in 0.660s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:44:08 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-d51b2cdb-a41c-4448-97cc-4a63e92a7727 tempest-TestShelveInstance-1427794981 None] <== create_volume: return (1617ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:44:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d51b2cdb-a41c-4448-97cc-4a63e92a7727 tempest-TestShelveInstance-1427794981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.621s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:44:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-fb396dce-ef95-4320-9925-be1b52611519 tempest-VolumesListAdminTestJSON-1929470986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.573s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:44:08 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-fb396dce-ef95-4320-9925-be1b52611519 tempest-VolumesListAdminTestJSON-1929470986 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:43:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-179093048',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0c12292-d3c1-43bc-8095-27e2112c0146,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0bce8cd27e74f4fa893b3a927d6cce9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:43:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:43:54Z,use_quota=True,user_id='276d6d8cb9654d80a06aa07272ef5873',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:44:08 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-fb396dce-ef95-4320-9925-be1b52611519 tempest-VolumesListAdminTestJSON-1929470986 None] Creating volume e0c12292-d3c1-43bc-8095-27e2112c0146 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:44:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-fb396dce-ef95-4320-9925-be1b52611519 tempest-VolumesListAdminTestJSON-1929470986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:44:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-fb396dce-ef95-4320-9925-be1b52611519 tempest-VolumesListAdminTestJSON-1929470986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:44:08 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-fb396dce-ef95-4320-9925-be1b52611519 tempest-VolumesListAdminTestJSON-1929470986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:44:08 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-fb396dce-ef95-4320-9925-be1b52611519 tempest-VolumesListAdminTestJSON-1929470986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:44:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-fb396dce-ef95-4320-9925-be1b52611519 tempest-VolumesListAdminTestJSON-1929470986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:44:08 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-fb396dce-ef95-4320-9925-be1b52611519 tempest-VolumesListAdminTestJSON-1929470986 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:44:08 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-fb396dce-ef95-4320-9925-be1b52611519 tempest-VolumesListAdminTestJSON-1929470986 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:44:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fb396dce-ef95-4320-9925-be1b52611519 tempest-VolumesListAdminTestJSON-1929470986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e0c12292-d3c1-43bc-8095-27e2112c0146 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:44:08 devstack sudo[99879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e0c12292-d3c1-43bc-8095-27e2112c0146 1073741824
Jul 09 14:44:08 devstack sudo[99879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:44:08 devstack cinder-volume[87230]: DEBUG cinder.volume.volume_utils [None req-d51b2cdb-a41c-4448-97cc-4a63e92a7727 tempest-TestShelveInstance-1427794981 None] Attempting download of 5eba314f-9adb-4fc7-aaad-9e9a3b7dae70 ((None, [{'url': 'file:///opt/stack/data/glance/images/5eba314f-9adb-4fc7-aaad-9e9a3b7dae70', 'metadata': {}}])) to volume cda2942f-b3a7-4c7a-a361-bd744f42b5b2. {{(pid=87230) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 09 14:44:08 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[465adfbe-42b0-4ffb-8282-42f37759fe20]: (4, 'raw') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:44:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d51b2cdb-a41c-4448-97cc-4a63e92a7727 tempest-TestShelveInstance-1427794981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5eba314f-9adb-4fc7-aaad-9e9a3b7dae70_p3yup0pt {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:44:08 devstack sudo[99881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5eba314f-9adb-4fc7-aaad-9e9a3b7dae70_p3yup0pt
Jul 09 14:44:08 devstack sudo[99881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:44:09 devstack sudo[99879]: pam_unix(sudo:session): session closed for user root
Jul 09 14:44:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fb396dce-ef95-4320-9925-be1b52611519 tempest-VolumesListAdminTestJSON-1929470986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e0c12292-d3c1-43bc-8095-27e2112c0146 1073741824" returned: 0 in 0.840s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:44:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fb396dce-ef95-4320-9925-be1b52611519 tempest-VolumesListAdminTestJSON-1929470986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e0c12292-d3c1-43bc-8095-27e2112c0146 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:44:09 devstack sudo[99889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e0c12292-d3c1-43bc-8095-27e2112c0146
Jul 09 14:44:09 devstack sudo[99889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:44:09 devstack sudo[99881]: pam_unix(sudo:session): session closed for user root
Jul 09 14:44:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d51b2cdb-a41c-4448-97cc-4a63e92a7727 tempest-TestShelveInstance-1427794981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5eba314f-9adb-4fc7-aaad-9e9a3b7dae70_p3yup0pt" returned: 0 in 0.803s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:44:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d51b2cdb-a41c-4448-97cc-4a63e92a7727 tempest-TestShelveInstance-1427794981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5eba314f-9adb-4fc7-aaad-9e9a3b7dae70_p3yup0pt {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:44:09 devstack sudo[99891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5eba314f-9adb-4fc7-aaad-9e9a3b7dae70_p3yup0pt
Jul 09 14:44:09 devstack sudo[99891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:44:09 devstack sudo[99889]: pam_unix(sudo:session): session closed for user root
Jul 09 14:44:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fb396dce-ef95-4320-9925-be1b52611519 tempest-VolumesListAdminTestJSON-1929470986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e0c12292-d3c1-43bc-8095-27e2112c0146" returned: 0 in 0.673s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:44:09 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-fb396dce-ef95-4320-9925-be1b52611519 tempest-VolumesListAdminTestJSON-1929470986 None] <== create_volume: return (1557ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:44:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-fb396dce-ef95-4320-9925-be1b52611519 tempest-VolumesListAdminTestJSON-1929470986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.559s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:44:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1f22a078-82de-4e2d-8b9b-f5fd9d450606 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.670s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:44:09 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-1f22a078-82de-4e2d-8b9b-f5fd9d450606 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:43:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-487931642',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a958d548-4193-4939-bab6-c48f7ac4f0c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3de20aa9426041e1892eb47b451973b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:43:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:43:57Z,use_quota=True,user_id='fe3d03e0cfa34c4d9fd5681af5a0b160',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:44:09 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-1f22a078-82de-4e2d-8b9b-f5fd9d450606 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Creating volume a958d548-4193-4939-bab6-c48f7ac4f0c0 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:44:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1f22a078-82de-4e2d-8b9b-f5fd9d450606 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:44:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1f22a078-82de-4e2d-8b9b-f5fd9d450606 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:44:09 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-1f22a078-82de-4e2d-8b9b-f5fd9d450606 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:44:09 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-1f22a078-82de-4e2d-8b9b-f5fd9d450606 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:44:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1f22a078-82de-4e2d-8b9b-f5fd9d450606 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:44:09 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-1f22a078-82de-4e2d-8b9b-f5fd9d450606 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:44:09 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-1f22a078-82de-4e2d-8b9b-f5fd9d450606 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:44:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1f22a078-82de-4e2d-8b9b-f5fd9d450606 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a958d548-4193-4939-bab6-c48f7ac4f0c0 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:44:09 devstack sudo[99896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a958d548-4193-4939-bab6-c48f7ac4f0c0 1073741824
Jul 09 14:44:09 devstack sudo[99896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:44:09 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-fb396dce-ef95-4320-9925-be1b52611519 tempest-VolumesListAdminTestJSON-1929470986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a6cfb81-0641-4dae-bc4e-2406b5419b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0c12292-d3c1-43bc-8095-27e2112c0146', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:44:09 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-fb396dce-ef95-4320-9925-be1b52611519 tempest-VolumesListAdminTestJSON-1929470986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa3d5288-373f-4132-8929-b574ae8f2690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:44:09 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-fb396dce-ef95-4320-9925-be1b52611519 tempest-VolumesListAdminTestJSON-1929470986 None] Volume volume-e0c12292-d3c1-43bc-8095-27e2112c0146 (e0c12292-d3c1-43bc-8095-27e2112c0146): created successfully
Jul 09 14:44:09 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-fb396dce-ef95-4320-9925-be1b52611519 tempest-VolumesListAdminTestJSON-1929470986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa3d5288-373f-4132-8929-b574ae8f2690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:44:09 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-fb396dce-ef95-4320-9925-be1b52611519 tempest-VolumesListAdminTestJSON-1929470986 None] Flow 'volume_create_manager' (988347c9-7be6-4c31-8d99-d073e0177ad5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:44:09 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-fb396dce-ef95-4320-9925-be1b52611519 tempest-VolumesListAdminTestJSON-1929470986 None] Created volume successfully.
Jul 09 14:44:09 devstack sudo[99891]: pam_unix(sudo:session): session closed for user root
Jul 09 14:44:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d51b2cdb-a41c-4448-97cc-4a63e92a7727 tempest-TestShelveInstance-1427794981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5eba314f-9adb-4fc7-aaad-9e9a3b7dae70_p3yup0pt" returned: 1 in 0.754s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:44:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d51b2cdb-a41c-4448-97cc-4a63e92a7727 tempest-TestShelveInstance-1427794981 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5eba314f-9adb-4fc7-aaad-9e9a3b7dae70_p3yup0pt' failed. Not Retrying. {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 09 14:44:09 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f60b91-af37-472c-b65c-756c9e19a7d5]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:44:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d51b2cdb-a41c-4448-97cc-4a63e92a7727 tempest-TestShelveInstance-1427794981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5eba314f-9adb-4fc7-aaad-9e9a3b7dae70_pg1vhdlkdevstack@QuobyteHD {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:44:09 devstack sudo[99898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5eba314f-9adb-4fc7-aaad-9e9a3b7dae70_pg1vhdlkdevstack@QuobyteHD
Jul 09 14:44:09 devstack sudo[99898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:44:10 devstack sudo[99898]: pam_unix(sudo:session): session closed for user root
Jul 09 14:44:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d51b2cdb-a41c-4448-97cc-4a63e92a7727 tempest-TestShelveInstance-1427794981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5eba314f-9adb-4fc7-aaad-9e9a3b7dae70_pg1vhdlkdevstack@QuobyteHD" returned: 0 in 0.779s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:44:10 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-d51b2cdb-a41c-4448-97cc-4a63e92a7727 tempest-TestShelveInstance-1427794981 None] 5eba314f-9adb-4fc7-aaad-9e9a3b7dae70 was qcow2, converting to raw {{(pid=87230) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 09 14:44:10 devstack sudo[99896]: pam_unix(sudo:session): session closed for user root
Jul 09 14:44:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d51b2cdb-a41c-4448-97cc-4a63e92a7727 tempest-TestShelveInstance-1427794981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5eba314f-9adb-4fc7-aaad-9e9a3b7dae70_pg1vhdlkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-cda2942f-b3a7-4c7a-a361-bd744f42b5b2 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:44:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1f22a078-82de-4e2d-8b9b-f5fd9d450606 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a958d548-4193-4939-bab6-c48f7ac4f0c0 1073741824" returned: 0 in 0.925s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:44:10 devstack sudo[99908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5eba314f-9adb-4fc7-aaad-9e9a3b7dae70_pg1vhdlkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-cda2942f-b3a7-4c7a-a361-bd744f42b5b2
Jul 09 14:44:10 devstack sudo[99908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:44:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1f22a078-82de-4e2d-8b9b-f5fd9d450606 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a958d548-4193-4939-bab6-c48f7ac4f0c0 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:44:10 devstack sudo[99910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a958d548-4193-4939-bab6-c48f7ac4f0c0
Jul 09 14:44:10 devstack sudo[99910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:44:11 devstack sudo[99910]: pam_unix(sudo:session): session closed for user root
Jul 09 14:44:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1f22a078-82de-4e2d-8b9b-f5fd9d450606 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a958d548-4193-4939-bab6-c48f7ac4f0c0" returned: 0 in 0.772s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:44:11 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-1f22a078-82de-4e2d-8b9b-f5fd9d450606 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] <== create_volume: return (1766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:44:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1f22a078-82de-4e2d-8b9b-f5fd9d450606 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.768s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:44:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-68e43187-acb7-439c-b7f8-699e0e3085eb tempest-VolumesActionsTest-1906998927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 4.016s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:44:11 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c996d85-fc53-4176-b6c1-c032b167f6b2]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:44:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-68e43187-acb7-439c-b7f8-699e0e3085eb tempest-VolumesActionsTest-1906998927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-9c94308d-f5c8-4a1c-9fd3-eedf373f1b20 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:44:11 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1f22a078-82de-4e2d-8b9b-f5fd9d450606 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d980504a-ea93-4b95-b6aa-a915760922b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a958d548-4193-4939-bab6-c48f7ac4f0c0', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:44:11 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1f22a078-82de-4e2d-8b9b-f5fd9d450606 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17db8371-2cff-4bb7-bb3b-b05846eda988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:44:11 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-1f22a078-82de-4e2d-8b9b-f5fd9d450606 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Volume volume-a958d548-4193-4939-bab6-c48f7ac4f0c0 (a958d548-4193-4939-bab6-c48f7ac4f0c0): created successfully
Jul 09 14:44:11 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1f22a078-82de-4e2d-8b9b-f5fd9d450606 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17db8371-2cff-4bb7-bb3b-b05846eda988) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:44:11 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1f22a078-82de-4e2d-8b9b-f5fd9d450606 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Flow 'volume_create_manager' (b47aee3b-8a73-43b3-b6bf-c209c4aa76ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:44:11 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-e541f3b4-09bd-44ad-aada-6091f7fd07f9 tempest-VolumesListAdminTestJSON-1929470986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:44:11 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e541f3b4-09bd-44ad-aada-6091f7fd07f9 tempest-VolumesListAdminTestJSON-1929470986 None] Flow 'volume_create_manager' (303e1a8f-c9ed-4555-a229-07e77c7706b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:44:11 devstack sudo[99921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-9c94308d-f5c8-4a1c-9fd3-eedf373f1b20
Jul 09 14:44:11 devstack sudo[99921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:44:11 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e541f3b4-09bd-44ad-aada-6091f7fd07f9 tempest-VolumesListAdminTestJSON-1929470986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a2e9a94-f28d-4b5b-9a43-47e362b56305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:44:11 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e541f3b4-09bd-44ad-aada-6091f7fd07f9 tempest-VolumesListAdminTestJSON-1929470986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a2e9a94-f28d-4b5b-9a43-47e362b56305) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:44:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-906075582',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=085a82dc-fbc2-46eb-844f-71ce3fa7b4ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0bce8cd27e74f4fa893b3a927d6cce9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:44:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:44:11Z,use_quota=True,user_id='276d6d8cb9654d80a06aa07272ef5873',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:44:11 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e541f3b4-09bd-44ad-aada-6091f7fd07f9 tempest-VolumesListAdminTestJSON-1929470986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5806a1c7-5f3c-4fa0-a560-abbc9a6cf29f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:44:11 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e541f3b4-09bd-44ad-aada-6091f7fd07f9 tempest-VolumesListAdminTestJSON-1929470986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5806a1c7-5f3c-4fa0-a560-abbc9a6cf29f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:44:11 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e541f3b4-09bd-44ad-aada-6091f7fd07f9 tempest-VolumesListAdminTestJSON-1929470986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ca413ed-1b1d-40b4-8d52-e800e2340aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:44:11 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e541f3b4-09bd-44ad-aada-6091f7fd07f9 tempest-VolumesListAdminTestJSON-1929470986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ca413ed-1b1d-40b4-8d52-e800e2340aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '085a82dc-fbc2-46eb-844f-71ce3fa7b4ea', 'volume_name': 'volume-085a82dc-fbc2-46eb-844f-71ce3fa7b4ea', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:44:11 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e541f3b4-09bd-44ad-aada-6091f7fd07f9 tempest-VolumesListAdminTestJSON-1929470986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46e7db34-f885-42de-bea2-1f312e3467a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:44:11 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e541f3b4-09bd-44ad-aada-6091f7fd07f9 tempest-VolumesListAdminTestJSON-1929470986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46e7db34-f885-42de-bea2-1f312e3467a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:44:11 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e541f3b4-09bd-44ad-aada-6091f7fd07f9 tempest-VolumesListAdminTestJSON-1929470986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb2079d3-c0f9-4a49-91e5-146d37665a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:44:11 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-e541f3b4-09bd-44ad-aada-6091f7fd07f9 tempest-VolumesListAdminTestJSON-1929470986 None] Volume 085a82dc-fbc2-46eb-844f-71ce3fa7b4ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-085a82dc-fbc2-46eb-844f-71ce3fa7b4ea', 'volume_size': 1}
Jul 09 14:44:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e541f3b4-09bd-44ad-aada-6091f7fd07f9 tempest-VolumesListAdminTestJSON-1929470986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:44:11 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-1f22a078-82de-4e2d-8b9b-f5fd9d450606 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Created volume successfully.
Jul 09 14:44:12 devstack sudo[99921]: pam_unix(sudo:session): session closed for user root
Jul 09 14:44:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-68e43187-acb7-439c-b7f8-699e0e3085eb tempest-VolumesActionsTest-1906998927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-9c94308d-f5c8-4a1c-9fd3-eedf373f1b20" returned: 0 in 0.964s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:44:12 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c55a6c-40f3-4f2c-9637-61d0a110d356]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:44:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-68e43187-acb7-439c-b7f8-699e0e3085eb tempest-VolumesActionsTest-1906998927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-9c94308d-f5c8-4a1c-9fd3-eedf373f1b20 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:44:12 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-18e31a3c-2ac5-42d8-aeb5-92f2132b2357 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:44:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-18e31a3c-2ac5-42d8-aeb5-92f2132b2357 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Flow 'volume_create_manager' (26d506aa-e1dd-4c08-858b-293d21cd1d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:44:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-18e31a3c-2ac5-42d8-aeb5-92f2132b2357 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e336beb8-90c6-4077-967f-11fd12832725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:44:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-18e31a3c-2ac5-42d8-aeb5-92f2132b2357 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e336beb8-90c6-4077-967f-11fd12832725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:44:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1521084305',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2094cb70-7453-46c6-9c1a-fd425676b052,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3de20aa9426041e1892eb47b451973b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:44:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:44:12Z,use_quota=True,user_id='fe3d03e0cfa34c4d9fd5681af5a0b160',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:44:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-18e31a3c-2ac5-42d8-aeb5-92f2132b2357 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd5e33e8-e61b-4a04-827d-7148c320f8a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:44:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-18e31a3c-2ac5-42d8-aeb5-92f2132b2357 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd5e33e8-e61b-4a04-827d-7148c320f8a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:44:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-18e31a3c-2ac5-42d8-aeb5-92f2132b2357 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1367e165-77c6-4cea-bbb3-7c657b74a50e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:44:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-18e31a3c-2ac5-42d8-aeb5-92f2132b2357 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1367e165-77c6-4cea-bbb3-7c657b74a50e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2094cb70-7453-46c6-9c1a-fd425676b052', 'volume_name': 'volume-2094cb70-7453-46c6-9c1a-fd425676b052', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:44:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-18e31a3c-2ac5-42d8-aeb5-92f2132b2357 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c5267a9-823e-4ea1-9b69-4f0f497ac791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:44:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-18e31a3c-2ac5-42d8-aeb5-92f2132b2357 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c5267a9-823e-4ea1-9b69-4f0f497ac791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:44:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-18e31a3c-2ac5-42d8-aeb5-92f2132b2357 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb898601-107b-4a7a-afc3-e6bad58670a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:44:12 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-18e31a3c-2ac5-42d8-aeb5-92f2132b2357 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Volume 2094cb70-7453-46c6-9c1a-fd425676b052: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2094cb70-7453-46c6-9c1a-fd425676b052', 'volume_size': 1}
Jul 09 14:44:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-18e31a3c-2ac5-42d8-aeb5-92f2132b2357 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:44:12 devstack sudo[99926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-9c94308d-f5c8-4a1c-9fd3-eedf373f1b20
Jul 09 14:44:12 devstack sudo[99926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:44:12 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7541301-0b8a-456b-b702-5881f32392ca tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:44:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f7541301-0b8a-456b-b702-5881f32392ca tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Flow 'volume_create_manager' (8cd4b6c8-5bb0-4e46-a6bd-7889ada01899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:44:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f7541301-0b8a-456b-b702-5881f32392ca tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3879181-5a22-4ee2-b865-942db48f5471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:44:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f7541301-0b8a-456b-b702-5881f32392ca tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3879181-5a22-4ee2-b865-942db48f5471) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:44:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2036949832',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b6dbbf8-db35-4357-8842-7045419a5e1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3de20aa9426041e1892eb47b451973b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:44:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:44:13Z,use_quota=True,user_id='fe3d03e0cfa34c4d9fd5681af5a0b160',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:44:13 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f7541301-0b8a-456b-b702-5881f32392ca tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb627637-42bb-4714-a829-f67540fe3cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:44:13 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f7541301-0b8a-456b-b702-5881f32392ca tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb627637-42bb-4714-a829-f67540fe3cd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:44:13 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f7541301-0b8a-456b-b702-5881f32392ca tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f30d7c12-d6cd-4860-b88b-a27e62926639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:44:13 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f7541301-0b8a-456b-b702-5881f32392ca tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f30d7c12-d6cd-4860-b88b-a27e62926639) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b6dbbf8-db35-4357-8842-7045419a5e1b', 'volume_name': 'volume-6b6dbbf8-db35-4357-8842-7045419a5e1b', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:44:13 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f7541301-0b8a-456b-b702-5881f32392ca tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28a3fb29-393b-4ce7-8743-a413bd943011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:44:13 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f7541301-0b8a-456b-b702-5881f32392ca tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28a3fb29-393b-4ce7-8743-a413bd943011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:44:13 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f7541301-0b8a-456b-b702-5881f32392ca tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f1276b4-3ae8-494e-adaa-6f57cc31122d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:44:13 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-f7541301-0b8a-456b-b702-5881f32392ca tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Volume 6b6dbbf8-db35-4357-8842-7045419a5e1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b6dbbf8-db35-4357-8842-7045419a5e1b', 'volume_size': 1}
Jul 09 14:44:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f7541301-0b8a-456b-b702-5881f32392ca tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:44:13 devstack sudo[99908]: pam_unix(sudo:session): session closed for user root
Jul 09 14:44:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d51b2cdb-a41c-4448-97cc-4a63e92a7727 tempest-TestShelveInstance-1427794981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5eba314f-9adb-4fc7-aaad-9e9a3b7dae70_pg1vhdlkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-cda2942f-b3a7-4c7a-a361-bd744f42b5b2" returned: 0 in 2.399s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:44:13 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-d51b2cdb-a41c-4448-97cc-4a63e92a7727 tempest-TestShelveInstance-1427794981 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5eba314f-9adb-4fc7-aaad-9e9a3b7dae70_pg1vhdlkdevstack@QuobyteHD, size 112.00 MB, duration 2.40 sec, destination /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-cda2942f-b3a7-4c7a-a361-bd744f42b5b2 {{(pid=87230) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 09 14:44:13 devstack cinder-volume[87230]: INFO cinder.image.image_utils [None req-d51b2cdb-a41c-4448-97cc-4a63e92a7727 tempest-TestShelveInstance-1427794981 None] Converted 112.00 MB image at 46.68 MB/s
Jul 09 14:44:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d51b2cdb-a41c-4448-97cc-4a63e92a7727 tempest-TestShelveInstance-1427794981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-cda2942f-b3a7-4c7a-a361-bd744f42b5b2 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:44:13 devstack sudo[99928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-cda2942f-b3a7-4c7a-a361-bd744f42b5b2 1G
Jul 09 14:44:13 devstack sudo[99928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:44:13 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5549565-80f1-49bb-81eb-ebcbac064be1 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:44:13 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b5549565-80f1-49bb-81eb-ebcbac064be1 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Flow 'volume_create_manager' (1407531d-7e7f-4d85-996e-d12729164207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:44:13 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b5549565-80f1-49bb-81eb-ebcbac064be1 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef8837f4-c4e4-464c-a852-19e9a2d286b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:44:13 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b5549565-80f1-49bb-81eb-ebcbac064be1 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef8837f4-c4e4-464c-a852-19e9a2d286b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:44:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1755066725',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcff4054-1c8c-4e3b-8661-c2db5f2150d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3de20aa9426041e1892eb47b451973b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:44:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:44:13Z,use_quota=True,user_id='fe3d03e0cfa34c4d9fd5681af5a0b160',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:44:13 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b5549565-80f1-49bb-81eb-ebcbac064be1 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ba2a695-aef0-4562-80fe-e051bee93d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:44:13 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b5549565-80f1-49bb-81eb-ebcbac064be1 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ba2a695-aef0-4562-80fe-e051bee93d7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:44:13 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b5549565-80f1-49bb-81eb-ebcbac064be1 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04ac3015-cc59-4d32-841f-46b519de2f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:44:13 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b5549565-80f1-49bb-81eb-ebcbac064be1 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04ac3015-cc59-4d32-841f-46b519de2f8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fcff4054-1c8c-4e3b-8661-c2db5f2150d0', 'volume_name': 'volume-fcff4054-1c8c-4e3b-8661-c2db5f2150d0', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:44:13 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b5549565-80f1-49bb-81eb-ebcbac064be1 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4a7ca6f-91f7-4d6c-9ebc-9ee0a8a15941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:44:13 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b5549565-80f1-49bb-81eb-ebcbac064be1 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4a7ca6f-91f7-4d6c-9ebc-9ee0a8a15941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:44:13 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b5549565-80f1-49bb-81eb-ebcbac064be1 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72d26246-7e7a-45a7-badd-c4a23f86c18d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:44:13 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-b5549565-80f1-49bb-81eb-ebcbac064be1 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Volume fcff4054-1c8c-4e3b-8661-c2db5f2150d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fcff4054-1c8c-4e3b-8661-c2db5f2150d0', 'volume_size': 1}
Jul 09 14:44:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b5549565-80f1-49bb-81eb-ebcbac064be1 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:44:13 devstack sudo[99926]: pam_unix(sudo:session): session closed for user root
Jul 09 14:44:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-68e43187-acb7-439c-b7f8-699e0e3085eb tempest-VolumesActionsTest-1906998927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-9c94308d-f5c8-4a1c-9fd3-eedf373f1b20" returned: 0 in 1.064s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:44:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-68e43187-acb7-439c-b7f8-699e0e3085eb tempest-VolumesActionsTest-1906998927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-9c94308d-f5c8-4a1c-9fd3-eedf373f1b20 /opt/stack/data/cinder/conversion/9c94308d-f5c8-4a1c-9fd3-eedf373f1b20.temp_image.961f81e4-f0b1-4cd9-b6a2-ff744566eb89oq8ww837.img {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:44:13 devstack sudo[99933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-9c94308d-f5c8-4a1c-9fd3-eedf373f1b20 /opt/stack/data/cinder/conversion/9c94308d-f5c8-4a1c-9fd3-eedf373f1b20.temp_image.961f81e4-f0b1-4cd9-b6a2-ff744566eb89oq8ww837.img
Jul 09 14:44:13 devstack sudo[99933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:44:13 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-65c48525-470a-4e6e-bed2-643397571797 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:44:13 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-65c48525-470a-4e6e-bed2-643397571797 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Flow 'volume_create_manager' (b1722d7a-cf76-4681-b331-7206264c7666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:44:13 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-65c48525-470a-4e6e-bed2-643397571797 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (093a5656-eb87-4dc0-90fc-5aaa3e4984a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:44:13 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-65c48525-470a-4e6e-bed2-643397571797 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (093a5656-eb87-4dc0-90fc-5aaa3e4984a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:44:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1801222534',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef2ef272-0d68-4238-b75e-c53657209196,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3de20aa9426041e1892eb47b451973b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:44:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:44:14Z,use_quota=True,user_id='fe3d03e0cfa34c4d9fd5681af5a0b160',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:44:13 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-65c48525-470a-4e6e-bed2-643397571797 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3af2853-1456-401b-8152-b2042adbac78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:44:13 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-65c48525-470a-4e6e-bed2-643397571797 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3af2853-1456-401b-8152-b2042adbac78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:44:13 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-65c48525-470a-4e6e-bed2-643397571797 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30c40d51-3c36-4c56-87d9-79615b01656d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:44:13 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-65c48525-470a-4e6e-bed2-643397571797 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30c40d51-3c36-4c56-87d9-79615b01656d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef2ef272-0d68-4238-b75e-c53657209196', 'volume_name': 'volume-ef2ef272-0d68-4238-b75e-c53657209196', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:44:13 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-65c48525-470a-4e6e-bed2-643397571797 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22801606-bd23-4ea2-8c27-95a77cd29fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:44:13 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-65c48525-470a-4e6e-bed2-643397571797 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22801606-bd23-4ea2-8c27-95a77cd29fd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:44:13 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-65c48525-470a-4e6e-bed2-643397571797 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca486fe6-bd0f-477a-8631-d182b1630ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:44:13 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-65c48525-470a-4e6e-bed2-643397571797 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Volume ef2ef272-0d68-4238-b75e-c53657209196: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef2ef272-0d68-4238-b75e-c53657209196', 'volume_size': 1}
Jul 09 14:44:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-65c48525-470a-4e6e-bed2-643397571797 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:44:14 devstack sudo[99928]: pam_unix(sudo:session): session closed for user root
Jul 09 14:44:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d51b2cdb-a41c-4448-97cc-4a63e92a7727 tempest-TestShelveInstance-1427794981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-cda2942f-b3a7-4c7a-a361-bd744f42b5b2 1G" returned: 0 in 0.994s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:44:14 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec7560fc-2221-499a-9862-3caec094713f]: (4, 'raw') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:44:14 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a78e7df-c89d-4aa8-95b4-af4564a84cd8 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:44:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1a78e7df-c89d-4aa8-95b4-af4564a84cd8 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Flow 'volume_create_manager' (89f98d03-dff1-4dfc-aec2-4490958ea821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:44:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1a78e7df-c89d-4aa8-95b4-af4564a84cd8 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6af8b29-d792-405e-8d7f-1dd9acc0261a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:44:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d51b2cdb-a41c-4448-97cc-4a63e92a7727 tempest-TestShelveInstance-1427794981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-cda2942f-b3a7-4c7a-a361-bd744f42b5b2 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:44:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1a78e7df-c89d-4aa8-95b4-af4564a84cd8 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6af8b29-d792-405e-8d7f-1dd9acc0261a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:44:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1040178809',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e954ae2-a0d8-4a9f-bbde-bb68cbd413fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3de20aa9426041e1892eb47b451973b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:44:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:44:14Z,use_quota=True,user_id='fe3d03e0cfa34c4d9fd5681af5a0b160',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:44:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1a78e7df-c89d-4aa8-95b4-af4564a84cd8 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (359bf431-490a-4ba3-8243-e0d7dfef9210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:44:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1a78e7df-c89d-4aa8-95b4-af4564a84cd8 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (359bf431-490a-4ba3-8243-e0d7dfef9210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:44:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1a78e7df-c89d-4aa8-95b4-af4564a84cd8 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4cc99a4-3f44-4234-998a-b4c734716dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:44:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1a78e7df-c89d-4aa8-95b4-af4564a84cd8 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4cc99a4-3f44-4234-998a-b4c734716dfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e954ae2-a0d8-4a9f-bbde-bb68cbd413fc', 'volume_name': 'volume-9e954ae2-a0d8-4a9f-bbde-bb68cbd413fc', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:44:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1a78e7df-c89d-4aa8-95b4-af4564a84cd8 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c25359d-f9cd-42b3-beea-3a5aee229213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:44:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1a78e7df-c89d-4aa8-95b4-af4564a84cd8 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c25359d-f9cd-42b3-beea-3a5aee229213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:44:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1a78e7df-c89d-4aa8-95b4-af4564a84cd8 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd36c724-19d7-4c9b-bf50-f2da7817d2ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:44:14 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-1a78e7df-c89d-4aa8-95b4-af4564a84cd8 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Volume 9e954ae2-a0d8-4a9f-bbde-bb68cbd413fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e954ae2-a0d8-4a9f-bbde-bb68cbd413fc', 'volume_size': 1}
Jul 09 14:44:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1a78e7df-c89d-4aa8-95b4-af4564a84cd8 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:44:14 devstack sudo[99938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-cda2942f-b3a7-4c7a-a361-bd744f42b5b2
Jul 09 14:44:14 devstack sudo[99938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:44:15 devstack sudo[99938]: pam_unix(sudo:session): session closed for user root
Jul 09 14:44:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d51b2cdb-a41c-4448-97cc-4a63e92a7727 tempest-TestShelveInstance-1427794981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-cda2942f-b3a7-4c7a-a361-bd744f42b5b2" returned: 0 in 1.148s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:44:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d51b2cdb-a41c-4448-97cc-4a63e92a7727 tempest-TestShelveInstance-1427794981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-cda2942f-b3a7-4c7a-a361-bd744f42b5b2 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:44:15 devstack sudo[99952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-cda2942f-b3a7-4c7a-a361-bd744f42b5b2
Jul 09 14:44:15 devstack sudo[99952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:44:16 devstack sudo[99952]: pam_unix(sudo:session): session closed for user root
Jul 09 14:44:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d51b2cdb-a41c-4448-97cc-4a63e92a7727 tempest-TestShelveInstance-1427794981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-cda2942f-b3a7-4c7a-a361-bd744f42b5b2" returned: 1 in 1.522s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:44:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d51b2cdb-a41c-4448-97cc-4a63e92a7727 tempest-TestShelveInstance-1427794981 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-cda2942f-b3a7-4c7a-a361-bd744f42b5b2' failed. Not Retrying. {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 09 14:44:16 devstack cinder-volume[87230]: DEBUG cinder.volume.volume_utils [None req-d51b2cdb-a41c-4448-97cc-4a63e92a7727 tempest-TestShelveInstance-1427794981 None] Downloaded image 5eba314f-9adb-4fc7-aaad-9e9a3b7dae70 ((None, [{'url': 'file:///opt/stack/data/glance/images/5eba314f-9adb-4fc7-aaad-9e9a3b7dae70', 'metadata': {}}])) to volume cda2942f-b3a7-4c7a-a361-bd744f42b5b2 successfully. {{(pid=87230) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 09 14:44:16 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-d51b2cdb-a41c-4448-97cc-4a63e92a7727 tempest-TestShelveInstance-1427794981 None] Temporary image 5eba314f-9adb-4fc7-aaad-9e9a3b7dae70 for user c193850d5cee405082c364988b5a20f2 is deleted. {{(pid=87230) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 09 14:44:16 devstack cinder-volume[87230]: DEBUG cinder.volume.volume_utils [None req-d51b2cdb-a41c-4448-97cc-4a63e92a7727 tempest-TestShelveInstance-1427794981 None] Marking volume cda2942f-b3a7-4c7a-a361-bd744f42b5b2 as bootable. {{(pid=87230) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 09 14:44:16 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-d51b2cdb-a41c-4448-97cc-4a63e92a7727 tempest-TestShelveInstance-1427794981 None] Copying metadata from image 5eba314f-9adb-4fc7-aaad-9e9a3b7dae70 to cda2942f-b3a7-4c7a-a361-bd744f42b5b2. {{(pid=87230) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 09 14:44:16 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-d51b2cdb-a41c-4448-97cc-4a63e92a7727 tempest-TestShelveInstance-1427794981 None] Creating volume glance metadata for volume cda2942f-b3a7-4c7a-a361-bd744f42b5b2 backed by image 5eba314f-9adb-4fc7-aaad-9e9a3b7dae70 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5eba314f-9adb-4fc7-aaad-9e9a3b7dae70', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87230) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 09 14:44:17 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d51b2cdb-a41c-4448-97cc-4a63e92a7727 tempest-TestShelveInstance-1427794981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00f597c7-b1cf-434b-af4f-c70aa7247acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cda2942f-b3a7-4c7a-a361-bd744f42b5b2', 'volume_size': 1, 'image_id': '5eba314f-9adb-4fc7-aaad-9e9a3b7dae70', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5eba314f-9adb-4fc7-aaad-9e9a3b7dae70', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '10a7640b39774d00a67b2de818bf4a10', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5eba314f-9adb-4fc7-aaad-9e9a3b7dae70', 'created_at': datetime.datetime(2026, 7, 9, 12, 24, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 12, 24, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5eba314f-9adb-4fc7-aaad-9e9a3b7dae70/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x720a54507890>}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:44:17 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d51b2cdb-a41c-4448-97cc-4a63e92a7727 tempest-TestShelveInstance-1427794981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3ced14b-9b12-4392-8cf4-4f7d5f09a395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:44:17 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-d51b2cdb-a41c-4448-97cc-4a63e92a7727 tempest-TestShelveInstance-1427794981 None] Volume volume-cda2942f-b3a7-4c7a-a361-bd744f42b5b2 (cda2942f-b3a7-4c7a-a361-bd744f42b5b2): created successfully
Jul 09 14:44:17 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d51b2cdb-a41c-4448-97cc-4a63e92a7727 tempest-TestShelveInstance-1427794981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3ced14b-9b12-4392-8cf4-4f7d5f09a395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:44:17 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d51b2cdb-a41c-4448-97cc-4a63e92a7727 tempest-TestShelveInstance-1427794981 None] Flow 'volume_create_manager' (701d4866-c203-4b8d-96dd-155cb44dfa94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:44:17 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-d51b2cdb-a41c-4448-97cc-4a63e92a7727 tempest-TestShelveInstance-1427794981 None] Created volume successfully.
Jul 09 14:44:18 devstack sudo[99933]: pam_unix(sudo:session): session closed for user root
Jul 09 14:44:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-68e43187-acb7-439c-b7f8-699e0e3085eb tempest-VolumesActionsTest-1906998927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-9c94308d-f5c8-4a1c-9fd3-eedf373f1b20 /opt/stack/data/cinder/conversion/9c94308d-f5c8-4a1c-9fd3-eedf373f1b20.temp_image.961f81e4-f0b1-4cd9-b6a2-ff744566eb89oq8ww837.img" returned: 0 in 4.947s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:44:18 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[dad8974f-14e1-41a3-b7ca-bf09d6d90fa9]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:44:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-68e43187-acb7-439c-b7f8-699e0e3085eb tempest-VolumesActionsTest-1906998927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-9c94308d-f5c8-4a1c-9fd3-eedf373f1b20 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:44:18 devstack sudo[99958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-9c94308d-f5c8-4a1c-9fd3-eedf373f1b20
Jul 09 14:44:18 devstack sudo[99958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:44:19 devstack sudo[99958]: pam_unix(sudo:session): session closed for user root
Jul 09 14:44:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-68e43187-acb7-439c-b7f8-699e0e3085eb tempest-VolumesActionsTest-1906998927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-9c94308d-f5c8-4a1c-9fd3-eedf373f1b20" returned: 0 in 0.973s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:44:19 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-68e43187-acb7-439c-b7f8-699e0e3085eb tempest-VolumesActionsTest-1906998927 None] Image conversion details: src /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-9c94308d-f5c8-4a1c-9fd3-eedf373f1b20, size 1024.00 MB, duration 4.95 sec, destination /opt/stack/data/cinder/conversion/9c94308d-f5c8-4a1c-9fd3-eedf373f1b20.temp_image.961f81e4-f0b1-4cd9-b6a2-ff744566eb89oq8ww837.img {{(pid=87230) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 09 14:44:19 devstack cinder-volume[87230]: INFO cinder.image.image_utils [None req-68e43187-acb7-439c-b7f8-699e0e3085eb tempest-VolumesActionsTest-1906998927 None] Converted 1024.00 MB image at 206.97 MB/s
Jul 09 14:44:19 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-68e43187-acb7-439c-b7f8-699e0e3085eb tempest-VolumesActionsTest-1906998927 None] 961f81e4-f0b1-4cd9-b6a2-ff744566eb89 was raw, converting to qcow2 {{(pid=87230) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}}
Jul 09 14:44:19 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3fba613-035d-4fbf-a249-712b810b8c98]: (4, 'raw') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:44:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-68e43187-acb7-439c-b7f8-699e0e3085eb tempest-VolumesActionsTest-1906998927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/9c94308d-f5c8-4a1c-9fd3-eedf373f1b20.temp_image.961f81e4-f0b1-4cd9-b6a2-ff744566eb89oq8ww837.img {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:44:19 devstack sudo[99967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/9c94308d-f5c8-4a1c-9fd3-eedf373f1b20.temp_image.961f81e4-f0b1-4cd9-b6a2-ff744566eb89oq8ww837.img
Jul 09 14:44:19 devstack sudo[99967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:44:20 devstack sudo[99967]: pam_unix(sudo:session): session closed for user root
Jul 09 14:44:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-68e43187-acb7-439c-b7f8-699e0e3085eb tempest-VolumesActionsTest-1906998927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/9c94308d-f5c8-4a1c-9fd3-eedf373f1b20.temp_image.961f81e4-f0b1-4cd9-b6a2-ff744566eb89oq8ww837.img" returned: 0 in 0.727s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:44:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-68e43187-acb7-439c-b7f8-699e0e3085eb tempest-VolumesActionsTest-1906998927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9c94308d-f5c8-4a1c-9fd3-eedf373f1b20.temp_image.961f81e4-f0b1-4cd9-b6a2-ff744566eb89oq8ww837.img {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:44:20 devstack sudo[99971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9c94308d-f5c8-4a1c-9fd3-eedf373f1b20.temp_image.961f81e4-f0b1-4cd9-b6a2-ff744566eb89oq8ww837.img
Jul 09 14:44:20 devstack sudo[99971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:44:21 devstack sudo[99971]: pam_unix(sudo:session): session closed for user root
Jul 09 14:44:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-68e43187-acb7-439c-b7f8-699e0e3085eb tempest-VolumesActionsTest-1906998927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9c94308d-f5c8-4a1c-9fd3-eedf373f1b20.temp_image.961f81e4-f0b1-4cd9-b6a2-ff744566eb89oq8ww837.img" returned: 1 in 0.719s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:44:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-68e43187-acb7-439c-b7f8-699e0e3085eb tempest-VolumesActionsTest-1906998927 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9c94308d-f5c8-4a1c-9fd3-eedf373f1b20.temp_image.961f81e4-f0b1-4cd9-b6a2-ff744566eb89oq8ww837.img' failed. Not Retrying. {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 09 14:44:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-68e43187-acb7-439c-b7f8-699e0e3085eb tempest-VolumesActionsTest-1906998927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/9c94308d-f5c8-4a1c-9fd3-eedf373f1b20.temp_image.961f81e4-f0b1-4cd9-b6a2-ff744566eb89oq8ww837.img /opt/stack/data/cinder/conversion/vol_upload_u61m1n7f {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:44:21 devstack sudo[99977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/9c94308d-f5c8-4a1c-9fd3-eedf373f1b20.temp_image.961f81e4-f0b1-4cd9-b6a2-ff744566eb89oq8ww837.img /opt/stack/data/cinder/conversion/vol_upload_u61m1n7f
Jul 09 14:44:21 devstack sudo[99977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:44:21 devstack sudo[99977]: pam_unix(sudo:session): session closed for user root
Jul 09 14:44:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-68e43187-acb7-439c-b7f8-699e0e3085eb tempest-VolumesActionsTest-1906998927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/9c94308d-f5c8-4a1c-9fd3-eedf373f1b20.temp_image.961f81e4-f0b1-4cd9-b6a2-ff744566eb89oq8ww837.img /opt/stack/data/cinder/conversion/vol_upload_u61m1n7f" returned: 0 in 0.676s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:44:21 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-68e43187-acb7-439c-b7f8-699e0e3085eb tempest-VolumesActionsTest-1906998927 None] Image conversion details: src /opt/stack/data/cinder/conversion/9c94308d-f5c8-4a1c-9fd3-eedf373f1b20.temp_image.961f81e4-f0b1-4cd9-b6a2-ff744566eb89oq8ww837.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_u61m1n7f {{(pid=87230) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 09 14:44:21 devstack cinder-volume[87230]: INFO cinder.image.image_utils [None req-68e43187-acb7-439c-b7f8-699e0e3085eb tempest-VolumesActionsTest-1906998927 None] Converted 1024.00 MB image at 1024.00 MB/s
Jul 09 14:44:21 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[df813f11-6f1b-4020-b7c7-2e876aa0e1ba]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:44:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-68e43187-acb7-439c-b7f8-699e0e3085eb tempest-VolumesActionsTest-1906998927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_u61m1n7f {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:44:21 devstack sudo[99984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_u61m1n7f
Jul 09 14:44:21 devstack sudo[99984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:44:22 devstack sudo[99984]: pam_unix(sudo:session): session closed for user root
Jul 09 14:44:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-68e43187-acb7-439c-b7f8-699e0e3085eb tempest-VolumesActionsTest-1906998927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_u61m1n7f" returned: 0 in 0.728s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:44:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-68e43187-acb7-439c-b7f8-699e0e3085eb tempest-VolumesActionsTest-1906998927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.169s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:44:23 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-68e43187-acb7-439c-b7f8-699e0e3085eb tempest-VolumesActionsTest-1906998927 None] Uploaded volume to glance image-id: 961f81e4-f0b1-4cd9-b6a2-ff744566eb89. {{(pid=87230) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Jul 09 14:44:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e541f3b4-09bd-44ad-aada-6091f7fd07f9 tempest-VolumesListAdminTestJSON-1929470986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.929s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:44:23 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-e541f3b4-09bd-44ad-aada-6091f7fd07f9 tempest-VolumesListAdminTestJSON-1929470986 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:44:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-906075582',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=085a82dc-fbc2-46eb-844f-71ce3fa7b4ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0bce8cd27e74f4fa893b3a927d6cce9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:44:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:44:11Z,use_quota=True,user_id='276d6d8cb9654d80a06aa07272ef5873',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:44:23 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-e541f3b4-09bd-44ad-aada-6091f7fd07f9 tempest-VolumesListAdminTestJSON-1929470986 None] Creating volume 085a82dc-fbc2-46eb-844f-71ce3fa7b4ea {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:44:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e541f3b4-09bd-44ad-aada-6091f7fd07f9 tempest-VolumesListAdminTestJSON-1929470986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:44:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e541f3b4-09bd-44ad-aada-6091f7fd07f9 tempest-VolumesListAdminTestJSON-1929470986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:44:23 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-e541f3b4-09bd-44ad-aada-6091f7fd07f9 tempest-VolumesListAdminTestJSON-1929470986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:44:23 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-e541f3b4-09bd-44ad-aada-6091f7fd07f9 tempest-VolumesListAdminTestJSON-1929470986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:44:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e541f3b4-09bd-44ad-aada-6091f7fd07f9 tempest-VolumesListAdminTestJSON-1929470986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:44:23 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-e541f3b4-09bd-44ad-aada-6091f7fd07f9 tempest-VolumesListAdminTestJSON-1929470986 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:44:23 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-e541f3b4-09bd-44ad-aada-6091f7fd07f9 tempest-VolumesListAdminTestJSON-1929470986 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:44:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e541f3b4-09bd-44ad-aada-6091f7fd07f9 tempest-VolumesListAdminTestJSON-1929470986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-085a82dc-fbc2-46eb-844f-71ce3fa7b4ea 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:44:23 devstack sudo[99989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-085a82dc-fbc2-46eb-844f-71ce3fa7b4ea 1073741824
Jul 09 14:44:23 devstack sudo[99989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:44:23 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-68e43187-acb7-439c-b7f8-699e0e3085eb tempest-VolumesActionsTest-1906998927 None] Copy volume to image completed successfully.
Jul 09 14:44:24 devstack sudo[99989]: pam_unix(sudo:session): session closed for user root
Jul 09 14:44:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e541f3b4-09bd-44ad-aada-6091f7fd07f9 tempest-VolumesListAdminTestJSON-1929470986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-085a82dc-fbc2-46eb-844f-71ce3fa7b4ea 1073741824" returned: 0 in 1.036s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:44:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e541f3b4-09bd-44ad-aada-6091f7fd07f9 tempest-VolumesListAdminTestJSON-1929470986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-085a82dc-fbc2-46eb-844f-71ce3fa7b4ea {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:44:24 devstack sudo[99994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-085a82dc-fbc2-46eb-844f-71ce3fa7b4ea
Jul 09 14:44:24 devstack sudo[99994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:44:25 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-5af2bdcc-b8e7-4d4b-987d-ffb277655adb tempest-VolumesActionsTest-1906998927 None] Acquiring lock "cinder-9c94308d-f5c8-4a1c-9fd3-eedf373f1b20-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:44:25 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-5af2bdcc-b8e7-4d4b-987d-ffb277655adb tempest-VolumesActionsTest-1906998927 None] Lock "cinder-9c94308d-f5c8-4a1c-9fd3-eedf373f1b20-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:44:25 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-5af2bdcc-b8e7-4d4b-987d-ffb277655adb tempest-VolumesActionsTest-1906998927 None] Acquiring lock "cinder-quobyte-9c94308d-f5c8-4a1c-9fd3-eedf373f1b20" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:44:25 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-5af2bdcc-b8e7-4d4b-987d-ffb277655adb tempest-VolumesActionsTest-1906998927 None] Lock "cinder-quobyte-9c94308d-f5c8-4a1c-9fd3-eedf373f1b20" acquired by "delete_volume" :: waited 0.063s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:44:25 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b73e3b7-6225-4459-9d90-3c7beacbd801]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:44:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5af2bdcc-b8e7-4d4b-987d-ffb277655adb tempest-VolumesActionsTest-1906998927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-9c94308d-f5c8-4a1c-9fd3-eedf373f1b20 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:44:25 devstack sudo[99997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-9c94308d-f5c8-4a1c-9fd3-eedf373f1b20
Jul 09 14:44:25 devstack sudo[99997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:44:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-f6251900-c0ad-4914-869d-7ae90849206c req-e58493b8-b956-4626-90a0-43cd2821588c tempest-TestShelveInstance-1427794981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:44:25 devstack sudo[99994]: pam_unix(sudo:session): session closed for user root
Jul 09 14:44:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e541f3b4-09bd-44ad-aada-6091f7fd07f9 tempest-VolumesListAdminTestJSON-1929470986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-085a82dc-fbc2-46eb-844f-71ce3fa7b4ea" returned: 0 in 0.887s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:44:25 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-e541f3b4-09bd-44ad-aada-6091f7fd07f9 tempest-VolumesListAdminTestJSON-1929470986 None] <== create_volume: return (1973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:44:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e541f3b4-09bd-44ad-aada-6091f7fd07f9 tempest-VolumesListAdminTestJSON-1929470986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.976s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:44:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-18e31a3c-2ac5-42d8-aeb5-92f2132b2357 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.993s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:44:25 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-18e31a3c-2ac5-42d8-aeb5-92f2132b2357 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:44:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1521084305',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2094cb70-7453-46c6-9c1a-fd425676b052,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3de20aa9426041e1892eb47b451973b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:44:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:44:12Z,use_quota=True,user_id='fe3d03e0cfa34c4d9fd5681af5a0b160',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:44:25 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-18e31a3c-2ac5-42d8-aeb5-92f2132b2357 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Creating volume 2094cb70-7453-46c6-9c1a-fd425676b052 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:44:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-18e31a3c-2ac5-42d8-aeb5-92f2132b2357 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:44:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-18e31a3c-2ac5-42d8-aeb5-92f2132b2357 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:44:25 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-18e31a3c-2ac5-42d8-aeb5-92f2132b2357 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:44:25 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-18e31a3c-2ac5-42d8-aeb5-92f2132b2357 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:44:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-18e31a3c-2ac5-42d8-aeb5-92f2132b2357 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:44:25 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-18e31a3c-2ac5-42d8-aeb5-92f2132b2357 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:44:25 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-18e31a3c-2ac5-42d8-aeb5-92f2132b2357 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:44:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-18e31a3c-2ac5-42d8-aeb5-92f2132b2357 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2094cb70-7453-46c6-9c1a-fd425676b052 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:44:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e541f3b4-09bd-44ad-aada-6091f7fd07f9 tempest-VolumesListAdminTestJSON-1929470986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb2079d3-c0f9-4a49-91e5-146d37665a0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-085a82dc-fbc2-46eb-844f-71ce3fa7b4ea', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:44:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e541f3b4-09bd-44ad-aada-6091f7fd07f9 tempest-VolumesListAdminTestJSON-1929470986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3f4f763-6581-4405-97cc-c0475adda33e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:44:25 devstack sudo[100008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2094cb70-7453-46c6-9c1a-fd425676b052 1073741824
Jul 09 14:44:25 devstack sudo[100008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:44:25 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-e541f3b4-09bd-44ad-aada-6091f7fd07f9 tempest-VolumesListAdminTestJSON-1929470986 None] Volume volume-085a82dc-fbc2-46eb-844f-71ce3fa7b4ea (085a82dc-fbc2-46eb-844f-71ce3fa7b4ea): created successfully
Jul 09 14:44:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e541f3b4-09bd-44ad-aada-6091f7fd07f9 tempest-VolumesListAdminTestJSON-1929470986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3f4f763-6581-4405-97cc-c0475adda33e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:44:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e541f3b4-09bd-44ad-aada-6091f7fd07f9 tempest-VolumesListAdminTestJSON-1929470986 None] Flow 'volume_create_manager' (303e1a8f-c9ed-4555-a229-07e77c7706b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:44:25 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-e541f3b4-09bd-44ad-aada-6091f7fd07f9 tempest-VolumesListAdminTestJSON-1929470986 None] Created volume successfully.
Jul 09 14:44:26 devstack sudo[99997]: pam_unix(sudo:session): session closed for user root
Jul 09 14:44:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5af2bdcc-b8e7-4d4b-987d-ffb277655adb tempest-VolumesActionsTest-1906998927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-9c94308d-f5c8-4a1c-9fd3-eedf373f1b20" returned: 0 in 0.910s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:44:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5af2bdcc-b8e7-4d4b-987d-ffb277655adb tempest-VolumesActionsTest-1906998927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-9c94308d-f5c8-4a1c-9fd3-eedf373f1b20 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:44:26 devstack sudo[100014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-9c94308d-f5c8-4a1c-9fd3-eedf373f1b20
Jul 09 14:44:26 devstack sudo[100014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:44:26 devstack sudo[100008]: pam_unix(sudo:session): session closed for user root
Jul 09 14:44:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-18e31a3c-2ac5-42d8-aeb5-92f2132b2357 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2094cb70-7453-46c6-9c1a-fd425676b052 1073741824" returned: 0 in 1.049s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:44:26 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6bd23b7-398b-487b-a96c-b9fe163f2414 tempest-VolumesListAdminTestJSON-1929470986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:44:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b6bd23b7-398b-487b-a96c-b9fe163f2414 tempest-VolumesListAdminTestJSON-1929470986 None] Flow 'volume_create_manager' (42308dca-7d61-4ca9-b605-d7b3254e0ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:44:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b6bd23b7-398b-487b-a96c-b9fe163f2414 tempest-VolumesListAdminTestJSON-1929470986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aca7f4cc-ab0a-4f15-beee-11d53c9d7fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:44:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-18e31a3c-2ac5-42d8-aeb5-92f2132b2357 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2094cb70-7453-46c6-9c1a-fd425676b052 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:44:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b6bd23b7-398b-487b-a96c-b9fe163f2414 tempest-VolumesListAdminTestJSON-1929470986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aca7f4cc-ab0a-4f15-beee-11d53c9d7fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:44:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2051701490',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b91a5ad-7f83-40a4-a007-8c5bf7267dd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0bce8cd27e74f4fa893b3a927d6cce9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:44:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:44:27Z,use_quota=True,user_id='276d6d8cb9654d80a06aa07272ef5873',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:44:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b6bd23b7-398b-487b-a96c-b9fe163f2414 tempest-VolumesListAdminTestJSON-1929470986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65d944c0-f74d-469e-9974-f6c99fc142ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:44:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b6bd23b7-398b-487b-a96c-b9fe163f2414 tempest-VolumesListAdminTestJSON-1929470986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65d944c0-f74d-469e-9974-f6c99fc142ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:44:26 devstack sudo[100021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2094cb70-7453-46c6-9c1a-fd425676b052
Jul 09 14:44:26 devstack sudo[100021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:44:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b6bd23b7-398b-487b-a96c-b9fe163f2414 tempest-VolumesListAdminTestJSON-1929470986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3f09ff5-bf15-434f-81fd-5845c0a17f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:44:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b6bd23b7-398b-487b-a96c-b9fe163f2414 tempest-VolumesListAdminTestJSON-1929470986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3f09ff5-bf15-434f-81fd-5845c0a17f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b91a5ad-7f83-40a4-a007-8c5bf7267dd5', 'volume_name': 'volume-6b91a5ad-7f83-40a4-a007-8c5bf7267dd5', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:44:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b6bd23b7-398b-487b-a96c-b9fe163f2414 tempest-VolumesListAdminTestJSON-1929470986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7135224-3b80-4301-ae69-6ac43846d33f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:44:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b6bd23b7-398b-487b-a96c-b9fe163f2414 tempest-VolumesListAdminTestJSON-1929470986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7135224-3b80-4301-ae69-6ac43846d33f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:44:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b6bd23b7-398b-487b-a96c-b9fe163f2414 tempest-VolumesListAdminTestJSON-1929470986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bca27946-0fb2-4041-930c-1b2e67c7f2e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:44:26 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-b6bd23b7-398b-487b-a96c-b9fe163f2414 tempest-VolumesListAdminTestJSON-1929470986 None] Volume 6b91a5ad-7f83-40a4-a007-8c5bf7267dd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b91a5ad-7f83-40a4-a007-8c5bf7267dd5', 'volume_size': 1}
Jul 09 14:44:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b6bd23b7-398b-487b-a96c-b9fe163f2414 tempest-VolumesListAdminTestJSON-1929470986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:44:26 devstack sudo[100014]: pam_unix(sudo:session): session closed for user root
Jul 09 14:44:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5af2bdcc-b8e7-4d4b-987d-ffb277655adb tempest-VolumesActionsTest-1906998927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-9c94308d-f5c8-4a1c-9fd3-eedf373f1b20" returned: 0 in 0.728s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:44:26 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-5af2bdcc-b8e7-4d4b-987d-ffb277655adb tempest-VolumesActionsTest-1906998927 None] Lock "cinder-quobyte-9c94308d-f5c8-4a1c-9fd3-eedf373f1b20" released by "delete_volume" :: held 1.711s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:44:27 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-5af2bdcc-b8e7-4d4b-987d-ffb277655adb tempest-VolumesActionsTest-1906998927 None] Created reservations ['9ab96b02-cf41-4143-a50c-4fdd81cb3570', 'e035661f-945d-4ef0-80d5-cd3b004fa94d', '7b9bf2ce-1242-4818-847e-758522e67225', '1abb4f35-feda-485d-ad54-b9e6802aae75'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:44:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5af2bdcc-b8e7-4d4b-987d-ffb277655adb tempest-VolumesActionsTest-1906998927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:44:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5af2bdcc-b8e7-4d4b-987d-ffb277655adb tempest-VolumesActionsTest-1906998927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:44:27 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-5af2bdcc-b8e7-4d4b-987d-ffb277655adb tempest-VolumesActionsTest-1906998927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:44:27 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-5af2bdcc-b8e7-4d4b-987d-ffb277655adb tempest-VolumesActionsTest-1906998927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:44:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5af2bdcc-b8e7-4d4b-987d-ffb277655adb tempest-VolumesActionsTest-1906998927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:44:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5af2bdcc-b8e7-4d4b-987d-ffb277655adb tempest-VolumesActionsTest-1906998927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:44:27 devstack sudo[100023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:44:27 devstack sudo[100023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:44:27 devstack sudo[100021]: pam_unix(sudo:session): session closed for user root
Jul 09 14:44:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-18e31a3c-2ac5-42d8-aeb5-92f2132b2357 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2094cb70-7453-46c6-9c1a-fd425676b052" returned: 0 in 0.665s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:44:27 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-18e31a3c-2ac5-42d8-aeb5-92f2132b2357 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] <== create_volume: return (1821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:44:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-18e31a3c-2ac5-42d8-aeb5-92f2132b2357 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.826s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:44:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f7541301-0b8a-456b-b702-5881f32392ca tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.487s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:44:27 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f7541301-0b8a-456b-b702-5881f32392ca tempest-CreateVolumesFromSourceVolumeTest-123286107 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:44:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2036949832',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b6dbbf8-db35-4357-8842-7045419a5e1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3de20aa9426041e1892eb47b451973b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:44:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:44:13Z,use_quota=True,user_id='fe3d03e0cfa34c4d9fd5681af5a0b160',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:44:27 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-f7541301-0b8a-456b-b702-5881f32392ca tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Creating volume 6b6dbbf8-db35-4357-8842-7045419a5e1b {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:44:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f7541301-0b8a-456b-b702-5881f32392ca tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:44:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f7541301-0b8a-456b-b702-5881f32392ca tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:44:27 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f7541301-0b8a-456b-b702-5881f32392ca tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:44:27 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f7541301-0b8a-456b-b702-5881f32392ca tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:44:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f7541301-0b8a-456b-b702-5881f32392ca tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:44:27 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f7541301-0b8a-456b-b702-5881f32392ca tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:44:27 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-f7541301-0b8a-456b-b702-5881f32392ca tempest-CreateVolumesFromSourceVolumeTest-123286107 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:44:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f7541301-0b8a-456b-b702-5881f32392ca tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-6b6dbbf8-db35-4357-8842-7045419a5e1b 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:44:27 devstack sudo[100026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-6b6dbbf8-db35-4357-8842-7045419a5e1b 1073741824
Jul 09 14:44:27 devstack sudo[100026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:44:27 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-18e31a3c-2ac5-42d8-aeb5-92f2132b2357 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb898601-107b-4a7a-afc3-e6bad58670a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2094cb70-7453-46c6-9c1a-fd425676b052', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:44:27 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-18e31a3c-2ac5-42d8-aeb5-92f2132b2357 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d9780cf-b6ef-4672-9be9-01e09b358525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:44:27 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-18e31a3c-2ac5-42d8-aeb5-92f2132b2357 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Volume volume-2094cb70-7453-46c6-9c1a-fd425676b052 (2094cb70-7453-46c6-9c1a-fd425676b052): created successfully
Jul 09 14:44:27 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-18e31a3c-2ac5-42d8-aeb5-92f2132b2357 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d9780cf-b6ef-4672-9be9-01e09b358525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:44:27 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-18e31a3c-2ac5-42d8-aeb5-92f2132b2357 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Flow 'volume_create_manager' (26d506aa-e1dd-4c08-858b-293d21cd1d89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:44:27 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-18e31a3c-2ac5-42d8-aeb5-92f2132b2357 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Created volume successfully.
Jul 09 14:44:27 devstack sudo[100023]: pam_unix(sudo:session): session closed for user root
Jul 09 14:44:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5af2bdcc-b8e7-4d4b-987d-ffb277655adb tempest-VolumesActionsTest-1906998927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.695s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:44:27 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-5af2bdcc-b8e7-4d4b-987d-ffb277655adb tempest-VolumesActionsTest-1906998927 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:44:27 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-5af2bdcc-b8e7-4d4b-987d-ffb277655adb tempest-VolumesActionsTest-1906998927 None] Deleted volume successfully.
Jul 09 14:44:27 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-5af2bdcc-b8e7-4d4b-987d-ffb277655adb tempest-VolumesActionsTest-1906998927 None] Lock "cinder-9c94308d-f5c8-4a1c-9fd3-eedf373f1b20-delete_volume" released by "delete_volume" :: held 2.685s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:44:28 devstack sudo[100026]: pam_unix(sudo:session): session closed for user root
Jul 09 14:44:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f7541301-0b8a-456b-b702-5881f32392ca tempest-CreateVolumesFromSourceVolumeTest-123286107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-6b6dbbf8-db35-4357-8842-7045419a5e1b 1073741824" returned: 0 in 0.927s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:44:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f7541301-0b8a-456b-b702-5881f32392ca tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-6b6dbbf8-db35-4357-8842-7045419a5e1b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:44:28 devstack sudo[100033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-6b6dbbf8-db35-4357-8842-7045419a5e1b
Jul 09 14:44:28 devstack sudo[100033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:44:29 devstack sudo[100033]: pam_unix(sudo:session): session closed for user root
Jul 09 14:44:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f7541301-0b8a-456b-b702-5881f32392ca tempest-CreateVolumesFromSourceVolumeTest-123286107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-6b6dbbf8-db35-4357-8842-7045419a5e1b" returned: 0 in 0.711s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:44:29 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f7541301-0b8a-456b-b702-5881f32392ca tempest-CreateVolumesFromSourceVolumeTest-123286107 None] <== create_volume: return (1683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:44:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f7541301-0b8a-456b-b702-5881f32392ca tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.689s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:44:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b5549565-80f1-49bb-81eb-ebcbac064be1 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.764s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:44:29 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b5549565-80f1-49bb-81eb-ebcbac064be1 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:44:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1755066725',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcff4054-1c8c-4e3b-8661-c2db5f2150d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3de20aa9426041e1892eb47b451973b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:44:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:44:13Z,use_quota=True,user_id='fe3d03e0cfa34c4d9fd5681af5a0b160',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:44:29 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-b5549565-80f1-49bb-81eb-ebcbac064be1 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Creating volume fcff4054-1c8c-4e3b-8661-c2db5f2150d0 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:44:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b5549565-80f1-49bb-81eb-ebcbac064be1 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:44:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b5549565-80f1-49bb-81eb-ebcbac064be1 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:44:29 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b5549565-80f1-49bb-81eb-ebcbac064be1 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:44:29 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b5549565-80f1-49bb-81eb-ebcbac064be1 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:44:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b5549565-80f1-49bb-81eb-ebcbac064be1 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:44:29 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b5549565-80f1-49bb-81eb-ebcbac064be1 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:44:29 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-b5549565-80f1-49bb-81eb-ebcbac064be1 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:44:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b5549565-80f1-49bb-81eb-ebcbac064be1 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-fcff4054-1c8c-4e3b-8661-c2db5f2150d0 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:44:29 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f7541301-0b8a-456b-b702-5881f32392ca tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f1276b4-3ae8-494e-adaa-6f57cc31122d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b6dbbf8-db35-4357-8842-7045419a5e1b', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:44:29 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f7541301-0b8a-456b-b702-5881f32392ca tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8a40189-c846-48bc-9b9d-d74df21d1f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:44:29 devstack sudo[100037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-fcff4054-1c8c-4e3b-8661-c2db5f2150d0 1073741824
Jul 09 14:44:29 devstack sudo[100037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:44:29 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-f7541301-0b8a-456b-b702-5881f32392ca tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Volume volume-6b6dbbf8-db35-4357-8842-7045419a5e1b (6b6dbbf8-db35-4357-8842-7045419a5e1b): created successfully
Jul 09 14:44:29 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f7541301-0b8a-456b-b702-5881f32392ca tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8a40189-c846-48bc-9b9d-d74df21d1f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:44:29 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f7541301-0b8a-456b-b702-5881f32392ca tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Flow 'volume_create_manager' (8cd4b6c8-5bb0-4e46-a6bd-7889ada01899) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:44:29 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-f7541301-0b8a-456b-b702-5881f32392ca tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Created volume successfully.
Jul 09 14:44:30 devstack sudo[100037]: pam_unix(sudo:session): session closed for user root
Jul 09 14:44:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b5549565-80f1-49bb-81eb-ebcbac064be1 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-fcff4054-1c8c-4e3b-8661-c2db5f2150d0 1073741824" returned: 0 in 0.893s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:44:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b5549565-80f1-49bb-81eb-ebcbac064be1 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-fcff4054-1c8c-4e3b-8661-c2db5f2150d0 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:44:30 devstack sudo[100043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-fcff4054-1c8c-4e3b-8661-c2db5f2150d0
Jul 09 14:44:30 devstack sudo[100043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:44:30 devstack sudo[100043]: pam_unix(sudo:session): session closed for user root
Jul 09 14:44:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b5549565-80f1-49bb-81eb-ebcbac064be1 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-fcff4054-1c8c-4e3b-8661-c2db5f2150d0" returned: 0 in 0.832s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:44:30 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b5549565-80f1-49bb-81eb-ebcbac064be1 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] <== create_volume: return (1773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:44:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b5549565-80f1-49bb-81eb-ebcbac064be1 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.776s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:44:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-65c48525-470a-4e6e-bed2-643397571797 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.077s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:44:30 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-65c48525-470a-4e6e-bed2-643397571797 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:44:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1801222534',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef2ef272-0d68-4238-b75e-c53657209196,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3de20aa9426041e1892eb47b451973b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:44:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:44:14Z,use_quota=True,user_id='fe3d03e0cfa34c4d9fd5681af5a0b160',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:44:31 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-65c48525-470a-4e6e-bed2-643397571797 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Creating volume ef2ef272-0d68-4238-b75e-c53657209196 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:44:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-65c48525-470a-4e6e-bed2-643397571797 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:44:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-65c48525-470a-4e6e-bed2-643397571797 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:44:31 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-65c48525-470a-4e6e-bed2-643397571797 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:44:31 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-65c48525-470a-4e6e-bed2-643397571797 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:44:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-65c48525-470a-4e6e-bed2-643397571797 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:44:31 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-65c48525-470a-4e6e-bed2-643397571797 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:44:31 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-65c48525-470a-4e6e-bed2-643397571797 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:44:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-65c48525-470a-4e6e-bed2-643397571797 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ef2ef272-0d68-4238-b75e-c53657209196 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:44:31 devstack sudo[100047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ef2ef272-0d68-4238-b75e-c53657209196 1073741824
Jul 09 14:44:31 devstack sudo[100047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:44:31 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b5549565-80f1-49bb-81eb-ebcbac064be1 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72d26246-7e7a-45a7-badd-c4a23f86c18d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcff4054-1c8c-4e3b-8661-c2db5f2150d0', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:44:31 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b5549565-80f1-49bb-81eb-ebcbac064be1 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57713905-9d15-44ed-aef3-9549b0898122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:44:31 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-b5549565-80f1-49bb-81eb-ebcbac064be1 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Volume volume-fcff4054-1c8c-4e3b-8661-c2db5f2150d0 (fcff4054-1c8c-4e3b-8661-c2db5f2150d0): created successfully
Jul 09 14:44:31 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b5549565-80f1-49bb-81eb-ebcbac064be1 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57713905-9d15-44ed-aef3-9549b0898122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:44:31 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b5549565-80f1-49bb-81eb-ebcbac064be1 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Flow 'volume_create_manager' (1407531d-7e7f-4d85-996e-d12729164207) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:44:31 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-b5549565-80f1-49bb-81eb-ebcbac064be1 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Created volume successfully.
Jul 09 14:44:31 devstack sudo[100047]: pam_unix(sudo:session): session closed for user root
Jul 09 14:44:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-65c48525-470a-4e6e-bed2-643397571797 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ef2ef272-0d68-4238-b75e-c53657209196 1073741824" returned: 0 in 0.929s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:44:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-65c48525-470a-4e6e-bed2-643397571797 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ef2ef272-0d68-4238-b75e-c53657209196 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:44:31 devstack sudo[100054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ef2ef272-0d68-4238-b75e-c53657209196
Jul 09 14:44:31 devstack sudo[100054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:44:32 devstack sudo[100054]: pam_unix(sudo:session): session closed for user root
Jul 09 14:44:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-65c48525-470a-4e6e-bed2-643397571797 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ef2ef272-0d68-4238-b75e-c53657209196" returned: 0 in 0.653s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:44:32 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-65c48525-470a-4e6e-bed2-643397571797 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] <== create_volume: return (1622ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:44:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-65c48525-470a-4e6e-bed2-643397571797 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.625s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:44:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1a78e7df-c89d-4aa8-95b4-af4564a84cd8 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.409s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:44:32 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-1a78e7df-c89d-4aa8-95b4-af4564a84cd8 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:44:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1040178809',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e954ae2-a0d8-4a9f-bbde-bb68cbd413fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3de20aa9426041e1892eb47b451973b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:44:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:44:14Z,use_quota=True,user_id='fe3d03e0cfa34c4d9fd5681af5a0b160',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:44:32 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-1a78e7df-c89d-4aa8-95b4-af4564a84cd8 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Creating volume 9e954ae2-a0d8-4a9f-bbde-bb68cbd413fc {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:44:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1a78e7df-c89d-4aa8-95b4-af4564a84cd8 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:44:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1a78e7df-c89d-4aa8-95b4-af4564a84cd8 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:44:32 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-1a78e7df-c89d-4aa8-95b4-af4564a84cd8 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:44:32 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-1a78e7df-c89d-4aa8-95b4-af4564a84cd8 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:44:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1a78e7df-c89d-4aa8-95b4-af4564a84cd8 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:44:32 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-1a78e7df-c89d-4aa8-95b4-af4564a84cd8 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:44:32 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-1a78e7df-c89d-4aa8-95b4-af4564a84cd8 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:44:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1a78e7df-c89d-4aa8-95b4-af4564a84cd8 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-9e954ae2-a0d8-4a9f-bbde-bb68cbd413fc 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:44:32 devstack sudo[100057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-9e954ae2-a0d8-4a9f-bbde-bb68cbd413fc 1073741824
Jul 09 14:44:32 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-65c48525-470a-4e6e-bed2-643397571797 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca486fe6-bd0f-477a-8631-d182b1630ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef2ef272-0d68-4238-b75e-c53657209196', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:44:32 devstack sudo[100057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:44:32 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-65c48525-470a-4e6e-bed2-643397571797 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (464d908a-fd1c-451a-be7e-ed40a9aa421b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:44:32 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-65c48525-470a-4e6e-bed2-643397571797 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Volume volume-ef2ef272-0d68-4238-b75e-c53657209196 (ef2ef272-0d68-4238-b75e-c53657209196): created successfully
Jul 09 14:44:32 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-65c48525-470a-4e6e-bed2-643397571797 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (464d908a-fd1c-451a-be7e-ed40a9aa421b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:44:32 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-65c48525-470a-4e6e-bed2-643397571797 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Flow 'volume_create_manager' (b1722d7a-cf76-4681-b331-7206264c7666) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:44:32 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-65c48525-470a-4e6e-bed2-643397571797 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Created volume successfully.
Jul 09 14:44:33 devstack sudo[100057]: pam_unix(sudo:session): session closed for user root
Jul 09 14:44:33 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c064c8d-c42d-46e0-81b0-7450848d2f3d tempest-VolumesCloneTest-1003273504 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:44:33 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0c064c8d-c42d-46e0-81b0-7450848d2f3d tempest-VolumesCloneTest-1003273504 None] Flow 'volume_create_manager' (1b07e78c-3c6c-4cc2-906e-05dfc1e07b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:44:33 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0c064c8d-c42d-46e0-81b0-7450848d2f3d tempest-VolumesCloneTest-1003273504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cffce156-867a-4115-8ccd-c060780c63d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:44:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1a78e7df-c89d-4aa8-95b4-af4564a84cd8 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-9e954ae2-a0d8-4a9f-bbde-bb68cbd413fc 1073741824" returned: 0 in 1.030s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:44:33 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0c064c8d-c42d-46e0-81b0-7450848d2f3d tempest-VolumesCloneTest-1003273504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cffce156-867a-4115-8ccd-c060780c63d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:44:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-660832064',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11262cd0-202f-472f-9d01-54869632f8de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4fb16f6840145de95ba89b001d554d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:44:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:44:34Z,use_quota=True,user_id='a11064e526364245bdf811bd0d7e106a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:44:33 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0c064c8d-c42d-46e0-81b0-7450848d2f3d tempest-VolumesCloneTest-1003273504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a9fcd89-fc31-4046-9d53-c5bd3fb97502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:44:33 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0c064c8d-c42d-46e0-81b0-7450848d2f3d tempest-VolumesCloneTest-1003273504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a9fcd89-fc31-4046-9d53-c5bd3fb97502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:44:33 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0c064c8d-c42d-46e0-81b0-7450848d2f3d tempest-VolumesCloneTest-1003273504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (187a0201-4631-42d6-9a07-5b8d3455f129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:44:33 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0c064c8d-c42d-46e0-81b0-7450848d2f3d tempest-VolumesCloneTest-1003273504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (187a0201-4631-42d6-9a07-5b8d3455f129) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11262cd0-202f-472f-9d01-54869632f8de', 'volume_name': 'volume-11262cd0-202f-472f-9d01-54869632f8de', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:44:33 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0c064c8d-c42d-46e0-81b0-7450848d2f3d tempest-VolumesCloneTest-1003273504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09da144d-560d-4e0c-a3dc-0ac34a537ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:44:33 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0c064c8d-c42d-46e0-81b0-7450848d2f3d tempest-VolumesCloneTest-1003273504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09da144d-560d-4e0c-a3dc-0ac34a537ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:44:33 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0c064c8d-c42d-46e0-81b0-7450848d2f3d tempest-VolumesCloneTest-1003273504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (861a8845-156b-4f97-a78f-e452d48ae649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:44:33 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-0c064c8d-c42d-46e0-81b0-7450848d2f3d tempest-VolumesCloneTest-1003273504 None] Volume 11262cd0-202f-472f-9d01-54869632f8de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11262cd0-202f-472f-9d01-54869632f8de', 'volume_size': 1}
Jul 09 14:44:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0c064c8d-c42d-46e0-81b0-7450848d2f3d tempest-VolumesCloneTest-1003273504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:44:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1a78e7df-c89d-4aa8-95b4-af4564a84cd8 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-9e954ae2-a0d8-4a9f-bbde-bb68cbd413fc {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:44:33 devstack sudo[100063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-9e954ae2-a0d8-4a9f-bbde-bb68cbd413fc
Jul 09 14:44:33 devstack sudo[100063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:44:34 devstack sudo[100063]: pam_unix(sudo:session): session closed for user root
Jul 09 14:44:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1a78e7df-c89d-4aa8-95b4-af4564a84cd8 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-9e954ae2-a0d8-4a9f-bbde-bb68cbd413fc" returned: 0 in 0.655s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:44:34 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-1a78e7df-c89d-4aa8-95b4-af4564a84cd8 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] <== create_volume: return (1784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:44:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1a78e7df-c89d-4aa8-95b4-af4564a84cd8 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.786s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:44:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-f6251900-c0ad-4914-869d-7ae90849206c req-e58493b8-b956-4626-90a0-43cd2821588c tempest-TestShelveInstance-1427794981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 8.800s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:44:34 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1a78e7df-c89d-4aa8-95b4-af4564a84cd8 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd36c724-19d7-4c9b-bf50-f2da7817d2ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e954ae2-a0d8-4a9f-bbde-bb68cbd413fc', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:44:34 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1a78e7df-c89d-4aa8-95b4-af4564a84cd8 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a2e9519-7321-420a-8bc4-dd9c383e2945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:44:34 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c08ccf-0a86-4fb1-a032-9f8f333112d7]: (4, 'raw') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:44:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-f6251900-c0ad-4914-869d-7ae90849206c req-e58493b8-b956-4626-90a0-43cd2821588c tempest-TestShelveInstance-1427794981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-cda2942f-b3a7-4c7a-a361-bd744f42b5b2 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:44:34 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-1a78e7df-c89d-4aa8-95b4-af4564a84cd8 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Volume volume-9e954ae2-a0d8-4a9f-bbde-bb68cbd413fc (9e954ae2-a0d8-4a9f-bbde-bb68cbd413fc): created successfully
Jul 09 14:44:34 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1a78e7df-c89d-4aa8-95b4-af4564a84cd8 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a2e9519-7321-420a-8bc4-dd9c383e2945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:44:34 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1a78e7df-c89d-4aa8-95b4-af4564a84cd8 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Flow 'volume_create_manager' (89f98d03-dff1-4dfc-aec2-4490958ea821) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:44:34 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-1a78e7df-c89d-4aa8-95b4-af4564a84cd8 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Created volume successfully.
Jul 09 14:44:34 devstack sudo[100066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-cda2942f-b3a7-4c7a-a361-bd744f42b5b2
Jul 09 14:44:34 devstack sudo[100066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:44:34 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-33370f71-dae2-4c84-b69c-cb5179133f8f tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Acquiring lock "cinder-9e954ae2-a0d8-4a9f-bbde-bb68cbd413fc-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:44:34 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-33370f71-dae2-4c84-b69c-cb5179133f8f tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Lock "cinder-9e954ae2-a0d8-4a9f-bbde-bb68cbd413fc-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:44:35 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-33370f71-dae2-4c84-b69c-cb5179133f8f tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Acquiring lock "cinder-quobyte-9e954ae2-a0d8-4a9f-bbde-bb68cbd413fc" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:44:35 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-33370f71-dae2-4c84-b69c-cb5179133f8f tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Lock "cinder-quobyte-9e954ae2-a0d8-4a9f-bbde-bb68cbd413fc" acquired by "delete_volume" :: waited 0.017s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:44:35 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[9486623e-0d2a-4934-9b00-a677d989aa2d]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:44:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-33370f71-dae2-4c84-b69c-cb5179133f8f tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-9e954ae2-a0d8-4a9f-bbde-bb68cbd413fc {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:44:35 devstack sudo[100068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-9e954ae2-a0d8-4a9f-bbde-bb68cbd413fc
Jul 09 14:44:35 devstack sudo[100068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:44:35 devstack sudo[100066]: pam_unix(sudo:session): session closed for user root
Jul 09 14:44:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-f6251900-c0ad-4914-869d-7ae90849206c req-e58493b8-b956-4626-90a0-43cd2821588c tempest-TestShelveInstance-1427794981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-cda2942f-b3a7-4c7a-a361-bd744f42b5b2" returned: 0 in 0.793s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:44:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-f6251900-c0ad-4914-869d-7ae90849206c req-e58493b8-b956-4626-90a0-43cd2821588c tempest-TestShelveInstance-1427794981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-cda2942f-b3a7-4c7a-a361-bd744f42b5b2 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:44:35 devstack sudo[100072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-cda2942f-b3a7-4c7a-a361-bd744f42b5b2
Jul 09 14:44:35 devstack sudo[100072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:44:35 devstack sudo[100068]: pam_unix(sudo:session): session closed for user root
Jul 09 14:44:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-33370f71-dae2-4c84-b69c-cb5179133f8f tempest-CreateVolumesFromSourceVolumeTest-123286107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-9e954ae2-a0d8-4a9f-bbde-bb68cbd413fc" returned: 0 in 0.794s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:44:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-33370f71-dae2-4c84-b69c-cb5179133f8f tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-9e954ae2-a0d8-4a9f-bbde-bb68cbd413fc {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:44:35 devstack sudo[100078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-9e954ae2-a0d8-4a9f-bbde-bb68cbd413fc
Jul 09 14:44:35 devstack sudo[100078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:44:36 devstack sudo[100072]: pam_unix(sudo:session): session closed for user root
Jul 09 14:44:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-f6251900-c0ad-4914-869d-7ae90849206c req-e58493b8-b956-4626-90a0-43cd2821588c tempest-TestShelveInstance-1427794981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-cda2942f-b3a7-4c7a-a361-bd744f42b5b2" returned: 1 in 0.796s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:44:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-f6251900-c0ad-4914-869d-7ae90849206c req-e58493b8-b956-4626-90a0-43cd2821588c tempest-TestShelveInstance-1427794981 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-cda2942f-b3a7-4c7a-a361-bd744f42b5b2' failed. Not Retrying. {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 09 14:44:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-f6251900-c0ad-4914-869d-7ae90849206c req-e58493b8-b956-4626-90a0-43cd2821588c tempest-TestShelveInstance-1427794981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.625s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:44:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b6bd23b7-398b-487b-a96c-b9fe163f2414 tempest-VolumesListAdminTestJSON-1929470986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.141s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:44:36 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b6bd23b7-398b-487b-a96c-b9fe163f2414 tempest-VolumesListAdminTestJSON-1929470986 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:44:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2051701490',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b91a5ad-7f83-40a4-a007-8c5bf7267dd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0bce8cd27e74f4fa893b3a927d6cce9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:44:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:44:27Z,use_quota=True,user_id='276d6d8cb9654d80a06aa07272ef5873',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:44:36 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-b6bd23b7-398b-487b-a96c-b9fe163f2414 tempest-VolumesListAdminTestJSON-1929470986 None] Creating volume 6b91a5ad-7f83-40a4-a007-8c5bf7267dd5 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:44:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b6bd23b7-398b-487b-a96c-b9fe163f2414 tempest-VolumesListAdminTestJSON-1929470986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:44:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b6bd23b7-398b-487b-a96c-b9fe163f2414 tempest-VolumesListAdminTestJSON-1929470986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:44:36 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b6bd23b7-398b-487b-a96c-b9fe163f2414 tempest-VolumesListAdminTestJSON-1929470986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:44:36 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b6bd23b7-398b-487b-a96c-b9fe163f2414 tempest-VolumesListAdminTestJSON-1929470986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:44:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b6bd23b7-398b-487b-a96c-b9fe163f2414 tempest-VolumesListAdminTestJSON-1929470986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:44:36 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b6bd23b7-398b-487b-a96c-b9fe163f2414 tempest-VolumesListAdminTestJSON-1929470986 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:44:36 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-b6bd23b7-398b-487b-a96c-b9fe163f2414 tempest-VolumesListAdminTestJSON-1929470986 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:44:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b6bd23b7-398b-487b-a96c-b9fe163f2414 tempest-VolumesListAdminTestJSON-1929470986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-6b91a5ad-7f83-40a4-a007-8c5bf7267dd5 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:44:36 devstack sudo[100083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-6b91a5ad-7f83-40a4-a007-8c5bf7267dd5 1073741824
Jul 09 14:44:36 devstack sudo[100083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:44:36 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-f6251900-c0ad-4914-869d-7ae90849206c req-e58493b8-b956-4626-90a0-43cd2821588c tempest-TestShelveInstance-1427794981 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653', 'name': 'volume-cda2942f-b3a7-4c7a-a361-bd744f42b5b2', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9f330044-1fd6-436f-b189-d27f3c50379f', 'enforce_multipath': True} {{(pid=87230) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 09 14:44:36 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-f6251900-c0ad-4914-869d-7ae90849206c req-e58493b8-b956-4626-90a0-43cd2821588c tempest-TestShelveInstance-1427794981 None] attachment_update completed successfully.
Jul 09 14:44:36 devstack sudo[100078]: pam_unix(sudo:session): session closed for user root
Jul 09 14:44:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-33370f71-dae2-4c84-b69c-cb5179133f8f tempest-CreateVolumesFromSourceVolumeTest-123286107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-9e954ae2-a0d8-4a9f-bbde-bb68cbd413fc" returned: 0 in 0.668s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:44:36 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-33370f71-dae2-4c84-b69c-cb5179133f8f tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Lock "cinder-quobyte-9e954ae2-a0d8-4a9f-bbde-bb68cbd413fc" released by "delete_volume" :: held 1.507s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:44:36 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-33370f71-dae2-4c84-b69c-cb5179133f8f tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Created reservations ['b3b0b911-f4c7-4291-838d-d3ac55e538f6', '1ed847a9-22da-40c1-9edf-2dd956c09529', 'a54fdff1-b5cf-42cb-bd46-ee13a7f8efb3', '71e946d1-a284-4267-ab21-e4573cf181e8'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:44:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-33370f71-dae2-4c84-b69c-cb5179133f8f tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:44:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-33370f71-dae2-4c84-b69c-cb5179133f8f tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:44:36 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-33370f71-dae2-4c84-b69c-cb5179133f8f tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:44:36 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-33370f71-dae2-4c84-b69c-cb5179133f8f tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:44:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-33370f71-dae2-4c84-b69c-cb5179133f8f tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:44:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-33370f71-dae2-4c84-b69c-cb5179133f8f tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:44:36 devstack sudo[100088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:44:36 devstack sudo[100088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:44:37 devstack sudo[100083]: pam_unix(sudo:session): session closed for user root
Jul 09 14:44:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b6bd23b7-398b-487b-a96c-b9fe163f2414 tempest-VolumesListAdminTestJSON-1929470986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-6b91a5ad-7f83-40a4-a007-8c5bf7267dd5 1073741824" returned: 0 in 0.959s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:44:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b6bd23b7-398b-487b-a96c-b9fe163f2414 tempest-VolumesListAdminTestJSON-1929470986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-6b91a5ad-7f83-40a4-a007-8c5bf7267dd5 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:44:37 devstack sudo[100091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-6b91a5ad-7f83-40a4-a007-8c5bf7267dd5
Jul 09 14:44:37 devstack sudo[100091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:44:37 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7f49f72f-31bc-406c-a421-d49c24a04304 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Acquiring lock "cinder-ef2ef272-0d68-4238-b75e-c53657209196-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:44:37 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7f49f72f-31bc-406c-a421-d49c24a04304 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Lock "cinder-ef2ef272-0d68-4238-b75e-c53657209196-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:44:37 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7f49f72f-31bc-406c-a421-d49c24a04304 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Acquiring lock "cinder-quobyte-ef2ef272-0d68-4238-b75e-c53657209196" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:44:37 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7f49f72f-31bc-406c-a421-d49c24a04304 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Lock "cinder-quobyte-ef2ef272-0d68-4238-b75e-c53657209196" acquired by "delete_volume" :: waited 0.015s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:44:37 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7baf1f5-1fda-427f-9097-3a9d061b5430]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:44:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7f49f72f-31bc-406c-a421-d49c24a04304 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ef2ef272-0d68-4238-b75e-c53657209196 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:44:37 devstack sudo[100088]: pam_unix(sudo:session): session closed for user root
Jul 09 14:44:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-33370f71-dae2-4c84-b69c-cb5179133f8f tempest-CreateVolumesFromSourceVolumeTest-123286107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.706s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:44:37 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-33370f71-dae2-4c84-b69c-cb5179133f8f tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:44:37 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-33370f71-dae2-4c84-b69c-cb5179133f8f tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Deleted volume successfully.
Jul 09 14:44:37 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-33370f71-dae2-4c84-b69c-cb5179133f8f tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Lock "cinder-9e954ae2-a0d8-4a9f-bbde-bb68cbd413fc-delete_volume" released by "delete_volume" :: held 2.451s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:44:37 devstack sudo[100094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ef2ef272-0d68-4238-b75e-c53657209196
Jul 09 14:44:37 devstack sudo[100094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:44:37 devstack sudo[100091]: pam_unix(sudo:session): session closed for user root
Jul 09 14:44:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b6bd23b7-398b-487b-a96c-b9fe163f2414 tempest-VolumesListAdminTestJSON-1929470986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-6b91a5ad-7f83-40a4-a007-8c5bf7267dd5" returned: 0 in 0.709s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:44:37 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b6bd23b7-398b-487b-a96c-b9fe163f2414 tempest-VolumesListAdminTestJSON-1929470986 None] <== create_volume: return (1708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:44:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b6bd23b7-398b-487b-a96c-b9fe163f2414 tempest-VolumesListAdminTestJSON-1929470986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.711s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:44:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0c064c8d-c42d-46e0-81b0-7450848d2f3d tempest-VolumesCloneTest-1003273504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.027s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:44:37 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-0c064c8d-c42d-46e0-81b0-7450848d2f3d tempest-VolumesCloneTest-1003273504 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:44:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-660832064',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11262cd0-202f-472f-9d01-54869632f8de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4fb16f6840145de95ba89b001d554d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:44:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:44:34Z,use_quota=True,user_id='a11064e526364245bdf811bd0d7e106a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:44:37 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-0c064c8d-c42d-46e0-81b0-7450848d2f3d tempest-VolumesCloneTest-1003273504 None] Creating volume 11262cd0-202f-472f-9d01-54869632f8de {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:44:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0c064c8d-c42d-46e0-81b0-7450848d2f3d tempest-VolumesCloneTest-1003273504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:44:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0c064c8d-c42d-46e0-81b0-7450848d2f3d tempest-VolumesCloneTest-1003273504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:44:37 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-0c064c8d-c42d-46e0-81b0-7450848d2f3d tempest-VolumesCloneTest-1003273504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:44:37 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-0c064c8d-c42d-46e0-81b0-7450848d2f3d tempest-VolumesCloneTest-1003273504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:44:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0c064c8d-c42d-46e0-81b0-7450848d2f3d tempest-VolumesCloneTest-1003273504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:44:37 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-0c064c8d-c42d-46e0-81b0-7450848d2f3d tempest-VolumesCloneTest-1003273504 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:44:37 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-0c064c8d-c42d-46e0-81b0-7450848d2f3d tempest-VolumesCloneTest-1003273504 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:44:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0c064c8d-c42d-46e0-81b0-7450848d2f3d tempest-VolumesCloneTest-1003273504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-11262cd0-202f-472f-9d01-54869632f8de 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:44:37 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b6bd23b7-398b-487b-a96c-b9fe163f2414 tempest-VolumesListAdminTestJSON-1929470986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bca27946-0fb2-4041-930c-1b2e67c7f2e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b91a5ad-7f83-40a4-a007-8c5bf7267dd5', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:44:37 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b6bd23b7-398b-487b-a96c-b9fe163f2414 tempest-VolumesListAdminTestJSON-1929470986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6dc6a07-b79c-46a4-a034-aefd3fdf0293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:44:37 devstack sudo[100097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-11262cd0-202f-472f-9d01-54869632f8de 1073741824
Jul 09 14:44:37 devstack sudo[100097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:44:37 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-b6bd23b7-398b-487b-a96c-b9fe163f2414 tempest-VolumesListAdminTestJSON-1929470986 None] Volume volume-6b91a5ad-7f83-40a4-a007-8c5bf7267dd5 (6b91a5ad-7f83-40a4-a007-8c5bf7267dd5): created successfully
Jul 09 14:44:37 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b6bd23b7-398b-487b-a96c-b9fe163f2414 tempest-VolumesListAdminTestJSON-1929470986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6dc6a07-b79c-46a4-a034-aefd3fdf0293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:44:37 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b6bd23b7-398b-487b-a96c-b9fe163f2414 tempest-VolumesListAdminTestJSON-1929470986 None] Flow 'volume_create_manager' (42308dca-7d61-4ca9-b605-d7b3254e0ebe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:44:37 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-b6bd23b7-398b-487b-a96c-b9fe163f2414 tempest-VolumesListAdminTestJSON-1929470986 None] Created volume successfully.
Jul 09 14:44:38 devstack sudo[100094]: pam_unix(sudo:session): session closed for user root
Jul 09 14:44:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7f49f72f-31bc-406c-a421-d49c24a04304 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ef2ef272-0d68-4238-b75e-c53657209196" returned: 0 in 0.826s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:44:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7f49f72f-31bc-406c-a421-d49c24a04304 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ef2ef272-0d68-4238-b75e-c53657209196 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:44:38 devstack sudo[100102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ef2ef272-0d68-4238-b75e-c53657209196
Jul 09 14:44:38 devstack sudo[100102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:44:38 devstack sudo[100097]: pam_unix(sudo:session): session closed for user root
Jul 09 14:44:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0c064c8d-c42d-46e0-81b0-7450848d2f3d tempest-VolumesCloneTest-1003273504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-11262cd0-202f-472f-9d01-54869632f8de 1073741824" returned: 0 in 0.984s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:44:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0c064c8d-c42d-46e0-81b0-7450848d2f3d tempest-VolumesCloneTest-1003273504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-11262cd0-202f-472f-9d01-54869632f8de {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:44:38 devstack sudo[100175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-11262cd0-202f-472f-9d01-54869632f8de
Jul 09 14:44:38 devstack sudo[100175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:44:38 devstack sudo[100102]: pam_unix(sudo:session): session closed for user root
Jul 09 14:44:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7f49f72f-31bc-406c-a421-d49c24a04304 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ef2ef272-0d68-4238-b75e-c53657209196" returned: 0 in 0.686s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:44:38 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7f49f72f-31bc-406c-a421-d49c24a04304 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Lock "cinder-quobyte-ef2ef272-0d68-4238-b75e-c53657209196" released by "delete_volume" :: held 1.566s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:44:38 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-7f49f72f-31bc-406c-a421-d49c24a04304 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Created reservations ['464fbb32-db55-4c80-8d1c-231ec6f15831', 'eec7f4f9-e035-4170-a793-a683e889c658', '31762bfb-a5c0-46e1-b9a0-9c62bbdee1fe', 'bc68c898-93d9-4f79-b6cc-5504b270292b'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:44:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f49f72f-31bc-406c-a421-d49c24a04304 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:44:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f49f72f-31bc-406c-a421-d49c24a04304 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:44:39 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7f49f72f-31bc-406c-a421-d49c24a04304 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:44:39 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7f49f72f-31bc-406c-a421-d49c24a04304 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:44:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f49f72f-31bc-406c-a421-d49c24a04304 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:44:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7f49f72f-31bc-406c-a421-d49c24a04304 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:44:39 devstack sudo[100177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:44:39 devstack sudo[100177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:44:39 devstack sudo[100175]: pam_unix(sudo:session): session closed for user root
Jul 09 14:44:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0c064c8d-c42d-46e0-81b0-7450848d2f3d tempest-VolumesCloneTest-1003273504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-11262cd0-202f-472f-9d01-54869632f8de" returned: 0 in 0.760s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:44:39 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-0c064c8d-c42d-46e0-81b0-7450848d2f3d tempest-VolumesCloneTest-1003273504 None] <== create_volume: return (1794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:44:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0c064c8d-c42d-46e0-81b0-7450848d2f3d tempest-VolumesCloneTest-1003273504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.799s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:44:39 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-ed268450-d187-4318-97a1-44e270f47c9f tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Acquiring lock "cinder-fcff4054-1c8c-4e3b-8661-c2db5f2150d0-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:44:39 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0c064c8d-c42d-46e0-81b0-7450848d2f3d tempest-VolumesCloneTest-1003273504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (861a8845-156b-4f97-a78f-e452d48ae649) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11262cd0-202f-472f-9d01-54869632f8de', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:44:39 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0c064c8d-c42d-46e0-81b0-7450848d2f3d tempest-VolumesCloneTest-1003273504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34230cfe-0292-47e9-b968-dd9d5c850fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:44:39 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-ed268450-d187-4318-97a1-44e270f47c9f tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Lock "cinder-fcff4054-1c8c-4e3b-8661-c2db5f2150d0-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:44:39 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-0c064c8d-c42d-46e0-81b0-7450848d2f3d tempest-VolumesCloneTest-1003273504 None] Volume volume-11262cd0-202f-472f-9d01-54869632f8de (11262cd0-202f-472f-9d01-54869632f8de): created successfully
Jul 09 14:44:39 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0c064c8d-c42d-46e0-81b0-7450848d2f3d tempest-VolumesCloneTest-1003273504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34230cfe-0292-47e9-b968-dd9d5c850fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:44:39 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0c064c8d-c42d-46e0-81b0-7450848d2f3d tempest-VolumesCloneTest-1003273504 None] Flow 'volume_create_manager' (1b07e78c-3c6c-4cc2-906e-05dfc1e07b1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:44:39 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-0c064c8d-c42d-46e0-81b0-7450848d2f3d tempest-VolumesCloneTest-1003273504 None] Created volume successfully.
Jul 09 14:44:39 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-ed268450-d187-4318-97a1-44e270f47c9f tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Acquiring lock "cinder-quobyte-fcff4054-1c8c-4e3b-8661-c2db5f2150d0" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:44:39 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-ed268450-d187-4318-97a1-44e270f47c9f tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Lock "cinder-quobyte-fcff4054-1c8c-4e3b-8661-c2db5f2150d0" acquired by "delete_volume" :: waited 0.021s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:44:39 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a7bc52-fde3-4047-a024-e0ec2c4a4513]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:44:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ed268450-d187-4318-97a1-44e270f47c9f tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-fcff4054-1c8c-4e3b-8661-c2db5f2150d0 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:44:40 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-3679c6ff-af01-4fb3-8c0b-ed1390c3145c tempest-VolumesListAdminTestJSON-780164009 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:44:40 devstack sudo[100177]: pam_unix(sudo:session): session closed for user root
Jul 09 14:44:40 devstack sudo[100195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-fcff4054-1c8c-4e3b-8661-c2db5f2150d0
Jul 09 14:44:40 devstack sudo[100195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:44:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3679c6ff-af01-4fb3-8c0b-ed1390c3145c tempest-VolumesListAdminTestJSON-780164009 None] Flow 'volume_create_manager' (2e7e43ab-528d-47c5-8627-77d71047f09e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:44:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3679c6ff-af01-4fb3-8c0b-ed1390c3145c tempest-VolumesListAdminTestJSON-780164009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (882fd004-2869-4134-a636-5169312b0805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:44:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7f49f72f-31bc-406c-a421-d49c24a04304 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 1.057s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:44:40 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-7f49f72f-31bc-406c-a421-d49c24a04304 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:44:40 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-7f49f72f-31bc-406c-a421-d49c24a04304 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Deleted volume successfully.
Jul 09 14:44:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3679c6ff-af01-4fb3-8c0b-ed1390c3145c tempest-VolumesListAdminTestJSON-780164009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (882fd004-2869-4134-a636-5169312b0805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:44:39Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b86d109d-75d2-4886-8a8b-345e3b0fab19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='506e8d0e681d4b72b2dd387cdf788a70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:44:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:44:40Z,use_quota=True,user_id='3ac4482ae82e4fe69e46b0040312502f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:44:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3679c6ff-af01-4fb3-8c0b-ed1390c3145c tempest-VolumesListAdminTestJSON-780164009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07c67f6a-074b-45d6-989d-685033d6e402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:44:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3679c6ff-af01-4fb3-8c0b-ed1390c3145c tempest-VolumesListAdminTestJSON-780164009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07c67f6a-074b-45d6-989d-685033d6e402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:44:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3679c6ff-af01-4fb3-8c0b-ed1390c3145c tempest-VolumesListAdminTestJSON-780164009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac5d6833-54b3-4dcd-9571-658a5c888ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:44:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3679c6ff-af01-4fb3-8c0b-ed1390c3145c tempest-VolumesListAdminTestJSON-780164009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac5d6833-54b3-4dcd-9571-658a5c888ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b86d109d-75d2-4886-8a8b-345e3b0fab19', 'volume_name': 'volume-b86d109d-75d2-4886-8a8b-345e3b0fab19', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:44:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3679c6ff-af01-4fb3-8c0b-ed1390c3145c tempest-VolumesListAdminTestJSON-780164009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03d1eb2e-a278-4c05-b73d-149a2d91b429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:44:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3679c6ff-af01-4fb3-8c0b-ed1390c3145c tempest-VolumesListAdminTestJSON-780164009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03d1eb2e-a278-4c05-b73d-149a2d91b429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:44:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3679c6ff-af01-4fb3-8c0b-ed1390c3145c tempest-VolumesListAdminTestJSON-780164009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e421035b-fbee-4742-96d5-e57d6f36d33a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:44:40 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-3679c6ff-af01-4fb3-8c0b-ed1390c3145c tempest-VolumesListAdminTestJSON-780164009 None] Volume b86d109d-75d2-4886-8a8b-345e3b0fab19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b86d109d-75d2-4886-8a8b-345e3b0fab19', 'volume_size': 1}
Jul 09 14:44:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3679c6ff-af01-4fb3-8c0b-ed1390c3145c tempest-VolumesListAdminTestJSON-780164009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:44:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3679c6ff-af01-4fb3-8c0b-ed1390c3145c tempest-VolumesListAdminTestJSON-780164009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:44:40 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3679c6ff-af01-4fb3-8c0b-ed1390c3145c tempest-VolumesListAdminTestJSON-780164009 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:44:39Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b86d109d-75d2-4886-8a8b-345e3b0fab19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='506e8d0e681d4b72b2dd387cdf788a70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:44:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:44:40Z,use_quota=True,user_id='3ac4482ae82e4fe69e46b0040312502f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:44:40 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-3679c6ff-af01-4fb3-8c0b-ed1390c3145c tempest-VolumesListAdminTestJSON-780164009 None] Creating volume b86d109d-75d2-4886-8a8b-345e3b0fab19 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:44:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3679c6ff-af01-4fb3-8c0b-ed1390c3145c tempest-VolumesListAdminTestJSON-780164009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:44:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3679c6ff-af01-4fb3-8c0b-ed1390c3145c tempest-VolumesListAdminTestJSON-780164009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:44:40 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3679c6ff-af01-4fb3-8c0b-ed1390c3145c tempest-VolumesListAdminTestJSON-780164009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:44:40 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3679c6ff-af01-4fb3-8c0b-ed1390c3145c tempest-VolumesListAdminTestJSON-780164009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:44:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3679c6ff-af01-4fb3-8c0b-ed1390c3145c tempest-VolumesListAdminTestJSON-780164009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:44:40 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3679c6ff-af01-4fb3-8c0b-ed1390c3145c tempest-VolumesListAdminTestJSON-780164009 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:44:40 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-3679c6ff-af01-4fb3-8c0b-ed1390c3145c tempest-VolumesListAdminTestJSON-780164009 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:44:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3679c6ff-af01-4fb3-8c0b-ed1390c3145c tempest-VolumesListAdminTestJSON-780164009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b86d109d-75d2-4886-8a8b-345e3b0fab19 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:44:40 devstack sudo[100214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b86d109d-75d2-4886-8a8b-345e3b0fab19 1073741824
Jul 09 14:44:40 devstack sudo[100214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:44:40 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7f49f72f-31bc-406c-a421-d49c24a04304 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Lock "cinder-ef2ef272-0d68-4238-b75e-c53657209196-delete_volume" released by "delete_volume" :: held 3.015s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:44:41 devstack sudo[100195]: pam_unix(sudo:session): session closed for user root
Jul 09 14:44:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ed268450-d187-4318-97a1-44e270f47c9f tempest-CreateVolumesFromSourceVolumeTest-123286107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-fcff4054-1c8c-4e3b-8661-c2db5f2150d0" returned: 0 in 1.195s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:44:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ed268450-d187-4318-97a1-44e270f47c9f tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-fcff4054-1c8c-4e3b-8661-c2db5f2150d0 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:44:41 devstack sudo[100235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-fcff4054-1c8c-4e3b-8661-c2db5f2150d0
Jul 09 14:44:41 devstack sudo[100235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:44:41 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-378e8773-7cb1-4eca-bb5a-c63b638dc7bf tempest-VolumesCloneTest-1003273504 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:44:41 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-378e8773-7cb1-4eca-bb5a-c63b638dc7bf tempest-VolumesCloneTest-1003273504 None] Flow 'volume_create_manager' (a190906d-e92b-4c6b-a130-ab940ea730f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:44:41 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-378e8773-7cb1-4eca-bb5a-c63b638dc7bf tempest-VolumesCloneTest-1003273504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b8c5b80-fbd8-40e8-a06b-72e0c6b4191f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:44:41 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-378e8773-7cb1-4eca-bb5a-c63b638dc7bf tempest-VolumesCloneTest-1003273504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b8c5b80-fbd8-40e8-a06b-72e0c6b4191f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:44:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1012099402',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db8bfc68-a815-42aa-b1f9-fe91b3ab7eae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4fb16f6840145de95ba89b001d554d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:44:41Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=11262cd0-202f-472f-9d01-54869632f8de,status='creating',terminated_at=None,updated_at=2026-07-09T12:44:41Z,use_quota=True,user_id='a11064e526364245bdf811bd0d7e106a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:44:41 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-378e8773-7cb1-4eca-bb5a-c63b638dc7bf tempest-VolumesCloneTest-1003273504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd2fa504-83af-485c-ab94-768cb0989aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:44:41 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-378e8773-7cb1-4eca-bb5a-c63b638dc7bf tempest-VolumesCloneTest-1003273504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd2fa504-83af-485c-ab94-768cb0989aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:44:41 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-378e8773-7cb1-4eca-bb5a-c63b638dc7bf tempest-VolumesCloneTest-1003273504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59bb0a77-d6a3-453a-acfb-95b303c3a296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:44:41 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-378e8773-7cb1-4eca-bb5a-c63b638dc7bf tempest-VolumesCloneTest-1003273504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59bb0a77-d6a3-453a-acfb-95b303c3a296) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'db8bfc68-a815-42aa-b1f9-fe91b3ab7eae', 'volume_name': 'volume-db8bfc68-a815-42aa-b1f9-fe91b3ab7eae', 'volume_size': 2, 'source_volid': '11262cd0-202f-472f-9d01-54869632f8de', 'source_volstatus': 'available'}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:44:41 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-378e8773-7cb1-4eca-bb5a-c63b638dc7bf tempest-VolumesCloneTest-1003273504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e74101a-1f11-4687-9a37-19e7e56c34fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:44:41 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-378e8773-7cb1-4eca-bb5a-c63b638dc7bf tempest-VolumesCloneTest-1003273504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e74101a-1f11-4687-9a37-19e7e56c34fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:44:41 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-378e8773-7cb1-4eca-bb5a-c63b638dc7bf tempest-VolumesCloneTest-1003273504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (356c18bd-5883-48b3-92d5-bdb6f782691b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:44:41 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-378e8773-7cb1-4eca-bb5a-c63b638dc7bf tempest-VolumesCloneTest-1003273504 None] Volume db8bfc68-a815-42aa-b1f9-fe91b3ab7eae: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-db8bfc68-a815-42aa-b1f9-fe91b3ab7eae', 'volume_size': 2, 'source_volid': '11262cd0-202f-472f-9d01-54869632f8de', 'source_volstatus': 'available'}
Jul 09 14:44:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-378e8773-7cb1-4eca-bb5a-c63b638dc7bf tempest-VolumesCloneTest-1003273504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:44:41 devstack sudo[100214]: pam_unix(sudo:session): session closed for user root
Jul 09 14:44:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3679c6ff-af01-4fb3-8c0b-ed1390c3145c tempest-VolumesListAdminTestJSON-780164009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b86d109d-75d2-4886-8a8b-345e3b0fab19 1073741824" returned: 0 in 1.227s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:44:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3679c6ff-af01-4fb3-8c0b-ed1390c3145c tempest-VolumesListAdminTestJSON-780164009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b86d109d-75d2-4886-8a8b-345e3b0fab19 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:44:41 devstack sudo[100268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b86d109d-75d2-4886-8a8b-345e3b0fab19
Jul 09 14:44:41 devstack sudo[100268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:44:41 devstack sudo[100235]: pam_unix(sudo:session): session closed for user root
Jul 09 14:44:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ed268450-d187-4318-97a1-44e270f47c9f tempest-CreateVolumesFromSourceVolumeTest-123286107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-fcff4054-1c8c-4e3b-8661-c2db5f2150d0" returned: 0 in 0.716s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:44:41 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-ed268450-d187-4318-97a1-44e270f47c9f tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Lock "cinder-quobyte-fcff4054-1c8c-4e3b-8661-c2db5f2150d0" released by "delete_volume" :: held 1.970s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:44:41 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-ed268450-d187-4318-97a1-44e270f47c9f tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Created reservations ['15295640-4d0d-4460-b3dc-095009ef85d8', '810579fd-c8fc-4fe2-9192-810d659f7356', '2f0144de-ab61-4048-a974-31cdb9bf9e53', 'f722252a-bd29-44f4-9350-0d650bc4b790'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:44:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-ed268450-d187-4318-97a1-44e270f47c9f tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:44:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-ed268450-d187-4318-97a1-44e270f47c9f tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:44:42 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-ed268450-d187-4318-97a1-44e270f47c9f tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:44:42 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-ed268450-d187-4318-97a1-44e270f47c9f tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:44:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-ed268450-d187-4318-97a1-44e270f47c9f tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:44:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ed268450-d187-4318-97a1-44e270f47c9f tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:44:42 devstack sudo[100575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:44:42 devstack sudo[100575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:44:42 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7a10cbae-cf69-4b18-be65-c1409b0d67f2 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Acquiring lock "cinder-6b6dbbf8-db35-4357-8842-7045419a5e1b-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:44:42 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7a10cbae-cf69-4b18-be65-c1409b0d67f2 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Lock "cinder-6b6dbbf8-db35-4357-8842-7045419a5e1b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:44:42 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7a10cbae-cf69-4b18-be65-c1409b0d67f2 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Acquiring lock "cinder-quobyte-6b6dbbf8-db35-4357-8842-7045419a5e1b" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:44:42 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7a10cbae-cf69-4b18-be65-c1409b0d67f2 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Lock "cinder-quobyte-6b6dbbf8-db35-4357-8842-7045419a5e1b" acquired by "delete_volume" :: waited 0.031s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:44:42 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[88555839-4315-4384-90c9-0750af8c4628]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:44:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7a10cbae-cf69-4b18-be65-c1409b0d67f2 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-6b6dbbf8-db35-4357-8842-7045419a5e1b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:44:42 devstack sudo[100268]: pam_unix(sudo:session): session closed for user root
Jul 09 14:44:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3679c6ff-af01-4fb3-8c0b-ed1390c3145c tempest-VolumesListAdminTestJSON-780164009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b86d109d-75d2-4886-8a8b-345e3b0fab19" returned: 0 in 0.922s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:44:42 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3679c6ff-af01-4fb3-8c0b-ed1390c3145c tempest-VolumesListAdminTestJSON-780164009 None] <== create_volume: return (2190ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:44:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3679c6ff-af01-4fb3-8c0b-ed1390c3145c tempest-VolumesListAdminTestJSON-780164009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.193s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:44:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-378e8773-7cb1-4eca-bb5a-c63b638dc7bf tempest-VolumesCloneTest-1003273504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.134s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:44:42 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-378e8773-7cb1-4eca-bb5a-c63b638dc7bf tempest-VolumesCloneTest-1003273504 None] Cloning volume 11262cd0-202f-472f-9d01-54869632f8de to volume db8bfc68-a815-42aa-b1f9-fe91b3ab7eae
Jul 09 14:44:42 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3679c6ff-af01-4fb3-8c0b-ed1390c3145c tempest-VolumesListAdminTestJSON-780164009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e421035b-fbee-4742-96d5-e57d6f36d33a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b86d109d-75d2-4886-8a8b-345e3b0fab19', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:44:42 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3679c6ff-af01-4fb3-8c0b-ed1390c3145c tempest-VolumesListAdminTestJSON-780164009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc85f965-26f8-47de-8589-b75dede8fee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:44:42 devstack sudo[100578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-6b6dbbf8-db35-4357-8842-7045419a5e1b
Jul 09 14:44:42 devstack sudo[100578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:44:42 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-3679c6ff-af01-4fb3-8c0b-ed1390c3145c tempest-VolumesListAdminTestJSON-780164009 None] Volume volume-b86d109d-75d2-4886-8a8b-345e3b0fab19 (b86d109d-75d2-4886-8a8b-345e3b0fab19): created successfully
Jul 09 14:44:42 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3679c6ff-af01-4fb3-8c0b-ed1390c3145c tempest-VolumesListAdminTestJSON-780164009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc85f965-26f8-47de-8589-b75dede8fee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:44:42 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3679c6ff-af01-4fb3-8c0b-ed1390c3145c tempest-VolumesListAdminTestJSON-780164009 None] Flow 'volume_create_manager' (2e7e43ab-528d-47c5-8627-77d71047f09e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:44:42 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-378e8773-7cb1-4eca-bb5a-c63b638dc7bf tempest-VolumesCloneTest-1003273504 None] Creating offline snapshot 422eb76a-b989-46c7-8830-9ff45a0d03ae of volume 11262cd0-202f-472f-9d01-54869632f8de {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 14:44:42 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-3679c6ff-af01-4fb3-8c0b-ed1390c3145c tempest-VolumesListAdminTestJSON-780164009 None] Created volume successfully.
Jul 09 14:44:42 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[962dabfd-9ac4-43e3-a163-9ff907f72241]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:44:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-378e8773-7cb1-4eca-bb5a-c63b638dc7bf tempest-VolumesCloneTest-1003273504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-11262cd0-202f-472f-9d01-54869632f8de {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:44:42 devstack sudo[100590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-11262cd0-202f-472f-9d01-54869632f8de
Jul 09 14:44:42 devstack sudo[100590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:44:43 devstack sudo[100575]: pam_unix(sudo:session): session closed for user root
Jul 09 14:44:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ed268450-d187-4318-97a1-44e270f47c9f tempest-CreateVolumesFromSourceVolumeTest-123286107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 1.064s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:44:43 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-ed268450-d187-4318-97a1-44e270f47c9f tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:44:43 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-ed268450-d187-4318-97a1-44e270f47c9f tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Deleted volume successfully.
Jul 09 14:44:43 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-ed268450-d187-4318-97a1-44e270f47c9f tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Lock "cinder-fcff4054-1c8c-4e3b-8661-c2db5f2150d0-delete_volume" released by "delete_volume" :: held 3.489s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:44:43 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8a9aaa6c-4aaf-411d-a1f3-45726f6a6006 tempest-VolumesListAdminTestJSON-780164009 None] Acquiring lock "cinder-b86d109d-75d2-4886-8a8b-345e3b0fab19-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:44:43 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8a9aaa6c-4aaf-411d-a1f3-45726f6a6006 tempest-VolumesListAdminTestJSON-780164009 None] Lock "cinder-b86d109d-75d2-4886-8a8b-345e3b0fab19-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:44:43 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8a9aaa6c-4aaf-411d-a1f3-45726f6a6006 tempest-VolumesListAdminTestJSON-780164009 None] Acquiring lock "cinder-quobyte-b86d109d-75d2-4886-8a8b-345e3b0fab19" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:44:43 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8a9aaa6c-4aaf-411d-a1f3-45726f6a6006 tempest-VolumesListAdminTestJSON-780164009 None] Lock "cinder-quobyte-b86d109d-75d2-4886-8a8b-345e3b0fab19" acquired by "delete_volume" :: waited 0.028s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:44:43 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ecc5d0b-147b-443a-b9e5-8d07bbeb0ade]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:44:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8a9aaa6c-4aaf-411d-a1f3-45726f6a6006 tempest-VolumesListAdminTestJSON-780164009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b86d109d-75d2-4886-8a8b-345e3b0fab19 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:44:43 devstack sudo[100578]: pam_unix(sudo:session): session closed for user root
Jul 09 14:44:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7a10cbae-cf69-4b18-be65-c1409b0d67f2 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-6b6dbbf8-db35-4357-8842-7045419a5e1b" returned: 0 in 1.528s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:44:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7a10cbae-cf69-4b18-be65-c1409b0d67f2 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-6b6dbbf8-db35-4357-8842-7045419a5e1b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:44:43 devstack sudo[100628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-6b6dbbf8-db35-4357-8842-7045419a5e1b
Jul 09 14:44:43 devstack sudo[100628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:44:43 devstack sudo[100627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b86d109d-75d2-4886-8a8b-345e3b0fab19
Jul 09 14:44:43 devstack sudo[100627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:44:44 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8d733f7b-d25f-467b-b4d9-d7f5ae311b8b tempest-VolumesListAdminTestJSON-1929470986 None] Acquiring lock "cinder-6b91a5ad-7f83-40a4-a007-8c5bf7267dd5-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:44:44 devstack sudo[100590]: pam_unix(sudo:session): session closed for user root
Jul 09 14:44:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-378e8773-7cb1-4eca-bb5a-c63b638dc7bf tempest-VolumesCloneTest-1003273504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-11262cd0-202f-472f-9d01-54869632f8de" returned: 0 in 1.462s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:44:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-378e8773-7cb1-4eca-bb5a-c63b638dc7bf tempest-VolumesCloneTest-1003273504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-11262cd0-202f-472f-9d01-54869632f8de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-11262cd0-202f-472f-9d01-54869632f8de.422eb76a-b989-46c7-8830-9ff45a0d03ae 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:44:44 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8d733f7b-d25f-467b-b4d9-d7f5ae311b8b tempest-VolumesListAdminTestJSON-1929470986 None] Lock "cinder-6b91a5ad-7f83-40a4-a007-8c5bf7267dd5-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:44:44 devstack sudo[100631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-11262cd0-202f-472f-9d01-54869632f8de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-11262cd0-202f-472f-9d01-54869632f8de.422eb76a-b989-46c7-8830-9ff45a0d03ae 1G
Jul 09 14:44:44 devstack sudo[100631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:44:44 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8d733f7b-d25f-467b-b4d9-d7f5ae311b8b tempest-VolumesListAdminTestJSON-1929470986 None] Acquiring lock "cinder-quobyte-6b91a5ad-7f83-40a4-a007-8c5bf7267dd5" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:44:44 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8d733f7b-d25f-467b-b4d9-d7f5ae311b8b tempest-VolumesListAdminTestJSON-1929470986 None] Lock "cinder-quobyte-6b91a5ad-7f83-40a4-a007-8c5bf7267dd5" acquired by "delete_volume" :: waited 0.023s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:44:44 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f25070-5cf8-4ed3-a3e4-04060829a389]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:44:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8d733f7b-d25f-467b-b4d9-d7f5ae311b8b tempest-VolumesListAdminTestJSON-1929470986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-6b91a5ad-7f83-40a4-a007-8c5bf7267dd5 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:44:44 devstack sudo[100633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-6b91a5ad-7f83-40a4-a007-8c5bf7267dd5
Jul 09 14:44:44 devstack sudo[100633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:44:45 devstack sudo[100627]: pam_unix(sudo:session): session closed for user root
Jul 09 14:44:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8a9aaa6c-4aaf-411d-a1f3-45726f6a6006 tempest-VolumesListAdminTestJSON-780164009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b86d109d-75d2-4886-8a8b-345e3b0fab19" returned: 0 in 1.683s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:44:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8a9aaa6c-4aaf-411d-a1f3-45726f6a6006 tempest-VolumesListAdminTestJSON-780164009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b86d109d-75d2-4886-8a8b-345e3b0fab19 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:44:45 devstack sudo[100644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b86d109d-75d2-4886-8a8b-345e3b0fab19
Jul 09 14:44:45 devstack sudo[100644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:44:45 devstack sudo[100628]: pam_unix(sudo:session): session closed for user root
Jul 09 14:44:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7a10cbae-cf69-4b18-be65-c1409b0d67f2 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-6b6dbbf8-db35-4357-8842-7045419a5e1b" returned: 0 in 1.726s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:44:45 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7a10cbae-cf69-4b18-be65-c1409b0d67f2 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Lock "cinder-quobyte-6b6dbbf8-db35-4357-8842-7045419a5e1b" released by "delete_volume" :: held 3.358s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:44:45 devstack sudo[100631]: pam_unix(sudo:session): session closed for user root
Jul 09 14:44:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-378e8773-7cb1-4eca-bb5a-c63b638dc7bf tempest-VolumesCloneTest-1003273504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-11262cd0-202f-472f-9d01-54869632f8de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-11262cd0-202f-472f-9d01-54869632f8de.422eb76a-b989-46c7-8830-9ff45a0d03ae 1G" returned: 0 in 1.755s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:44:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-378e8773-7cb1-4eca-bb5a-c63b638dc7bf tempest-VolumesCloneTest-1003273504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11262cd0-202f-472f-9d01-54869632f8de -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-11262cd0-202f-472f-9d01-54869632f8de.422eb76a-b989-46c7-8830-9ff45a0d03ae {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:44:45 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-7a10cbae-cf69-4b18-be65-c1409b0d67f2 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Created reservations ['220e1bb2-38df-4504-aa12-103be08be4af', '0084abf5-790f-4499-badd-4ed9ddbe68a7', 'f50ea317-6afc-45f7-b673-95448674ee13', '0c84b9d7-9b04-4af8-a3e8-9ecd1a39d645'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:44:45 devstack sudo[100648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11262cd0-202f-472f-9d01-54869632f8de -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-11262cd0-202f-472f-9d01-54869632f8de.422eb76a-b989-46c7-8830-9ff45a0d03ae
Jul 09 14:44:45 devstack sudo[100648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:44:45 devstack sudo[100633]: pam_unix(sudo:session): session closed for user root
Jul 09 14:44:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8d733f7b-d25f-467b-b4d9-d7f5ae311b8b tempest-VolumesListAdminTestJSON-1929470986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-6b91a5ad-7f83-40a4-a007-8c5bf7267dd5" returned: 0 in 1.590s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:44:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8d733f7b-d25f-467b-b4d9-d7f5ae311b8b tempest-VolumesListAdminTestJSON-1929470986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-6b91a5ad-7f83-40a4-a007-8c5bf7267dd5 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:44:45 devstack sudo[100650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-6b91a5ad-7f83-40a4-a007-8c5bf7267dd5
Jul 09 14:44:45 devstack sudo[100650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:44:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7a10cbae-cf69-4b18-be65-c1409b0d67f2 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:44:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7a10cbae-cf69-4b18-be65-c1409b0d67f2 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:44:46 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7a10cbae-cf69-4b18-be65-c1409b0d67f2 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:44:46 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7a10cbae-cf69-4b18-be65-c1409b0d67f2 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:44:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7a10cbae-cf69-4b18-be65-c1409b0d67f2 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:44:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7a10cbae-cf69-4b18-be65-c1409b0d67f2 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:44:46 devstack sudo[100652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:44:46 devstack sudo[100652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:44:46 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c8ef1d3c-88a4-4409-8d42-44a4d8aa1d4e tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Acquiring lock "cinder-2094cb70-7453-46c6-9c1a-fd425676b052-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:44:46 devstack sudo[100644]: pam_unix(sudo:session): session closed for user root
Jul 09 14:44:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8a9aaa6c-4aaf-411d-a1f3-45726f6a6006 tempest-VolumesListAdminTestJSON-780164009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b86d109d-75d2-4886-8a8b-345e3b0fab19" returned: 0 in 1.496s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:44:47 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8a9aaa6c-4aaf-411d-a1f3-45726f6a6006 tempest-VolumesListAdminTestJSON-780164009 None] Lock "cinder-quobyte-b86d109d-75d2-4886-8a8b-345e3b0fab19" released by "delete_volume" :: held 3.283s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:44:47 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c8ef1d3c-88a4-4409-8d42-44a4d8aa1d4e tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Lock "cinder-2094cb70-7453-46c6-9c1a-fd425676b052-delete_volume" acquired by "delete_volume" :: waited 0.112s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:44:47 devstack sudo[100648]: pam_unix(sudo:session): session closed for user root
Jul 09 14:44:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-378e8773-7cb1-4eca-bb5a-c63b638dc7bf tempest-VolumesCloneTest-1003273504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11262cd0-202f-472f-9d01-54869632f8de -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-11262cd0-202f-472f-9d01-54869632f8de.422eb76a-b989-46c7-8830-9ff45a0d03ae" returned: 0 in 1.369s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:44:47 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-378e8773-7cb1-4eca-bb5a-c63b638dc7bf tempest-VolumesCloneTest-1003273504 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-11262cd0-202f-472f-9d01-54869632f8de.422eb76a-b989-46c7-8830-9ff45a0d03ae is being set with open permissions: ugo+rw
Jul 09 14:44:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-378e8773-7cb1-4eca-bb5a-c63b638dc7bf tempest-VolumesCloneTest-1003273504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-11262cd0-202f-472f-9d01-54869632f8de.422eb76a-b989-46c7-8830-9ff45a0d03ae {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:44:47 devstack sudo[100659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-11262cd0-202f-472f-9d01-54869632f8de.422eb76a-b989-46c7-8830-9ff45a0d03ae
Jul 09 14:44:47 devstack sudo[100659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:44:47 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c8ef1d3c-88a4-4409-8d42-44a4d8aa1d4e tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Acquiring lock "cinder-quobyte-2094cb70-7453-46c6-9c1a-fd425676b052" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:44:47 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c8ef1d3c-88a4-4409-8d42-44a4d8aa1d4e tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Lock "cinder-quobyte-2094cb70-7453-46c6-9c1a-fd425676b052" acquired by "delete_volume" :: waited 0.067s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:44:47 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[b043f502-2746-4a20-96a8-32f746f98137]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:44:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c8ef1d3c-88a4-4409-8d42-44a4d8aa1d4e tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2094cb70-7453-46c6-9c1a-fd425676b052 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:44:47 devstack sudo[100652]: pam_unix(sudo:session): session closed for user root
Jul 09 14:44:47 devstack sudo[100650]: pam_unix(sudo:session): session closed for user root
Jul 09 14:44:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8d733f7b-d25f-467b-b4d9-d7f5ae311b8b tempest-VolumesListAdminTestJSON-1929470986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-6b91a5ad-7f83-40a4-a007-8c5bf7267dd5" returned: 0 in 1.575s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:44:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7a10cbae-cf69-4b18-be65-c1409b0d67f2 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 1.405s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:44:47 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-8a9aaa6c-4aaf-411d-a1f3-45726f6a6006 tempest-VolumesListAdminTestJSON-780164009 None] Created reservations ['cd11c901-b5dc-49b3-ab30-7811acd170cf', '1deb857f-a2ae-456b-89f8-c117e48e2736', '7295cfa8-eae4-4a2a-918c-4854cdff0c12', 'dab11a31-e467-4276-a55a-4f7ebb011fa7'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:44:47 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-7a10cbae-cf69-4b18-be65-c1409b0d67f2 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:44:47 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-7a10cbae-cf69-4b18-be65-c1409b0d67f2 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Deleted volume successfully.
Jul 09 14:44:47 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8d733f7b-d25f-467b-b4d9-d7f5ae311b8b tempest-VolumesListAdminTestJSON-1929470986 None] Lock "cinder-quobyte-6b91a5ad-7f83-40a4-a007-8c5bf7267dd5" released by "delete_volume" :: held 3.278s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:44:47 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7a10cbae-cf69-4b18-be65-c1409b0d67f2 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Lock "cinder-6b6dbbf8-db35-4357-8842-7045419a5e1b-delete_volume" released by "delete_volume" :: held 5.417s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:44:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8a9aaa6c-4aaf-411d-a1f3-45726f6a6006 tempest-VolumesListAdminTestJSON-780164009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:44:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8a9aaa6c-4aaf-411d-a1f3-45726f6a6006 tempest-VolumesListAdminTestJSON-780164009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:44:47 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-8a9aaa6c-4aaf-411d-a1f3-45726f6a6006 tempest-VolumesListAdminTestJSON-780164009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:44:47 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-8a9aaa6c-4aaf-411d-a1f3-45726f6a6006 tempest-VolumesListAdminTestJSON-780164009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:44:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8a9aaa6c-4aaf-411d-a1f3-45726f6a6006 tempest-VolumesListAdminTestJSON-780164009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:44:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8a9aaa6c-4aaf-411d-a1f3-45726f6a6006 tempest-VolumesListAdminTestJSON-780164009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:44:47 devstack sudo[100662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2094cb70-7453-46c6-9c1a-fd425676b052
Jul 09 14:44:47 devstack sudo[100662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:44:47 devstack sudo[100663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:44:47 devstack sudo[100663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:44:47 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-8d733f7b-d25f-467b-b4d9-d7f5ae311b8b tempest-VolumesListAdminTestJSON-1929470986 None] Created reservations ['ae3b4052-1327-4196-aa2c-f9e4fcc5e311', '900c9b70-6ad5-40ee-90ec-aa36429a58c8', '5577d55a-5ba9-4e4c-b1ec-491d057702f6', 'e587a9cd-2ef8-444c-9a95-a3f783a03a07'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:44:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8d733f7b-d25f-467b-b4d9-d7f5ae311b8b tempest-VolumesListAdminTestJSON-1929470986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:44:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8d733f7b-d25f-467b-b4d9-d7f5ae311b8b tempest-VolumesListAdminTestJSON-1929470986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:44:47 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-8d733f7b-d25f-467b-b4d9-d7f5ae311b8b tempest-VolumesListAdminTestJSON-1929470986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:44:48 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-8d733f7b-d25f-467b-b4d9-d7f5ae311b8b tempest-VolumesListAdminTestJSON-1929470986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:44:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8d733f7b-d25f-467b-b4d9-d7f5ae311b8b tempest-VolumesListAdminTestJSON-1929470986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:44:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8d733f7b-d25f-467b-b4d9-d7f5ae311b8b tempest-VolumesListAdminTestJSON-1929470986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:44:48 devstack sudo[100666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:44:48 devstack sudo[100666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:44:48 devstack sudo[100659]: pam_unix(sudo:session): session closed for user root
Jul 09 14:44:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-378e8773-7cb1-4eca-bb5a-c63b638dc7bf tempest-VolumesCloneTest-1003273504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-11262cd0-202f-472f-9d01-54869632f8de.422eb76a-b989-46c7-8830-9ff45a0d03ae" returned: 0 in 1.289s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:44:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-378e8773-7cb1-4eca-bb5a-c63b638dc7bf tempest-VolumesCloneTest-1003273504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-11262cd0-202f-472f-9d01-54869632f8de.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:44:48 devstack sudo[100669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-11262cd0-202f-472f-9d01-54869632f8de.info
Jul 09 14:44:48 devstack sudo[100669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:44:48 devstack sudo[100663]: pam_unix(sudo:session): session closed for user root
Jul 09 14:44:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8a9aaa6c-4aaf-411d-a1f3-45726f6a6006 tempest-VolumesListAdminTestJSON-780164009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 1.213s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:44:48 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-8a9aaa6c-4aaf-411d-a1f3-45726f6a6006 tempest-VolumesListAdminTestJSON-780164009 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:44:48 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-512e01f6-92ed-4119-baf3-910b569e815d tempest-VolumesListAdminTestJSON-1929470986 None] Acquiring lock "cinder-085a82dc-fbc2-46eb-844f-71ce3fa7b4ea-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:44:49 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-8a9aaa6c-4aaf-411d-a1f3-45726f6a6006 tempest-VolumesListAdminTestJSON-780164009 None] Deleted volume successfully.
Jul 09 14:44:49 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8a9aaa6c-4aaf-411d-a1f3-45726f6a6006 tempest-VolumesListAdminTestJSON-780164009 None] Lock "cinder-b86d109d-75d2-4886-8a8b-345e3b0fab19-delete_volume" released by "delete_volume" :: held 5.499s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:44:49 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-512e01f6-92ed-4119-baf3-910b569e815d tempest-VolumesListAdminTestJSON-1929470986 None] Lock "cinder-085a82dc-fbc2-46eb-844f-71ce3fa7b4ea-delete_volume" acquired by "delete_volume" :: waited 0.122s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:44:49 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-512e01f6-92ed-4119-baf3-910b569e815d tempest-VolumesListAdminTestJSON-1929470986 None] Acquiring lock "cinder-quobyte-085a82dc-fbc2-46eb-844f-71ce3fa7b4ea" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:44:49 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-512e01f6-92ed-4119-baf3-910b569e815d tempest-VolumesListAdminTestJSON-1929470986 None] Lock "cinder-quobyte-085a82dc-fbc2-46eb-844f-71ce3fa7b4ea" acquired by "delete_volume" :: waited 0.043s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:44:49 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a9a7961-9165-47a8-bef2-66bfd9bed7c8]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:44:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-512e01f6-92ed-4119-baf3-910b569e815d tempest-VolumesListAdminTestJSON-1929470986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-085a82dc-fbc2-46eb-844f-71ce3fa7b4ea {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:44:49 devstack sudo[100662]: pam_unix(sudo:session): session closed for user root
Jul 09 14:44:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c8ef1d3c-88a4-4409-8d42-44a4d8aa1d4e tempest-CreateVolumesFromSourceVolumeTest-123286107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2094cb70-7453-46c6-9c1a-fd425676b052" returned: 0 in 2.088s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:44:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c8ef1d3c-88a4-4409-8d42-44a4d8aa1d4e tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2094cb70-7453-46c6-9c1a-fd425676b052 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:44:49 devstack sudo[100677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2094cb70-7453-46c6-9c1a-fd425676b052
Jul 09 14:44:49 devstack sudo[100677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:44:49 devstack sudo[100675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-085a82dc-fbc2-46eb-844f-71ce3fa7b4ea
Jul 09 14:44:49 devstack sudo[100675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:44:49 devstack sudo[100666]: pam_unix(sudo:session): session closed for user root
Jul 09 14:44:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8d733f7b-d25f-467b-b4d9-d7f5ae311b8b tempest-VolumesListAdminTestJSON-1929470986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 1.708s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:44:49 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-8d733f7b-d25f-467b-b4d9-d7f5ae311b8b tempest-VolumesListAdminTestJSON-1929470986 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:44:49 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-8d733f7b-d25f-467b-b4d9-d7f5ae311b8b tempest-VolumesListAdminTestJSON-1929470986 None] Deleted volume successfully.
Jul 09 14:44:49 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8d733f7b-d25f-467b-b4d9-d7f5ae311b8b tempest-VolumesListAdminTestJSON-1929470986 None] Lock "cinder-6b91a5ad-7f83-40a4-a007-8c5bf7267dd5-delete_volume" released by "delete_volume" :: held 5.687s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:44:50 devstack sudo[100669]: pam_unix(sudo:session): session closed for user root
Jul 09 14:44:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-378e8773-7cb1-4eca-bb5a-c63b638dc7bf tempest-VolumesCloneTest-1003273504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-11262cd0-202f-472f-9d01-54869632f8de.info" returned: 0 in 1.514s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:44:50 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-378e8773-7cb1-4eca-bb5a-c63b638dc7bf tempest-VolumesCloneTest-1003273504 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-11262cd0-202f-472f-9d01-54869632f8de.info is being set with open permissions: ugo+rw
Jul 09 14:44:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-378e8773-7cb1-4eca-bb5a-c63b638dc7bf tempest-VolumesCloneTest-1003273504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-11262cd0-202f-472f-9d01-54869632f8de.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:44:50 devstack sudo[100681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-11262cd0-202f-472f-9d01-54869632f8de.info
Jul 09 14:44:50 devstack sudo[100681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:44:50 devstack sudo[100677]: pam_unix(sudo:session): session closed for user root
Jul 09 14:44:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c8ef1d3c-88a4-4409-8d42-44a4d8aa1d4e tempest-CreateVolumesFromSourceVolumeTest-123286107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2094cb70-7453-46c6-9c1a-fd425676b052" returned: 0 in 0.992s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:44:50 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c8ef1d3c-88a4-4409-8d42-44a4d8aa1d4e tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Lock "cinder-quobyte-2094cb70-7453-46c6-9c1a-fd425676b052" released by "delete_volume" :: held 3.201s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:44:50 devstack sudo[100675]: pam_unix(sudo:session): session closed for user root
Jul 09 14:44:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-512e01f6-92ed-4119-baf3-910b569e815d tempest-VolumesListAdminTestJSON-1929470986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-085a82dc-fbc2-46eb-844f-71ce3fa7b4ea" returned: 0 in 1.286s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:44:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-512e01f6-92ed-4119-baf3-910b569e815d tempest-VolumesListAdminTestJSON-1929470986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-085a82dc-fbc2-46eb-844f-71ce3fa7b4ea {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:44:50 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-c8ef1d3c-88a4-4409-8d42-44a4d8aa1d4e tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Created reservations ['f742da30-27ab-475e-a570-5cc748edc622', '27918165-6e70-47b1-9a93-cf154dd639aa', '8de1b490-9d3a-408c-b7a2-c5babbd00448', '59c6ecc6-5f7b-4118-b237-9ef0fbbdcdd0'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:44:50 devstack sudo[100688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-085a82dc-fbc2-46eb-844f-71ce3fa7b4ea
Jul 09 14:44:50 devstack sudo[100688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:44:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c8ef1d3c-88a4-4409-8d42-44a4d8aa1d4e tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:44:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c8ef1d3c-88a4-4409-8d42-44a4d8aa1d4e tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:44:50 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-c8ef1d3c-88a4-4409-8d42-44a4d8aa1d4e tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:44:50 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-c8ef1d3c-88a4-4409-8d42-44a4d8aa1d4e tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:44:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c8ef1d3c-88a4-4409-8d42-44a4d8aa1d4e tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:44:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c8ef1d3c-88a4-4409-8d42-44a4d8aa1d4e tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:44:50 devstack sudo[100690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:44:50 devstack sudo[100690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:44:51 devstack sudo[100681]: pam_unix(sudo:session): session closed for user root
Jul 09 14:44:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-378e8773-7cb1-4eca-bb5a-c63b638dc7bf tempest-VolumesCloneTest-1003273504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-11262cd0-202f-472f-9d01-54869632f8de.info" returned: 0 in 1.269s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:44:51 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-378e8773-7cb1-4eca-bb5a-c63b638dc7bf tempest-VolumesCloneTest-1003273504 None] Acquiring lock "cinder-quobyte-db8bfc68-a815-42aa-b1f9-fe91b3ab7eae" by "_copy_volume_from_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:44:51 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-378e8773-7cb1-4eca-bb5a-c63b638dc7bf tempest-VolumesCloneTest-1003273504 None] Lock "cinder-quobyte-db8bfc68-a815-42aa-b1f9-fe91b3ab7eae" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:44:51 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-378e8773-7cb1-4eca-bb5a-c63b638dc7bf tempest-VolumesCloneTest-1003273504 None] snapshot: 422eb76a-b989-46c7-8830-9ff45a0d03ae, volume: db8bfc68-a815-42aa-b1f9-fe91b3ab7eae,  {{(pid=87230) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 09 14:44:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-378e8773-7cb1-4eca-bb5a-c63b638dc7bf tempest-VolumesCloneTest-1003273504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:44:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-378e8773-7cb1-4eca-bb5a-c63b638dc7bf tempest-VolumesCloneTest-1003273504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:44:51 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-378e8773-7cb1-4eca-bb5a-c63b638dc7bf tempest-VolumesCloneTest-1003273504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:44:51 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-378e8773-7cb1-4eca-bb5a-c63b638dc7bf tempest-VolumesCloneTest-1003273504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:44:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-378e8773-7cb1-4eca-bb5a-c63b638dc7bf tempest-VolumesCloneTest-1003273504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:44:51 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[296f0e83-b946-4843-ab1f-b665ec12fef2]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:44:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-378e8773-7cb1-4eca-bb5a-c63b638dc7bf tempest-VolumesCloneTest-1003273504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-11262cd0-202f-472f-9d01-54869632f8de.422eb76a-b989-46c7-8830-9ff45a0d03ae {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:44:51 devstack sudo[100695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-11262cd0-202f-472f-9d01-54869632f8de.422eb76a-b989-46c7-8830-9ff45a0d03ae
Jul 09 14:44:51 devstack sudo[100695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:44:51 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-dd31971f-d881-458f-abb0-f8d803d999b6 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Acquiring lock "cinder-a958d548-4193-4939-bab6-c48f7ac4f0c0-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:44:51 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-dd31971f-d881-458f-abb0-f8d803d999b6 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Lock "cinder-a958d548-4193-4939-bab6-c48f7ac4f0c0-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:44:51 devstack sudo[100688]: pam_unix(sudo:session): session closed for user root
Jul 09 14:44:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-512e01f6-92ed-4119-baf3-910b569e815d tempest-VolumesListAdminTestJSON-1929470986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-085a82dc-fbc2-46eb-844f-71ce3fa7b4ea" returned: 0 in 1.193s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:44:51 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-512e01f6-92ed-4119-baf3-910b569e815d tempest-VolumesListAdminTestJSON-1929470986 None] Lock "cinder-quobyte-085a82dc-fbc2-46eb-844f-71ce3fa7b4ea" released by "delete_volume" :: held 2.578s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:44:51 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-dd31971f-d881-458f-abb0-f8d803d999b6 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Acquiring lock "cinder-quobyte-a958d548-4193-4939-bab6-c48f7ac4f0c0" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:44:51 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-dd31971f-d881-458f-abb0-f8d803d999b6 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Lock "cinder-quobyte-a958d548-4193-4939-bab6-c48f7ac4f0c0" acquired by "delete_volume" :: waited 0.045s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:44:51 devstack sudo[100690]: pam_unix(sudo:session): session closed for user root
Jul 09 14:44:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c8ef1d3c-88a4-4409-8d42-44a4d8aa1d4e tempest-CreateVolumesFromSourceVolumeTest-123286107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 1.166s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:44:51 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-c8ef1d3c-88a4-4409-8d42-44a4d8aa1d4e tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:44:51 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[8733b04d-c942-4a63-955e-dd9e993b51fc]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:44:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dd31971f-d881-458f-abb0-f8d803d999b6 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a958d548-4193-4939-bab6-c48f7ac4f0c0 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:44:51 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-c8ef1d3c-88a4-4409-8d42-44a4d8aa1d4e tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Deleted volume successfully.
Jul 09 14:44:51 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-512e01f6-92ed-4119-baf3-910b569e815d tempest-VolumesListAdminTestJSON-1929470986 None] Created reservations ['170c869a-0847-42be-a771-d3a4dab0b7e8', '6af6fad0-ca49-4634-8275-a19413069252', 'c5530e45-5669-4b23-91ec-5b75654325b6', 'ab65c0de-ff09-4be0-a46f-6648648c0bdf'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:44:52 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c8ef1d3c-88a4-4409-8d42-44a4d8aa1d4e tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Lock "cinder-2094cb70-7453-46c6-9c1a-fd425676b052-delete_volume" released by "delete_volume" :: held 4.985s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:44:52 devstack sudo[100699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a958d548-4193-4939-bab6-c48f7ac4f0c0
Jul 09 14:44:52 devstack sudo[100699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:44:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-512e01f6-92ed-4119-baf3-910b569e815d tempest-VolumesListAdminTestJSON-1929470986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:44:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-512e01f6-92ed-4119-baf3-910b569e815d tempest-VolumesListAdminTestJSON-1929470986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:44:52 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-512e01f6-92ed-4119-baf3-910b569e815d tempest-VolumesListAdminTestJSON-1929470986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:44:52 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-512e01f6-92ed-4119-baf3-910b569e815d tempest-VolumesListAdminTestJSON-1929470986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:44:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-512e01f6-92ed-4119-baf3-910b569e815d tempest-VolumesListAdminTestJSON-1929470986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:44:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-512e01f6-92ed-4119-baf3-910b569e815d tempest-VolumesListAdminTestJSON-1929470986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:44:52 devstack sudo[100701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:44:52 devstack sudo[100701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:44:52 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 14:44:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:44:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:44:52 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:44:52 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:44:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:44:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:44:52 devstack sudo[100703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:44:52 devstack sudo[100703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:44:52 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f107de35-7f2f-4d64-abff-8622ff56ca2e tempest-VolumesListAdminTestJSON-1929470986 None] Acquiring lock "cinder-e0c12292-d3c1-43bc-8095-27e2112c0146-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:44:52 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f107de35-7f2f-4d64-abff-8622ff56ca2e tempest-VolumesListAdminTestJSON-1929470986 None] Lock "cinder-e0c12292-d3c1-43bc-8095-27e2112c0146-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:44:53 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f107de35-7f2f-4d64-abff-8622ff56ca2e tempest-VolumesListAdminTestJSON-1929470986 None] Acquiring lock "cinder-quobyte-e0c12292-d3c1-43bc-8095-27e2112c0146" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:44:53 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f107de35-7f2f-4d64-abff-8622ff56ca2e tempest-VolumesListAdminTestJSON-1929470986 None] Lock "cinder-quobyte-e0c12292-d3c1-43bc-8095-27e2112c0146" acquired by "delete_volume" :: waited 0.018s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:44:53 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aacfb74-ad27-4020-aa56-aa9bbe8d9cde]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:44:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f107de35-7f2f-4d64-abff-8622ff56ca2e tempest-VolumesListAdminTestJSON-1929470986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e0c12292-d3c1-43bc-8095-27e2112c0146 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:44:53 devstack sudo[100695]: pam_unix(sudo:session): session closed for user root
Jul 09 14:44:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-378e8773-7cb1-4eca-bb5a-c63b638dc7bf tempest-VolumesCloneTest-1003273504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-11262cd0-202f-472f-9d01-54869632f8de.422eb76a-b989-46c7-8830-9ff45a0d03ae" returned: 0 in 1.796s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:44:53 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-378e8773-7cb1-4eca-bb5a-c63b638dc7bf tempest-VolumesCloneTest-1003273504 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11262cd0-202f-472f-9d01-54869632f8de(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 14:44:53 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-378e8773-7cb1-4eca-bb5a-c63b638dc7bf tempest-VolumesCloneTest-1003273504 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-11262cd0-202f-472f-9d01-54869632f8de {{(pid=87230) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 09 14:44:53 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-378e8773-7cb1-4eca-bb5a-c63b638dc7bf tempest-VolumesCloneTest-1003273504 None] Creating direct copy from snapshot {{(pid=87230) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 09 14:44:53 devstack sudo[100699]: pam_unix(sudo:session): session closed for user root
Jul 09 14:44:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dd31971f-d881-458f-abb0-f8d803d999b6 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a958d548-4193-4939-bab6-c48f7ac4f0c0" returned: 0 in 1.297s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:44:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dd31971f-d881-458f-abb0-f8d803d999b6 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a958d548-4193-4939-bab6-c48f7ac4f0c0 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:44:53 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b2324a0-b7ef-4bda-a878-5beb7b97a070]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:44:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-378e8773-7cb1-4eca-bb5a-c63b638dc7bf tempest-VolumesCloneTest-1003273504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-11262cd0-202f-472f-9d01-54869632f8de {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:44:53 devstack sudo[100716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a958d548-4193-4939-bab6-c48f7ac4f0c0
Jul 09 14:44:53 devstack sudo[100716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:44:53 devstack sudo[100715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e0c12292-d3c1-43bc-8095-27e2112c0146
Jul 09 14:44:53 devstack sudo[100715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:44:53 devstack sudo[100701]: pam_unix(sudo:session): session closed for user root
Jul 09 14:44:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-512e01f6-92ed-4119-baf3-910b569e815d tempest-VolumesListAdminTestJSON-1929470986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 1.287s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:44:53 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-512e01f6-92ed-4119-baf3-910b569e815d tempest-VolumesListAdminTestJSON-1929470986 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:44:53 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-512e01f6-92ed-4119-baf3-910b569e815d tempest-VolumesListAdminTestJSON-1929470986 None] Deleted volume successfully.
Jul 09 14:44:53 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-512e01f6-92ed-4119-baf3-910b569e815d tempest-VolumesListAdminTestJSON-1929470986 None] Lock "cinder-085a82dc-fbc2-46eb-844f-71ce3fa7b4ea-delete_volume" released by "delete_volume" :: held 4.439s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:44:53 devstack sudo[100718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-11262cd0-202f-472f-9d01-54869632f8de
Jul 09 14:44:53 devstack sudo[100718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:44:54 devstack sudo[100703]: pam_unix(sudo:session): session closed for user root
Jul 09 14:44:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 1.772s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:44:54 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:44:54 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Running periodic task VolumeManager._thread_info {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 14:44:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] thread count: 28 {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 09 14:44:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] thread info: [<_MainThread(MainThread, started 125388812103808)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125388713797504)>, <Thread(Thread-3 (stat_writer), started daemon 125388699995392)>, <Thread(Rabbit-heartbeat, started daemon 125388700522560)>, <Thread(Thread-5 (_runner), started daemon 125388698545216)>, <Thread(Thread-7 (_runner), started daemon 125388698611264)>, <Thread(fd_logger, started daemon 125388703020672)>, <Thread(privsep_reader, started daemon 125388696441088)>, <Thread(tpool_thread_0, started daemon 125388687943360)>, <Thread(tpool_thread_1, started daemon 125388679550656)>, <Thread(tpool_thread_2, started daemon 125388671141568)>, <Thread(tpool_thread_3, started daemon 125388662732480)>, <Thread(tpool_thread_4, started daemon 125388654323392)>, <Thread(tpool_thread_5, started daemon 125388645914304)>, <Thread(tpool_thread_6, started daemon 125388637505216)>, <Thread(tpool_thread_7, started daemon 125388629096128)>, <Thread(tpool_thread_8, started daemon 125388620687040)>, <Thread(tpool_thread_9, started daemon 125388612277952)>, <Thread(tpool_thread_10, started daemon 125388603868864)>, <Thread(tpool_thread_11, started daemon 125388595459776)>, <Thread(tpool_thread_12, started daemon 125388587050688)>, <Thread(tpool_thread_13, started daemon 125388578641600)>, <Thread(tpool_thread_14, started daemon 125388570232512)>, <Thread(tpool_thread_15, started daemon 125388561823424)>, <Thread(tpool_thread_16, started daemon 125388553414336)>, <Thread(tpool_thread_17, started daemon 125388545005248)>, <Thread(tpool_thread_18, started daemon 125388536596160)>, <Thread(tpool_thread_19, started daemon 125388528187072)>] {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 09 14:44:54 devstack sudo[100716]: pam_unix(sudo:session): session closed for user root
Jul 09 14:44:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dd31971f-d881-458f-abb0-f8d803d999b6 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a958d548-4193-4939-bab6-c48f7ac4f0c0" returned: 0 in 1.065s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:44:54 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-dd31971f-d881-458f-abb0-f8d803d999b6 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Lock "cinder-quobyte-a958d548-4193-4939-bab6-c48f7ac4f0c0" released by "delete_volume" :: held 2.431s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:44:54 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-dd31971f-d881-458f-abb0-f8d803d999b6 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Created reservations ['e6c7799b-22b0-41d6-a091-95f270546160', '041ce76e-521a-44d3-b5dd-9ccdede9dceb', '45174728-756a-4e57-a2cf-e54aa1b101a5', 'c43f9193-d6aa-4632-8292-472a9560a37a'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:44:54 devstack sudo[100715]: pam_unix(sudo:session): session closed for user root
Jul 09 14:44:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f107de35-7f2f-4d64-abff-8622ff56ca2e tempest-VolumesListAdminTestJSON-1929470986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e0c12292-d3c1-43bc-8095-27e2112c0146" returned: 0 in 1.401s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:44:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f107de35-7f2f-4d64-abff-8622ff56ca2e tempest-VolumesListAdminTestJSON-1929470986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e0c12292-d3c1-43bc-8095-27e2112c0146 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:44:54 devstack sudo[100731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e0c12292-d3c1-43bc-8095-27e2112c0146
Jul 09 14:44:54 devstack sudo[100731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:44:54 devstack sudo[100718]: pam_unix(sudo:session): session closed for user root
Jul 09 14:44:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-378e8773-7cb1-4eca-bb5a-c63b638dc7bf tempest-VolumesCloneTest-1003273504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-11262cd0-202f-472f-9d01-54869632f8de" returned: 0 in 1.273s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:44:54 devstack cinder-volume[87230]: DEBUG cinder.utils [None req-378e8773-7cb1-4eca-bb5a-c63b638dc7bf tempest-VolumesCloneTest-1003273504 None] Path /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-db8bfc68-a815-42aa-b1f9-fe91b3ab7eae not found in is_blk_device check {{(pid=87230) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 09 14:44:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-378e8773-7cb1-4eca-bb5a-c63b638dc7bf tempest-VolumesCloneTest-1003273504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-11262cd0-202f-472f-9d01-54869632f8de /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-db8bfc68-a815-42aa-b1f9-fe91b3ab7eae {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:44:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-dd31971f-d881-458f-abb0-f8d803d999b6 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:44:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-dd31971f-d881-458f-abb0-f8d803d999b6 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:44:54 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-dd31971f-d881-458f-abb0-f8d803d999b6 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:44:54 devstack sudo[100733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-11262cd0-202f-472f-9d01-54869632f8de /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-db8bfc68-a815-42aa-b1f9-fe91b3ab7eae
Jul 09 14:44:54 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-dd31971f-d881-458f-abb0-f8d803d999b6 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:44:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-dd31971f-d881-458f-abb0-f8d803d999b6 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:44:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dd31971f-d881-458f-abb0-f8d803d999b6 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:44:54 devstack sudo[100733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:44:54 devstack sudo[100735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:44:54 devstack sudo[100735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:44:55 devstack sudo[100731]: pam_unix(sudo:session): session closed for user root
Jul 09 14:44:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f107de35-7f2f-4d64-abff-8622ff56ca2e tempest-VolumesListAdminTestJSON-1929470986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e0c12292-d3c1-43bc-8095-27e2112c0146" returned: 0 in 0.815s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:44:55 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f107de35-7f2f-4d64-abff-8622ff56ca2e tempest-VolumesListAdminTestJSON-1929470986 None] Lock "cinder-quobyte-e0c12292-d3c1-43bc-8095-27e2112c0146" released by "delete_volume" :: held 2.326s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:44:55 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-f107de35-7f2f-4d64-abff-8622ff56ca2e tempest-VolumesListAdminTestJSON-1929470986 None] Created reservations ['8c38373c-4b75-434d-8f54-4b8a0546e688', '2763e7c0-549d-4eab-bd4d-c1d05978a870', '077eb6e0-8544-40ec-b9ea-bbc576d2d0e6', '30c50dfd-ac93-4e34-bc13-768186098b1a'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:44:55 devstack sudo[100735]: pam_unix(sudo:session): session closed for user root
Jul 09 14:44:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dd31971f-d881-458f-abb0-f8d803d999b6 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.894s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:44:55 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-dd31971f-d881-458f-abb0-f8d803d999b6 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:44:55 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-dd31971f-d881-458f-abb0-f8d803d999b6 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Deleted volume successfully.
Jul 09 14:44:55 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-dd31971f-d881-458f-abb0-f8d803d999b6 tempest-CreateVolumesFromSourceVolumeTest-123286107 None] Lock "cinder-a958d548-4193-4939-bab6-c48f7ac4f0c0-delete_volume" released by "delete_volume" :: held 3.763s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:44:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f107de35-7f2f-4d64-abff-8622ff56ca2e tempest-VolumesListAdminTestJSON-1929470986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:44:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f107de35-7f2f-4d64-abff-8622ff56ca2e tempest-VolumesListAdminTestJSON-1929470986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:44:55 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f107de35-7f2f-4d64-abff-8622ff56ca2e tempest-VolumesListAdminTestJSON-1929470986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:44:55 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f107de35-7f2f-4d64-abff-8622ff56ca2e tempest-VolumesListAdminTestJSON-1929470986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:44:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f107de35-7f2f-4d64-abff-8622ff56ca2e tempest-VolumesListAdminTestJSON-1929470986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:44:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f107de35-7f2f-4d64-abff-8622ff56ca2e tempest-VolumesListAdminTestJSON-1929470986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:44:55 devstack sudo[100749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:44:55 devstack sudo[100749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:44:57 devstack sudo[100749]: pam_unix(sudo:session): session closed for user root
Jul 09 14:44:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f107de35-7f2f-4d64-abff-8622ff56ca2e tempest-VolumesListAdminTestJSON-1929470986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 2.149s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:44:57 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-f107de35-7f2f-4d64-abff-8622ff56ca2e tempest-VolumesListAdminTestJSON-1929470986 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:44:57 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-f107de35-7f2f-4d64-abff-8622ff56ca2e tempest-VolumesListAdminTestJSON-1929470986 None] Deleted volume successfully.
Jul 09 14:44:57 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f107de35-7f2f-4d64-abff-8622ff56ca2e tempest-VolumesListAdminTestJSON-1929470986 None] Lock "cinder-e0c12292-d3c1-43bc-8095-27e2112c0146-delete_volume" released by "delete_volume" :: held 5.034s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:45:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-378e8773-7cb1-4eca-bb5a-c63b638dc7bf tempest-VolumesCloneTest-1003273504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-11262cd0-202f-472f-9d01-54869632f8de /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-db8bfc68-a815-42aa-b1f9-fe91b3ab7eae" returned: 0 in 7.520s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:45:02 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[72251b08-6aa9-42d0-b3e4-e11904966929]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:45:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-378e8773-7cb1-4eca-bb5a-c63b638dc7bf tempest-VolumesCloneTest-1003273504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-11262cd0-202f-472f-9d01-54869632f8de {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:45:02 devstack sudo[100875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-11262cd0-202f-472f-9d01-54869632f8de
Jul 09 14:45:02 devstack sudo[100875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:45:03 devstack sudo[100875]: pam_unix(sudo:session): session closed for user root
Jul 09 14:45:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-378e8773-7cb1-4eca-bb5a-c63b638dc7bf tempest-VolumesCloneTest-1003273504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-11262cd0-202f-472f-9d01-54869632f8de" returned: 0 in 1.280s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:45:03 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-378e8773-7cb1-4eca-bb5a-c63b638dc7bf tempest-VolumesCloneTest-1003273504 None] Image conversion details: src /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-11262cd0-202f-472f-9d01-54869632f8de, size 1024.00 MB, duration 7.52 sec, destination /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-db8bfc68-a815-42aa-b1f9-fe91b3ab7eae {{(pid=87230) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 09 14:45:03 devstack cinder-volume[87230]: INFO cinder.image.image_utils [None req-378e8773-7cb1-4eca-bb5a-c63b638dc7bf tempest-VolumesCloneTest-1003273504 None] Converted 1024.00 MB image at 136.14 MB/s
Jul 09 14:45:03 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-378e8773-7cb1-4eca-bb5a-c63b638dc7bf tempest-VolumesCloneTest-1003273504 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-db8bfc68-a815-42aa-b1f9-fe91b3ab7eae is being set with open permissions: ugo+rw
Jul 09 14:45:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-378e8773-7cb1-4eca-bb5a-c63b638dc7bf tempest-VolumesCloneTest-1003273504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-db8bfc68-a815-42aa-b1f9-fe91b3ab7eae {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:45:03 devstack sudo[100881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-db8bfc68-a815-42aa-b1f9-fe91b3ab7eae
Jul 09 14:45:03 devstack sudo[100881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:45:04 devstack sudo[100881]: pam_unix(sudo:session): session closed for user root
Jul 09 14:45:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-378e8773-7cb1-4eca-bb5a-c63b638dc7bf tempest-VolumesCloneTest-1003273504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-db8bfc68-a815-42aa-b1f9-fe91b3ab7eae" returned: 0 in 0.723s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:45:04 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-378e8773-7cb1-4eca-bb5a-c63b638dc7bf tempest-VolumesCloneTest-1003273504 None] Lock "cinder-quobyte-db8bfc68-a815-42aa-b1f9-fe91b3ab7eae" released by "_copy_volume_from_snapshot" :: held 12.748s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:45:04 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-378e8773-7cb1-4eca-bb5a-c63b638dc7bf tempest-VolumesCloneTest-1003273504 None] Acquiring lock "cinder-quobyte-422eb76a-b989-46c7-8830-9ff45a0d03ae" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:45:04 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-378e8773-7cb1-4eca-bb5a-c63b638dc7bf tempest-VolumesCloneTest-1003273504 None] Lock "cinder-quobyte-422eb76a-b989-46c7-8830-9ff45a0d03ae" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:45:04 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-378e8773-7cb1-4eca-bb5a-c63b638dc7bf tempest-VolumesCloneTest-1003273504 None] Deleting offline snapshot 422eb76a-b989-46c7-8830-9ff45a0d03ae of volume 11262cd0-202f-472f-9d01-54869632f8de {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 14:45:04 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-378e8773-7cb1-4eca-bb5a-c63b638dc7bf tempest-VolumesCloneTest-1003273504 None] snapshot_file for this snap is: volume-11262cd0-202f-472f-9d01-54869632f8de.422eb76a-b989-46c7-8830-9ff45a0d03ae {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 14:45:04 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[3755bb3c-7036-468e-a7e7-96a70e4b9b51]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:45:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-378e8773-7cb1-4eca-bb5a-c63b638dc7bf tempest-VolumesCloneTest-1003273504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-11262cd0-202f-472f-9d01-54869632f8de.422eb76a-b989-46c7-8830-9ff45a0d03ae {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:45:04 devstack sudo[100884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-11262cd0-202f-472f-9d01-54869632f8de.422eb76a-b989-46c7-8830-9ff45a0d03ae
Jul 09 14:45:04 devstack sudo[100884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:45:04 devstack sudo[100884]: pam_unix(sudo:session): session closed for user root
Jul 09 14:45:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-378e8773-7cb1-4eca-bb5a-c63b638dc7bf tempest-VolumesCloneTest-1003273504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-11262cd0-202f-472f-9d01-54869632f8de.422eb76a-b989-46c7-8830-9ff45a0d03ae" returned: 0 in 0.793s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:45:04 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-378e8773-7cb1-4eca-bb5a-c63b638dc7bf tempest-VolumesCloneTest-1003273504 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11262cd0-202f-472f-9d01-54869632f8de(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 14:45:05 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[044b2e2c-e042-496a-b913-a79a82d8cba0]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:45:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-378e8773-7cb1-4eca-bb5a-c63b638dc7bf tempest-VolumesCloneTest-1003273504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-11262cd0-202f-472f-9d01-54869632f8de {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:45:05 devstack sudo[100889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-11262cd0-202f-472f-9d01-54869632f8de
Jul 09 14:45:05 devstack sudo[100889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:45:05 devstack sudo[100889]: pam_unix(sudo:session): session closed for user root
Jul 09 14:45:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-378e8773-7cb1-4eca-bb5a-c63b638dc7bf tempest-VolumesCloneTest-1003273504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-11262cd0-202f-472f-9d01-54869632f8de" returned: 0 in 0.937s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:45:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-378e8773-7cb1-4eca-bb5a-c63b638dc7bf tempest-VolumesCloneTest-1003273504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-11262cd0-202f-472f-9d01-54869632f8de.422eb76a-b989-46c7-8830-9ff45a0d03ae {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:45:06 devstack sudo[100894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-11262cd0-202f-472f-9d01-54869632f8de.422eb76a-b989-46c7-8830-9ff45a0d03ae
Jul 09 14:45:06 devstack sudo[100894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:45:06 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-b03a7830-2699-4d53-9a64-31e00a5d6887 tempest-VolumeImageDependencyTests-392802147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:45:06 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b03a7830-2699-4d53-9a64-31e00a5d6887 tempest-VolumeImageDependencyTests-392802147 None] Flow 'volume_create_manager' (31a63a58-e11b-49d3-af7a-1ae0a94e7a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:45:06 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b03a7830-2699-4d53-9a64-31e00a5d6887 tempest-VolumeImageDependencyTests-392802147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3e05f43-33f6-404d-8a66-ef586269f7b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:45:06 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b03a7830-2699-4d53-9a64-31e00a5d6887 tempest-VolumeImageDependencyTests-392802147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3e05f43-33f6-404d-8a66-ef586269f7b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:45:06Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c043e31-5b46-4008-b5c1-2a7a0586327d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0533bdd3cbc1476481cef4e8bd8b226d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:45:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:45:07Z,use_quota=True,user_id='65eeefc3873f4691bc73d99e83587bec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:45:06 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b03a7830-2699-4d53-9a64-31e00a5d6887 tempest-VolumeImageDependencyTests-392802147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c10ed35c-716d-41c7-8b45-dada6bc3fdfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:45:06 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b03a7830-2699-4d53-9a64-31e00a5d6887 tempest-VolumeImageDependencyTests-392802147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c10ed35c-716d-41c7-8b45-dada6bc3fdfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:45:06 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b03a7830-2699-4d53-9a64-31e00a5d6887 tempest-VolumeImageDependencyTests-392802147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (451addd3-191e-422c-ad6b-7e34cb032930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:45:06 devstack cinder-volume[87230]: DEBUG cinder.image.glance [None req-b03a7830-2699-4d53-9a64-31e00a5d6887 tempest-VolumeImageDependencyTests-392802147 None] Creating Keystone auth plugin from conf {{(pid=87230) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 09 14:45:06 devstack sudo[100894]: pam_unix(sudo:session): session closed for user root
Jul 09 14:45:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-378e8773-7cb1-4eca-bb5a-c63b638dc7bf tempest-VolumesCloneTest-1003273504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-11262cd0-202f-472f-9d01-54869632f8de.422eb76a-b989-46c7-8830-9ff45a0d03ae" returned: 0 in 0.880s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:45:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-378e8773-7cb1-4eca-bb5a-c63b638dc7bf tempest-VolumesCloneTest-1003273504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-11262cd0-202f-472f-9d01-54869632f8de.422eb76a-b989-46c7-8830-9ff45a0d03ae {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:45:06 devstack sudo[100899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-11262cd0-202f-472f-9d01-54869632f8de.422eb76a-b989-46c7-8830-9ff45a0d03ae
Jul 09 14:45:06 devstack sudo[100899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:45:07 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b03a7830-2699-4d53-9a64-31e00a5d6887 tempest-VolumeImageDependencyTests-392802147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (451addd3-191e-422c-ad6b-7e34cb032930) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8c043e31-5b46-4008-b5c1-2a7a0586327d', 'volume_name': 'volume-8c043e31-5b46-4008-b5c1-2a7a0586327d', 'volume_size': 1, 'image_id': '8293fddf-260e-463d-9248-03a538290e64', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8293fddf-260e-463d-9248-03a538290e64', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'faf1d6b83f64abf9598ffae0593ab144', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0533bdd3cbc1476481cef4e8bd8b226d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2f6798779bdc4d6df12f8c2bb2bfa4b08ea43690bb6d163037b6a9738aa725b082fa4dd846ba84ec3a42772777873cdc7910095e88e368ba2f46c3b5dcec9b7b', 'id': '8293fddf-260e-463d-9248-03a538290e64', 'created_at': datetime.datetime(2026, 7, 9, 12, 45, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 12, 45, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8293fddf-260e-463d-9248-03a538290e64/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x720a54453080>}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:45:07 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b03a7830-2699-4d53-9a64-31e00a5d6887 tempest-VolumeImageDependencyTests-392802147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e989cc2-be24-48cd-85a5-95293e070cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:45:07 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b03a7830-2699-4d53-9a64-31e00a5d6887 tempest-VolumeImageDependencyTests-392802147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e989cc2-be24-48cd-85a5-95293e070cd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:45:07 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b03a7830-2699-4d53-9a64-31e00a5d6887 tempest-VolumeImageDependencyTests-392802147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed6bb939-90f6-4d50-933b-9d683d60a362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:45:07 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-b03a7830-2699-4d53-9a64-31e00a5d6887 tempest-VolumeImageDependencyTests-392802147 None] Volume 8c043e31-5b46-4008-b5c1-2a7a0586327d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8c043e31-5b46-4008-b5c1-2a7a0586327d', 'volume_size': 1, 'image_id': '8293fddf-260e-463d-9248-03a538290e64', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8293fddf-260e-463d-9248-03a538290e64', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'faf1d6b83f64abf9598ffae0593ab144', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0533bdd3cbc1476481cef4e8bd8b226d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2f6798779bdc4d6df12f8c2bb2bfa4b08ea43690bb6d163037b6a9738aa725b082fa4dd846ba84ec3a42772777873cdc7910095e88e368ba2f46c3b5dcec9b7b', 'id': '8293fddf-260e-463d-9248-03a538290e64', 'created_at': datetime.datetime(2026, 7, 9, 12, 45, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 12, 45, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8293fddf-260e-463d-9248-03a538290e64/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x720a54453080>}
Jul 09 14:45:07 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-b03a7830-2699-4d53-9a64-31e00a5d6887 tempest-VolumeImageDependencyTests-392802147 None] Trying to clone 8c043e31-5b46-4008-b5c1-2a7a0586327d from image 8293fddf-260e-463d-9248-03a538290e64 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8293fddf-260e-463d-9248-03a538290e64', 'metadata': {}}]). {{(pid=87230) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 09 14:45:07 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-b03a7830-2699-4d53-9a64-31e00a5d6887 tempest-VolumeImageDependencyTests-392802147 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8293fddf-260e-463d-9248-03a538290e64_rrtwfgmsdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87230) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 09 14:45:07 devstack cinder-volume[87230]: INFO cinder.image.image_utils [None req-b03a7830-2699-4d53-9a64-31e00a5d6887 tempest-VolumeImageDependencyTests-392802147 None] Image download 0.00 MB at 0.00 MB/s
Jul 09 14:45:07 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e3f73bf-f2dc-4b20-bd63-566762fcb8fb]: (4, 'raw') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:45:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b03a7830-2699-4d53-9a64-31e00a5d6887 tempest-VolumeImageDependencyTests-392802147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8293fddf-260e-463d-9248-03a538290e64_rrtwfgmsdevstack@QuobyteHD {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:45:07 devstack sudo[100901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8293fddf-260e-463d-9248-03a538290e64_rrtwfgmsdevstack@QuobyteHD
Jul 09 14:45:07 devstack sudo[100901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:45:07 devstack sudo[100899]: pam_unix(sudo:session): session closed for user root
Jul 09 14:45:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-378e8773-7cb1-4eca-bb5a-c63b638dc7bf tempest-VolumesCloneTest-1003273504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-11262cd0-202f-472f-9d01-54869632f8de.422eb76a-b989-46c7-8830-9ff45a0d03ae" returned: 0 in 0.725s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:45:07 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-378e8773-7cb1-4eca-bb5a-c63b638dc7bf tempest-VolumesCloneTest-1003273504 None] Lock "cinder-quobyte-422eb76a-b989-46c7-8830-9ff45a0d03ae" released by "_delete_snapshot" :: held 3.452s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:45:07 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=92,cinder:INSERT=36,cinder:UPDATE=131,cinder:DELETE=11 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 14:45:07 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=98,cinder:UPDATE=127,cinder:INSERT=34,cinder:DELETE=12 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 14:45:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-378e8773-7cb1-4eca-bb5a-c63b638dc7bf tempest-VolumesCloneTest-1003273504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 25.235s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:45:07 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-378e8773-7cb1-4eca-bb5a-c63b638dc7bf tempest-VolumesCloneTest-1003273504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (356c18bd-5883-48b3-92d5-bdb6f782691b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db8bfc68-a815-42aa-b1f9-fe91b3ab7eae', 'volume_size': 2, 'source_volid': '11262cd0-202f-472f-9d01-54869632f8de', 'source_volstatus': 'available'}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:45:07 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-378e8773-7cb1-4eca-bb5a-c63b638dc7bf tempest-VolumesCloneTest-1003273504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61ff6c79-8b76-406b-832a-89923b9d00fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:45:07 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-378e8773-7cb1-4eca-bb5a-c63b638dc7bf tempest-VolumesCloneTest-1003273504 None] Volume volume-db8bfc68-a815-42aa-b1f9-fe91b3ab7eae (db8bfc68-a815-42aa-b1f9-fe91b3ab7eae): created successfully
Jul 09 14:45:07 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-378e8773-7cb1-4eca-bb5a-c63b638dc7bf tempest-VolumesCloneTest-1003273504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61ff6c79-8b76-406b-832a-89923b9d00fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:45:07 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-378e8773-7cb1-4eca-bb5a-c63b638dc7bf tempest-VolumesCloneTest-1003273504 None] Flow 'volume_create_manager' (a190906d-e92b-4c6b-a130-ab940ea730f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:45:07 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-378e8773-7cb1-4eca-bb5a-c63b638dc7bf tempest-VolumesCloneTest-1003273504 None] Created volume successfully.
Jul 09 14:45:07 devstack sudo[100901]: pam_unix(sudo:session): session closed for user root
Jul 09 14:45:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b03a7830-2699-4d53-9a64-31e00a5d6887 tempest-VolumeImageDependencyTests-392802147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8293fddf-260e-463d-9248-03a538290e64_rrtwfgmsdevstack@QuobyteHD" returned: 0 in 0.754s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:45:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b03a7830-2699-4d53-9a64-31e00a5d6887 tempest-VolumeImageDependencyTests-392802147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8293fddf-260e-463d-9248-03a538290e64_rrtwfgmsdevstack@QuobyteHD {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:45:08 devstack sudo[100906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8293fddf-260e-463d-9248-03a538290e64_rrtwfgmsdevstack@QuobyteHD
Jul 09 14:45:08 devstack sudo[100906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:45:08 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-97476368-04e3-4e5b-9245-c887fff330ad tempest-VolumesImageMetadata-64242335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:45:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-97476368-04e3-4e5b-9245-c887fff330ad tempest-VolumesImageMetadata-64242335 None] Flow 'volume_create_manager' (c2b5a651-a770-4128-9d5b-c8c070787450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:45:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-97476368-04e3-4e5b-9245-c887fff330ad tempest-VolumesImageMetadata-64242335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7165209-07cb-4f0d-a6dc-2d5596b19a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:45:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-97476368-04e3-4e5b-9245-c887fff330ad tempest-VolumesImageMetadata-64242335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7165209-07cb-4f0d-a6dc-2d5596b19a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:45:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1330073691',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a080b871-c1e0-43ba-afb6-b129198b0c47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae79b5ea43ba44a6b25c6cb6751805bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:45:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:45:08Z,use_quota=True,user_id='72a6a289afe643138a96162c9a58ec74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:45:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-97476368-04e3-4e5b-9245-c887fff330ad tempest-VolumesImageMetadata-64242335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (866234ed-9870-4156-b5b5-ed99b45a5c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:45:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-97476368-04e3-4e5b-9245-c887fff330ad tempest-VolumesImageMetadata-64242335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (866234ed-9870-4156-b5b5-ed99b45a5c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:45:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-97476368-04e3-4e5b-9245-c887fff330ad tempest-VolumesImageMetadata-64242335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (186ebbf4-a597-4638-a167-c580e2983c96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:45:08 devstack cinder-volume[87230]: DEBUG cinder.image.glance [None req-97476368-04e3-4e5b-9245-c887fff330ad tempest-VolumesImageMetadata-64242335 None] Creating Keystone auth plugin from conf {{(pid=87230) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 09 14:45:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-97476368-04e3-4e5b-9245-c887fff330ad tempest-VolumesImageMetadata-64242335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (186ebbf4-a597-4638-a167-c580e2983c96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a080b871-c1e0-43ba-afb6-b129198b0c47', 'volume_name': 'volume-a080b871-c1e0-43ba-afb6-b129198b0c47', 'volume_size': 1, 'image_id': '5eba314f-9adb-4fc7-aaad-9e9a3b7dae70', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5eba314f-9adb-4fc7-aaad-9e9a3b7dae70', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '10a7640b39774d00a67b2de818bf4a10', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5eba314f-9adb-4fc7-aaad-9e9a3b7dae70', 'created_at': datetime.datetime(2026, 7, 9, 12, 24, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 12, 24, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5eba314f-9adb-4fc7-aaad-9e9a3b7dae70/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x720a54606240>}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:45:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-97476368-04e3-4e5b-9245-c887fff330ad tempest-VolumesImageMetadata-64242335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (112a484b-1a4a-4ff4-a715-d1b35ffe93ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:45:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-97476368-04e3-4e5b-9245-c887fff330ad tempest-VolumesImageMetadata-64242335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (112a484b-1a4a-4ff4-a715-d1b35ffe93ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:45:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-97476368-04e3-4e5b-9245-c887fff330ad tempest-VolumesImageMetadata-64242335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3f91691-d07e-418d-81a7-74eea6081595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:45:08 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-97476368-04e3-4e5b-9245-c887fff330ad tempest-VolumesImageMetadata-64242335 None] Volume a080b871-c1e0-43ba-afb6-b129198b0c47: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a080b871-c1e0-43ba-afb6-b129198b0c47', 'volume_size': 1, 'image_id': '5eba314f-9adb-4fc7-aaad-9e9a3b7dae70', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5eba314f-9adb-4fc7-aaad-9e9a3b7dae70', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '10a7640b39774d00a67b2de818bf4a10', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5eba314f-9adb-4fc7-aaad-9e9a3b7dae70', 'created_at': datetime.datetime(2026, 7, 9, 12, 24, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 12, 24, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5eba314f-9adb-4fc7-aaad-9e9a3b7dae70/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x720a54606240>}
Jul 09 14:45:08 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-97476368-04e3-4e5b-9245-c887fff330ad tempest-VolumesImageMetadata-64242335 None] Trying to clone a080b871-c1e0-43ba-afb6-b129198b0c47 from image 5eba314f-9adb-4fc7-aaad-9e9a3b7dae70 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5eba314f-9adb-4fc7-aaad-9e9a3b7dae70', 'metadata': {}}]). {{(pid=87230) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 09 14:45:08 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-54e38253-b509-419b-82cf-c913186eb1a8 tempest-VolumesCloneTest-1003273504 None] Acquiring lock "cinder-db8bfc68-a815-42aa-b1f9-fe91b3ab7eae-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:45:08 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-54e38253-b509-419b-82cf-c913186eb1a8 tempest-VolumesCloneTest-1003273504 None] Lock "cinder-db8bfc68-a815-42aa-b1f9-fe91b3ab7eae-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:45:08 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-54e38253-b509-419b-82cf-c913186eb1a8 tempest-VolumesCloneTest-1003273504 None] Acquiring lock "cinder-quobyte-db8bfc68-a815-42aa-b1f9-fe91b3ab7eae" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:45:08 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-54e38253-b509-419b-82cf-c913186eb1a8 tempest-VolumesCloneTest-1003273504 None] Lock "cinder-quobyte-db8bfc68-a815-42aa-b1f9-fe91b3ab7eae" acquired by "delete_volume" :: waited 0.039s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:45:08 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ae2ce8-10fd-4d76-bca7-de935acdd0e3]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:45:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-54e38253-b509-419b-82cf-c913186eb1a8 tempest-VolumesCloneTest-1003273504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-db8bfc68-a815-42aa-b1f9-fe91b3ab7eae {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:45:08 devstack sudo[100906]: pam_unix(sudo:session): session closed for user root
Jul 09 14:45:08 devstack sudo[100909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-db8bfc68-a815-42aa-b1f9-fe91b3ab7eae
Jul 09 14:45:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b03a7830-2699-4d53-9a64-31e00a5d6887 tempest-VolumeImageDependencyTests-392802147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8293fddf-260e-463d-9248-03a538290e64_rrtwfgmsdevstack@QuobyteHD" returned: 1 in 0.824s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:45:08 devstack sudo[100909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:45:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b03a7830-2699-4d53-9a64-31e00a5d6887 tempest-VolumeImageDependencyTests-392802147 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8293fddf-260e-463d-9248-03a538290e64_rrtwfgmsdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 09 14:45:08 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-b03a7830-2699-4d53-9a64-31e00a5d6887 tempest-VolumeImageDependencyTests-392802147 None] Temporary image 8293fddf-260e-463d-9248-03a538290e64 is fetched for user 65eeefc3873f4691bc73d99e83587bec. {{(pid=87230) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 09 14:45:08 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-97476368-04e3-4e5b-9245-c887fff330ad tempest-VolumesImageMetadata-64242335 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5eba314f-9adb-4fc7-aaad-9e9a3b7dae70_jez_6apqdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87230) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 09 14:45:08 devstack cinder-volume[87230]: INFO cinder.image.image_utils [None req-97476368-04e3-4e5b-9245-c887fff330ad tempest-VolumesImageMetadata-64242335 None] Image download 20.69 MB at 20.69 MB/s
Jul 09 14:45:08 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[4284430e-abf7-4e9a-ae68-4105b456c5e4]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:45:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-97476368-04e3-4e5b-9245-c887fff330ad tempest-VolumesImageMetadata-64242335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5eba314f-9adb-4fc7-aaad-9e9a3b7dae70_jez_6apqdevstack@QuobyteHD {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:45:08 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0251da8-e6a3-4835-929e-96398804df15]: (4, 'raw') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:45:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b03a7830-2699-4d53-9a64-31e00a5d6887 tempest-VolumeImageDependencyTests-392802147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8293fddf-260e-463d-9248-03a538290e64_rrtwfgmsdevstack@QuobyteHD {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:45:08 devstack sudo[100915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5eba314f-9adb-4fc7-aaad-9e9a3b7dae70_jez_6apqdevstack@QuobyteHD
Jul 09 14:45:08 devstack sudo[100915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:45:09 devstack sudo[100916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8293fddf-260e-463d-9248-03a538290e64_rrtwfgmsdevstack@QuobyteHD
Jul 09 14:45:09 devstack sudo[100916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:45:09 devstack sudo[100909]: pam_unix(sudo:session): session closed for user root
Jul 09 14:45:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-54e38253-b509-419b-82cf-c913186eb1a8 tempest-VolumesCloneTest-1003273504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-db8bfc68-a815-42aa-b1f9-fe91b3ab7eae" returned: 0 in 0.840s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:45:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-54e38253-b509-419b-82cf-c913186eb1a8 tempest-VolumesCloneTest-1003273504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-db8bfc68-a815-42aa-b1f9-fe91b3ab7eae {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:45:09 devstack sudo[100922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-db8bfc68-a815-42aa-b1f9-fe91b3ab7eae
Jul 09 14:45:09 devstack sudo[100922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:45:09 devstack sudo[100915]: pam_unix(sudo:session): session closed for user root
Jul 09 14:45:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-97476368-04e3-4e5b-9245-c887fff330ad tempest-VolumesImageMetadata-64242335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5eba314f-9adb-4fc7-aaad-9e9a3b7dae70_jez_6apqdevstack@QuobyteHD" returned: 0 in 0.782s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:45:09 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-97476368-04e3-4e5b-9245-c887fff330ad tempest-VolumesImageMetadata-64242335 None] Temporary image 5eba314f-9adb-4fc7-aaad-9e9a3b7dae70 is fetched for user 72a6a289afe643138a96162c9a58ec74. {{(pid=87230) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 09 14:45:09 devstack sudo[100916]: pam_unix(sudo:session): session closed for user root
Jul 09 14:45:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b03a7830-2699-4d53-9a64-31e00a5d6887 tempest-VolumeImageDependencyTests-392802147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8293fddf-260e-463d-9248-03a538290e64_rrtwfgmsdevstack@QuobyteHD" returned: 0 in 0.770s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:45:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b03a7830-2699-4d53-9a64-31e00a5d6887 tempest-VolumeImageDependencyTests-392802147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8293fddf-260e-463d-9248-03a538290e64_rrtwfgmsdevstack@QuobyteHD {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:45:09 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ae52a7-6ddf-4106-b783-d44c07ec2fd2]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:45:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-97476368-04e3-4e5b-9245-c887fff330ad tempest-VolumesImageMetadata-64242335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5eba314f-9adb-4fc7-aaad-9e9a3b7dae70_jez_6apqdevstack@QuobyteHD {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:45:09 devstack sudo[100929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8293fddf-260e-463d-9248-03a538290e64_rrtwfgmsdevstack@QuobyteHD
Jul 09 14:45:09 devstack sudo[100929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:45:09 devstack sudo[100930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5eba314f-9adb-4fc7-aaad-9e9a3b7dae70_jez_6apqdevstack@QuobyteHD
Jul 09 14:45:09 devstack sudo[100930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:45:10 devstack sudo[100922]: pam_unix(sudo:session): session closed for user root
Jul 09 14:45:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-54e38253-b509-419b-82cf-c913186eb1a8 tempest-VolumesCloneTest-1003273504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-db8bfc68-a815-42aa-b1f9-fe91b3ab7eae" returned: 0 in 0.752s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:45:10 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-54e38253-b509-419b-82cf-c913186eb1a8 tempest-VolumesCloneTest-1003273504 None] Lock "cinder-quobyte-db8bfc68-a815-42aa-b1f9-fe91b3ab7eae" released by "delete_volume" :: held 1.661s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:45:10 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-54e38253-b509-419b-82cf-c913186eb1a8 tempest-VolumesCloneTest-1003273504 None] Created reservations ['7083303d-d4b2-454e-851a-1c9c0f41d94f', '99a23a75-3347-4845-ae2f-a4cd262d7f31', 'e210ec73-3675-4f52-9869-10a138372478', '1286cda1-717e-4fec-898d-c88feb67c08d'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:45:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-54e38253-b509-419b-82cf-c913186eb1a8 tempest-VolumesCloneTest-1003273504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:45:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-54e38253-b509-419b-82cf-c913186eb1a8 tempest-VolumesCloneTest-1003273504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:45:10 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-54e38253-b509-419b-82cf-c913186eb1a8 tempest-VolumesCloneTest-1003273504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:45:10 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-54e38253-b509-419b-82cf-c913186eb1a8 tempest-VolumesCloneTest-1003273504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:45:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-54e38253-b509-419b-82cf-c913186eb1a8 tempest-VolumesCloneTest-1003273504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:45:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-54e38253-b509-419b-82cf-c913186eb1a8 tempest-VolumesCloneTest-1003273504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:45:10 devstack sudo[100937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:45:10 devstack sudo[100937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:45:10 devstack sudo[100929]: pam_unix(sudo:session): session closed for user root
Jul 09 14:45:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b03a7830-2699-4d53-9a64-31e00a5d6887 tempest-VolumeImageDependencyTests-392802147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8293fddf-260e-463d-9248-03a538290e64_rrtwfgmsdevstack@QuobyteHD" returned: 1 in 0.843s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:45:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b03a7830-2699-4d53-9a64-31e00a5d6887 tempest-VolumeImageDependencyTests-392802147 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8293fddf-260e-463d-9248-03a538290e64_rrtwfgmsdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 09 14:45:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b03a7830-2699-4d53-9a64-31e00a5d6887 tempest-VolumeImageDependencyTests-392802147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:45:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b03a7830-2699-4d53-9a64-31e00a5d6887 tempest-VolumeImageDependencyTests-392802147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:45:10 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b03a7830-2699-4d53-9a64-31e00a5d6887 tempest-VolumeImageDependencyTests-392802147 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:45:06Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c043e31-5b46-4008-b5c1-2a7a0586327d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0533bdd3cbc1476481cef4e8bd8b226d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:45:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:45:07Z,use_quota=True,user_id='65eeefc3873f4691bc73d99e83587bec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:45:10 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-b03a7830-2699-4d53-9a64-31e00a5d6887 tempest-VolumeImageDependencyTests-392802147 None] Creating volume 8c043e31-5b46-4008-b5c1-2a7a0586327d {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:45:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b03a7830-2699-4d53-9a64-31e00a5d6887 tempest-VolumeImageDependencyTests-392802147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:45:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b03a7830-2699-4d53-9a64-31e00a5d6887 tempest-VolumeImageDependencyTests-392802147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:45:10 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b03a7830-2699-4d53-9a64-31e00a5d6887 tempest-VolumeImageDependencyTests-392802147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:45:10 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b03a7830-2699-4d53-9a64-31e00a5d6887 tempest-VolumeImageDependencyTests-392802147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:45:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b03a7830-2699-4d53-9a64-31e00a5d6887 tempest-VolumeImageDependencyTests-392802147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:45:10 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b03a7830-2699-4d53-9a64-31e00a5d6887 tempest-VolumeImageDependencyTests-392802147 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:45:10 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-b03a7830-2699-4d53-9a64-31e00a5d6887 tempest-VolumeImageDependencyTests-392802147 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:45:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b03a7830-2699-4d53-9a64-31e00a5d6887 tempest-VolumeImageDependencyTests-392802147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8c043e31-5b46-4008-b5c1-2a7a0586327d 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:45:10 devstack sudo[100941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8c043e31-5b46-4008-b5c1-2a7a0586327d 1073741824
Jul 09 14:45:10 devstack sudo[100941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:45:10 devstack sudo[100930]: pam_unix(sudo:session): session closed for user root
Jul 09 14:45:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-97476368-04e3-4e5b-9245-c887fff330ad tempest-VolumesImageMetadata-64242335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5eba314f-9adb-4fc7-aaad-9e9a3b7dae70_jez_6apqdevstack@QuobyteHD" returned: 0 in 0.974s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:45:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-97476368-04e3-4e5b-9245-c887fff330ad tempest-VolumesImageMetadata-64242335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:45:10 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e5fad709-504d-4af3-9b9f-8c13eecddcde tempest-VolumesCloneTest-1003273504 None] Acquiring lock "cinder-11262cd0-202f-472f-9d01-54869632f8de-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:45:10 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e5fad709-504d-4af3-9b9f-8c13eecddcde tempest-VolumesCloneTest-1003273504 None] Lock "cinder-11262cd0-202f-472f-9d01-54869632f8de-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:45:10 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e5fad709-504d-4af3-9b9f-8c13eecddcde tempest-VolumesCloneTest-1003273504 None] Acquiring lock "cinder-quobyte-11262cd0-202f-472f-9d01-54869632f8de" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:45:10 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e5fad709-504d-4af3-9b9f-8c13eecddcde tempest-VolumesCloneTest-1003273504 None] Lock "cinder-quobyte-11262cd0-202f-472f-9d01-54869632f8de" acquired by "delete_volume" :: waited 0.023s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:45:11 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[887b700e-63a3-41c2-9515-61adb48d7d91]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:45:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e5fad709-504d-4af3-9b9f-8c13eecddcde tempest-VolumesCloneTest-1003273504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-11262cd0-202f-472f-9d01-54869632f8de {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:45:11 devstack sudo[100945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-11262cd0-202f-472f-9d01-54869632f8de
Jul 09 14:45:11 devstack sudo[100945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:45:11 devstack sudo[100937]: pam_unix(sudo:session): session closed for user root
Jul 09 14:45:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-54e38253-b509-419b-82cf-c913186eb1a8 tempest-VolumesCloneTest-1003273504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.915s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:45:11 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-54e38253-b509-419b-82cf-c913186eb1a8 tempest-VolumesCloneTest-1003273504 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:45:11 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-54e38253-b509-419b-82cf-c913186eb1a8 tempest-VolumesCloneTest-1003273504 None] Deleted volume successfully.
Jul 09 14:45:11 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-54e38253-b509-419b-82cf-c913186eb1a8 tempest-VolumesCloneTest-1003273504 None] Lock "cinder-db8bfc68-a815-42aa-b1f9-fe91b3ab7eae-delete_volume" released by "delete_volume" :: held 2.874s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:45:11 devstack sudo[100941]: pam_unix(sudo:session): session closed for user root
Jul 09 14:45:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b03a7830-2699-4d53-9a64-31e00a5d6887 tempest-VolumeImageDependencyTests-392802147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8c043e31-5b46-4008-b5c1-2a7a0586327d 1073741824" returned: 0 in 1.031s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:45:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b03a7830-2699-4d53-9a64-31e00a5d6887 tempest-VolumeImageDependencyTests-392802147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8c043e31-5b46-4008-b5c1-2a7a0586327d {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:45:11 devstack sudo[100953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8c043e31-5b46-4008-b5c1-2a7a0586327d
Jul 09 14:45:11 devstack sudo[100953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:45:11 devstack sudo[100945]: pam_unix(sudo:session): session closed for user root
Jul 09 14:45:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e5fad709-504d-4af3-9b9f-8c13eecddcde tempest-VolumesCloneTest-1003273504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-11262cd0-202f-472f-9d01-54869632f8de" returned: 0 in 0.919s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:45:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e5fad709-504d-4af3-9b9f-8c13eecddcde tempest-VolumesCloneTest-1003273504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-11262cd0-202f-472f-9d01-54869632f8de {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:45:11 devstack sudo[100959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-11262cd0-202f-472f-9d01-54869632f8de
Jul 09 14:45:11 devstack sudo[100959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:45:12 devstack sudo[100953]: pam_unix(sudo:session): session closed for user root
Jul 09 14:45:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b03a7830-2699-4d53-9a64-31e00a5d6887 tempest-VolumeImageDependencyTests-392802147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8c043e31-5b46-4008-b5c1-2a7a0586327d" returned: 0 in 0.726s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:45:12 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b03a7830-2699-4d53-9a64-31e00a5d6887 tempest-VolumeImageDependencyTests-392802147 None] <== create_volume: return (1800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:45:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b03a7830-2699-4d53-9a64-31e00a5d6887 tempest-VolumeImageDependencyTests-392802147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.803s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:45:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-97476368-04e3-4e5b-9245-c887fff330ad tempest-VolumesImageMetadata-64242335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.589s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:45:12 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-97476368-04e3-4e5b-9245-c887fff330ad tempest-VolumesImageMetadata-64242335 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:45:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1330073691',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a080b871-c1e0-43ba-afb6-b129198b0c47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae79b5ea43ba44a6b25c6cb6751805bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:45:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:45:08Z,use_quota=True,user_id='72a6a289afe643138a96162c9a58ec74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:45:12 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-97476368-04e3-4e5b-9245-c887fff330ad tempest-VolumesImageMetadata-64242335 None] Creating volume a080b871-c1e0-43ba-afb6-b129198b0c47 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:45:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-97476368-04e3-4e5b-9245-c887fff330ad tempest-VolumesImageMetadata-64242335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:45:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-97476368-04e3-4e5b-9245-c887fff330ad tempest-VolumesImageMetadata-64242335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:45:12 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-97476368-04e3-4e5b-9245-c887fff330ad tempest-VolumesImageMetadata-64242335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:45:12 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-97476368-04e3-4e5b-9245-c887fff330ad tempest-VolumesImageMetadata-64242335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:45:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-97476368-04e3-4e5b-9245-c887fff330ad tempest-VolumesImageMetadata-64242335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:45:12 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-97476368-04e3-4e5b-9245-c887fff330ad tempest-VolumesImageMetadata-64242335 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:45:12 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-97476368-04e3-4e5b-9245-c887fff330ad tempest-VolumesImageMetadata-64242335 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:45:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-97476368-04e3-4e5b-9245-c887fff330ad tempest-VolumesImageMetadata-64242335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a080b871-c1e0-43ba-afb6-b129198b0c47 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:45:12 devstack sudo[100962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a080b871-c1e0-43ba-afb6-b129198b0c47 1073741824
Jul 09 14:45:12 devstack sudo[100962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:45:12 devstack cinder-volume[87230]: DEBUG cinder.volume.volume_utils [None req-b03a7830-2699-4d53-9a64-31e00a5d6887 tempest-VolumeImageDependencyTests-392802147 None] Attempting download of 8293fddf-260e-463d-9248-03a538290e64 ((None, [{'url': 'file:///opt/stack/data/glance/images/8293fddf-260e-463d-9248-03a538290e64', 'metadata': {}}])) to volume 8c043e31-5b46-4008-b5c1-2a7a0586327d. {{(pid=87230) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 09 14:45:12 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[45772562-18fb-46cf-8038-4960c44dd318]: (4, 'raw') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:45:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b03a7830-2699-4d53-9a64-31e00a5d6887 tempest-VolumeImageDependencyTests-392802147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8293fddf-260e-463d-9248-03a538290e64_22zf3tl4 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:45:12 devstack sudo[100964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8293fddf-260e-463d-9248-03a538290e64_22zf3tl4
Jul 09 14:45:12 devstack sudo[100964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:45:12 devstack sudo[100959]: pam_unix(sudo:session): session closed for user root
Jul 09 14:45:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e5fad709-504d-4af3-9b9f-8c13eecddcde tempest-VolumesCloneTest-1003273504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-11262cd0-202f-472f-9d01-54869632f8de" returned: 0 in 0.718s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:45:12 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e5fad709-504d-4af3-9b9f-8c13eecddcde tempest-VolumesCloneTest-1003273504 None] Lock "cinder-quobyte-11262cd0-202f-472f-9d01-54869632f8de" released by "delete_volume" :: held 1.709s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:45:12 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-e5fad709-504d-4af3-9b9f-8c13eecddcde tempest-VolumesCloneTest-1003273504 None] Created reservations ['cb67320a-789d-4d8c-8ba9-457a4bff7d24', '9e773139-cbb3-444e-ac48-5f9e5a9c8975', '3635ea87-0a2f-48ca-9525-19fcb46727b1', '3aec43e7-a8a2-41be-8b76-852503122db9'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:45:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e5fad709-504d-4af3-9b9f-8c13eecddcde tempest-VolumesCloneTest-1003273504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:45:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e5fad709-504d-4af3-9b9f-8c13eecddcde tempest-VolumesCloneTest-1003273504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:45:12 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-e5fad709-504d-4af3-9b9f-8c13eecddcde tempest-VolumesCloneTest-1003273504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:45:12 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-e5fad709-504d-4af3-9b9f-8c13eecddcde tempest-VolumesCloneTest-1003273504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:45:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e5fad709-504d-4af3-9b9f-8c13eecddcde tempest-VolumesCloneTest-1003273504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:45:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e5fad709-504d-4af3-9b9f-8c13eecddcde tempest-VolumesCloneTest-1003273504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:45:12 devstack sudo[100967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:45:12 devstack sudo[100967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:45:13 devstack sudo[100962]: pam_unix(sudo:session): session closed for user root
Jul 09 14:45:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-97476368-04e3-4e5b-9245-c887fff330ad tempest-VolumesImageMetadata-64242335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a080b871-c1e0-43ba-afb6-b129198b0c47 1073741824" returned: 0 in 1.038s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:45:13 devstack sudo[100964]: pam_unix(sudo:session): session closed for user root
Jul 09 14:45:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b03a7830-2699-4d53-9a64-31e00a5d6887 tempest-VolumeImageDependencyTests-392802147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8293fddf-260e-463d-9248-03a538290e64_22zf3tl4" returned: 0 in 0.991s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:45:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b03a7830-2699-4d53-9a64-31e00a5d6887 tempest-VolumeImageDependencyTests-392802147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8293fddf-260e-463d-9248-03a538290e64_22zf3tl4 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:45:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-97476368-04e3-4e5b-9245-c887fff330ad tempest-VolumesImageMetadata-64242335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a080b871-c1e0-43ba-afb6-b129198b0c47 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:45:13 devstack sudo[100980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a080b871-c1e0-43ba-afb6-b129198b0c47
Jul 09 14:45:13 devstack sudo[100980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:45:13 devstack sudo[100979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8293fddf-260e-463d-9248-03a538290e64_22zf3tl4
Jul 09 14:45:13 devstack sudo[100979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:45:13 devstack sudo[100967]: pam_unix(sudo:session): session closed for user root
Jul 09 14:45:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e5fad709-504d-4af3-9b9f-8c13eecddcde tempest-VolumesCloneTest-1003273504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.974s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:45:13 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-e5fad709-504d-4af3-9b9f-8c13eecddcde tempest-VolumesCloneTest-1003273504 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:45:13 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-e5fad709-504d-4af3-9b9f-8c13eecddcde tempest-VolumesCloneTest-1003273504 None] Deleted volume successfully.
Jul 09 14:45:13 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e5fad709-504d-4af3-9b9f-8c13eecddcde tempest-VolumesCloneTest-1003273504 None] Lock "cinder-11262cd0-202f-472f-9d01-54869632f8de-delete_volume" released by "delete_volume" :: held 2.988s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:45:14 devstack sudo[100980]: pam_unix(sudo:session): session closed for user root
Jul 09 14:45:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-97476368-04e3-4e5b-9245-c887fff330ad tempest-VolumesImageMetadata-64242335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a080b871-c1e0-43ba-afb6-b129198b0c47" returned: 0 in 0.844s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:45:14 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-97476368-04e3-4e5b-9245-c887fff330ad tempest-VolumesImageMetadata-64242335 None] <== create_volume: return (1972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:45:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-97476368-04e3-4e5b-9245-c887fff330ad tempest-VolumesImageMetadata-64242335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.975s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:45:14 devstack cinder-volume[87230]: DEBUG cinder.volume.volume_utils [None req-97476368-04e3-4e5b-9245-c887fff330ad tempest-VolumesImageMetadata-64242335 None] Attempting download of 5eba314f-9adb-4fc7-aaad-9e9a3b7dae70 ((None, [{'url': 'file:///opt/stack/data/glance/images/5eba314f-9adb-4fc7-aaad-9e9a3b7dae70', 'metadata': {}}])) to volume a080b871-c1e0-43ba-afb6-b129198b0c47. {{(pid=87230) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 09 14:45:14 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab274d31-a76b-4e02-96ac-d64f2e4aa1d3]: (4, 'raw') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:45:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-97476368-04e3-4e5b-9245-c887fff330ad tempest-VolumesImageMetadata-64242335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5eba314f-9adb-4fc7-aaad-9e9a3b7dae70_otioxb26 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:45:14 devstack sudo[100979]: pam_unix(sudo:session): session closed for user root
Jul 09 14:45:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b03a7830-2699-4d53-9a64-31e00a5d6887 tempest-VolumeImageDependencyTests-392802147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8293fddf-260e-463d-9248-03a538290e64_22zf3tl4" returned: 1 in 1.089s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:45:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b03a7830-2699-4d53-9a64-31e00a5d6887 tempest-VolumeImageDependencyTests-392802147 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8293fddf-260e-463d-9248-03a538290e64_22zf3tl4' failed. Not Retrying. {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 09 14:45:14 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe4a0a7-edc1-47c5-a58b-b185ac3cfbde]: (4, 'raw') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:45:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b03a7830-2699-4d53-9a64-31e00a5d6887 tempest-VolumeImageDependencyTests-392802147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8293fddf-260e-463d-9248-03a538290e64_rrtwfgmsdevstack@QuobyteHD {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:45:14 devstack sudo[100989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5eba314f-9adb-4fc7-aaad-9e9a3b7dae70_otioxb26
Jul 09 14:45:14 devstack sudo[100989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:45:14 devstack sudo[100990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8293fddf-260e-463d-9248-03a538290e64_rrtwfgmsdevstack@QuobyteHD
Jul 09 14:45:14 devstack sudo[100990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:45:15 devstack sudo[100989]: pam_unix(sudo:session): session closed for user root
Jul 09 14:45:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-97476368-04e3-4e5b-9245-c887fff330ad tempest-VolumesImageMetadata-64242335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5eba314f-9adb-4fc7-aaad-9e9a3b7dae70_otioxb26" returned: 0 in 0.905s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:45:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-97476368-04e3-4e5b-9245-c887fff330ad tempest-VolumesImageMetadata-64242335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5eba314f-9adb-4fc7-aaad-9e9a3b7dae70_otioxb26 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:45:15 devstack sudo[100990]: pam_unix(sudo:session): session closed for user root
Jul 09 14:45:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b03a7830-2699-4d53-9a64-31e00a5d6887 tempest-VolumeImageDependencyTests-392802147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8293fddf-260e-463d-9248-03a538290e64_rrtwfgmsdevstack@QuobyteHD" returned: 0 in 0.857s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:45:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b03a7830-2699-4d53-9a64-31e00a5d6887 tempest-VolumeImageDependencyTests-392802147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8293fddf-260e-463d-9248-03a538290e64_rrtwfgmsdevstack@QuobyteHD {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:45:15 devstack sudo[100997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5eba314f-9adb-4fc7-aaad-9e9a3b7dae70_otioxb26
Jul 09 14:45:15 devstack sudo[100997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:45:15 devstack sudo[100998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8293fddf-260e-463d-9248-03a538290e64_rrtwfgmsdevstack@QuobyteHD
Jul 09 14:45:15 devstack sudo[100998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:45:16 devstack sudo[100997]: pam_unix(sudo:session): session closed for user root
Jul 09 14:45:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-97476368-04e3-4e5b-9245-c887fff330ad tempest-VolumesImageMetadata-64242335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5eba314f-9adb-4fc7-aaad-9e9a3b7dae70_otioxb26" returned: 1 in 0.880s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:45:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-97476368-04e3-4e5b-9245-c887fff330ad tempest-VolumesImageMetadata-64242335 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5eba314f-9adb-4fc7-aaad-9e9a3b7dae70_otioxb26' failed. Not Retrying. {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 09 14:45:16 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc6795e0-fae7-4913-9f61-b13ec09439a6]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:45:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-97476368-04e3-4e5b-9245-c887fff330ad tempest-VolumesImageMetadata-64242335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5eba314f-9adb-4fc7-aaad-9e9a3b7dae70_jez_6apqdevstack@QuobyteHD {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:45:16 devstack sudo[100998]: pam_unix(sudo:session): session closed for user root
Jul 09 14:45:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b03a7830-2699-4d53-9a64-31e00a5d6887 tempest-VolumeImageDependencyTests-392802147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8293fddf-260e-463d-9248-03a538290e64_rrtwfgmsdevstack@QuobyteHD" returned: 1 in 0.863s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:45:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b03a7830-2699-4d53-9a64-31e00a5d6887 tempest-VolumeImageDependencyTests-392802147 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8293fddf-260e-463d-9248-03a538290e64_rrtwfgmsdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 09 14:45:16 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-b03a7830-2699-4d53-9a64-31e00a5d6887 tempest-VolumeImageDependencyTests-392802147 None] 8293fddf-260e-463d-9248-03a538290e64 was raw, converting to raw {{(pid=87230) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 09 14:45:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b03a7830-2699-4d53-9a64-31e00a5d6887 tempest-VolumeImageDependencyTests-392802147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_8293fddf-260e-463d-9248-03a538290e64_rrtwfgmsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8c043e31-5b46-4008-b5c1-2a7a0586327d {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:45:16 devstack sudo[101011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_8293fddf-260e-463d-9248-03a538290e64_rrtwfgmsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8c043e31-5b46-4008-b5c1-2a7a0586327d
Jul 09 14:45:16 devstack sudo[101011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:45:16 devstack sudo[101010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5eba314f-9adb-4fc7-aaad-9e9a3b7dae70_jez_6apqdevstack@QuobyteHD
Jul 09 14:45:16 devstack sudo[101010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:45:17 devstack sudo[101010]: pam_unix(sudo:session): session closed for user root
Jul 09 14:45:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-97476368-04e3-4e5b-9245-c887fff330ad tempest-VolumesImageMetadata-64242335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5eba314f-9adb-4fc7-aaad-9e9a3b7dae70_jez_6apqdevstack@QuobyteHD" returned: 0 in 0.885s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:45:17 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-97476368-04e3-4e5b-9245-c887fff330ad tempest-VolumesImageMetadata-64242335 None] 5eba314f-9adb-4fc7-aaad-9e9a3b7dae70 was qcow2, converting to raw {{(pid=87230) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 09 14:45:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-97476368-04e3-4e5b-9245-c887fff330ad tempest-VolumesImageMetadata-64242335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5eba314f-9adb-4fc7-aaad-9e9a3b7dae70_jez_6apqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a080b871-c1e0-43ba-afb6-b129198b0c47 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:45:17 devstack sudo[101021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5eba314f-9adb-4fc7-aaad-9e9a3b7dae70_jez_6apqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a080b871-c1e0-43ba-afb6-b129198b0c47
Jul 09 14:45:17 devstack sudo[101021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:45:17 devstack sudo[101011]: pam_unix(sudo:session): session closed for user root
Jul 09 14:45:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b03a7830-2699-4d53-9a64-31e00a5d6887 tempest-VolumeImageDependencyTests-392802147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_8293fddf-260e-463d-9248-03a538290e64_rrtwfgmsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8c043e31-5b46-4008-b5c1-2a7a0586327d" returned: 0 in 0.931s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:45:17 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-b03a7830-2699-4d53-9a64-31e00a5d6887 tempest-VolumeImageDependencyTests-392802147 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8293fddf-260e-463d-9248-03a538290e64_rrtwfgmsdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8c043e31-5b46-4008-b5c1-2a7a0586327d {{(pid=87230) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 09 14:45:17 devstack cinder-volume[87230]: INFO cinder.image.image_utils [None req-b03a7830-2699-4d53-9a64-31e00a5d6887 tempest-VolumeImageDependencyTests-392802147 None] Converted 0.00 MB image at 0.00 MB/s
Jul 09 14:45:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b03a7830-2699-4d53-9a64-31e00a5d6887 tempest-VolumeImageDependencyTests-392802147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8c043e31-5b46-4008-b5c1-2a7a0586327d 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:45:17 devstack sudo[101023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8c043e31-5b46-4008-b5c1-2a7a0586327d 1G
Jul 09 14:45:17 devstack sudo[101023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:45:17 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-4660845a-56fc-419f-a33e-84c5b5c3ee7a tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:45:17 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4660845a-56fc-419f-a33e-84c5b5c3ee7a tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] Flow 'volume_create_manager' (3335f87a-2458-4359-8cf6-5a7899486b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:45:17 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4660845a-56fc-419f-a33e-84c5b5c3ee7a tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fd473d9-37a4-4d5f-aefa-0aad5741aae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:45:17 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4660845a-56fc-419f-a33e-84c5b5c3ee7a tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fd473d9-37a4-4d5f-aefa-0aad5741aae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:45:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-208025559',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82f34a80-bfa3-429a-ad43-a590837a1ae6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7901b7465f34da5bc8da15e2ef1dbc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:45:17Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:45:17Z,use_quota=True,user_id='4132abc5e0d145a483574c0a1fca7bce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:45:17 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4660845a-56fc-419f-a33e-84c5b5c3ee7a tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fc070ad-1439-43d5-af38-6284120977f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:45:17 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4660845a-56fc-419f-a33e-84c5b5c3ee7a tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fc070ad-1439-43d5-af38-6284120977f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:45:17 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4660845a-56fc-419f-a33e-84c5b5c3ee7a tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67896a5e-5f40-416e-b8f3-54e3a357a0de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:45:17 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4660845a-56fc-419f-a33e-84c5b5c3ee7a tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67896a5e-5f40-416e-b8f3-54e3a357a0de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82f34a80-bfa3-429a-ad43-a590837a1ae6', 'volume_name': 'volume-82f34a80-bfa3-429a-ad43-a590837a1ae6', 'volume_size': 2}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:45:17 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4660845a-56fc-419f-a33e-84c5b5c3ee7a tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00535d5e-427d-4fa4-8419-581315ac2922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:45:17 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4660845a-56fc-419f-a33e-84c5b5c3ee7a tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00535d5e-427d-4fa4-8419-581315ac2922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:45:17 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4660845a-56fc-419f-a33e-84c5b5c3ee7a tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37527539-4540-4f00-b2a6-ce87d87056f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:45:17 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-4660845a-56fc-419f-a33e-84c5b5c3ee7a tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] Volume 82f34a80-bfa3-429a-ad43-a590837a1ae6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82f34a80-bfa3-429a-ad43-a590837a1ae6', 'volume_size': 2}
Jul 09 14:45:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-4660845a-56fc-419f-a33e-84c5b5c3ee7a tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:45:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-4660845a-56fc-419f-a33e-84c5b5c3ee7a tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:45:17 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-4660845a-56fc-419f-a33e-84c5b5c3ee7a tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:45:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-208025559',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82f34a80-bfa3-429a-ad43-a590837a1ae6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7901b7465f34da5bc8da15e2ef1dbc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:45:17Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:45:17Z,use_quota=True,user_id='4132abc5e0d145a483574c0a1fca7bce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:45:17 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-4660845a-56fc-419f-a33e-84c5b5c3ee7a tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] Creating volume 82f34a80-bfa3-429a-ad43-a590837a1ae6 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:45:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-4660845a-56fc-419f-a33e-84c5b5c3ee7a tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:45:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-4660845a-56fc-419f-a33e-84c5b5c3ee7a tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:45:17 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-4660845a-56fc-419f-a33e-84c5b5c3ee7a tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:45:17 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-4660845a-56fc-419f-a33e-84c5b5c3ee7a tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:45:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-4660845a-56fc-419f-a33e-84c5b5c3ee7a tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:45:17 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-4660845a-56fc-419f-a33e-84c5b5c3ee7a tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:45:17 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-4660845a-56fc-419f-a33e-84c5b5c3ee7a tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:45:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4660845a-56fc-419f-a33e-84c5b5c3ee7a tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-82f34a80-bfa3-429a-ad43-a590837a1ae6 2147483648 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:45:17 devstack sudo[101025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-82f34a80-bfa3-429a-ad43-a590837a1ae6 2147483648
Jul 09 14:45:17 devstack sudo[101025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:45:17 devstack sudo[101023]: pam_unix(sudo:session): session closed for user root
Jul 09 14:45:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b03a7830-2699-4d53-9a64-31e00a5d6887 tempest-VolumeImageDependencyTests-392802147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8c043e31-5b46-4008-b5c1-2a7a0586327d 1G" returned: 0 in 0.794s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:45:18 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc55247-d289-4fed-a8ee-6c84eb90f256]: (4, 'raw') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:45:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b03a7830-2699-4d53-9a64-31e00a5d6887 tempest-VolumeImageDependencyTests-392802147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8c043e31-5b46-4008-b5c1-2a7a0586327d {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:45:18 devstack sudo[101039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8c043e31-5b46-4008-b5c1-2a7a0586327d
Jul 09 14:45:18 devstack sudo[101039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:45:18 devstack sudo[101025]: pam_unix(sudo:session): session closed for user root
Jul 09 14:45:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4660845a-56fc-419f-a33e-84c5b5c3ee7a tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-82f34a80-bfa3-429a-ad43-a590837a1ae6 2147483648" returned: 0 in 1.261s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:45:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4660845a-56fc-419f-a33e-84c5b5c3ee7a tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-82f34a80-bfa3-429a-ad43-a590837a1ae6 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:45:18 devstack sudo[101044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-82f34a80-bfa3-429a-ad43-a590837a1ae6
Jul 09 14:45:18 devstack sudo[101044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:45:19 devstack sudo[101039]: pam_unix(sudo:session): session closed for user root
Jul 09 14:45:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b03a7830-2699-4d53-9a64-31e00a5d6887 tempest-VolumeImageDependencyTests-392802147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8c043e31-5b46-4008-b5c1-2a7a0586327d" returned: 0 in 1.031s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:45:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b03a7830-2699-4d53-9a64-31e00a5d6887 tempest-VolumeImageDependencyTests-392802147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8c043e31-5b46-4008-b5c1-2a7a0586327d {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:45:19 devstack sudo[101051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8c043e31-5b46-4008-b5c1-2a7a0586327d
Jul 09 14:45:19 devstack sudo[101051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:45:19 devstack sudo[101021]: pam_unix(sudo:session): session closed for user root
Jul 09 14:45:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-97476368-04e3-4e5b-9245-c887fff330ad tempest-VolumesImageMetadata-64242335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5eba314f-9adb-4fc7-aaad-9e9a3b7dae70_jez_6apqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a080b871-c1e0-43ba-afb6-b129198b0c47" returned: 0 in 2.233s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:45:19 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-97476368-04e3-4e5b-9245-c887fff330ad tempest-VolumesImageMetadata-64242335 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5eba314f-9adb-4fc7-aaad-9e9a3b7dae70_jez_6apqdevstack@QuobyteHD, size 112.00 MB, duration 2.23 sec, destination /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a080b871-c1e0-43ba-afb6-b129198b0c47 {{(pid=87230) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 09 14:45:19 devstack cinder-volume[87230]: INFO cinder.image.image_utils [None req-97476368-04e3-4e5b-9245-c887fff330ad tempest-VolumesImageMetadata-64242335 None] Converted 112.00 MB image at 50.13 MB/s
Jul 09 14:45:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-97476368-04e3-4e5b-9245-c887fff330ad tempest-VolumesImageMetadata-64242335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a080b871-c1e0-43ba-afb6-b129198b0c47 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:45:19 devstack sudo[101054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a080b871-c1e0-43ba-afb6-b129198b0c47 1G
Jul 09 14:45:19 devstack sudo[101054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:45:19 devstack sudo[101044]: pam_unix(sudo:session): session closed for user root
Jul 09 14:45:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4660845a-56fc-419f-a33e-84c5b5c3ee7a tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-82f34a80-bfa3-429a-ad43-a590837a1ae6" returned: 0 in 0.850s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:45:19 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-4660845a-56fc-419f-a33e-84c5b5c3ee7a tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] <== create_volume: return (2178ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:45:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-4660845a-56fc-419f-a33e-84c5b5c3ee7a tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.180s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:45:19 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4660845a-56fc-419f-a33e-84c5b5c3ee7a tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37527539-4540-4f00-b2a6-ce87d87056f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82f34a80-bfa3-429a-ad43-a590837a1ae6', 'volume_size': 2}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:45:19 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4660845a-56fc-419f-a33e-84c5b5c3ee7a tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdf70c0f-dcb0-4287-ab35-259585334029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:45:19 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-4660845a-56fc-419f-a33e-84c5b5c3ee7a tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] Volume volume-82f34a80-bfa3-429a-ad43-a590837a1ae6 (82f34a80-bfa3-429a-ad43-a590837a1ae6): created successfully
Jul 09 14:45:19 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4660845a-56fc-419f-a33e-84c5b5c3ee7a tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdf70c0f-dcb0-4287-ab35-259585334029) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:45:19 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4660845a-56fc-419f-a33e-84c5b5c3ee7a tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] Flow 'volume_create_manager' (3335f87a-2458-4359-8cf6-5a7899486b41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:45:19 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-4660845a-56fc-419f-a33e-84c5b5c3ee7a tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] Created volume successfully.
Jul 09 14:45:20 devstack sudo[101051]: pam_unix(sudo:session): session closed for user root
Jul 09 14:45:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b03a7830-2699-4d53-9a64-31e00a5d6887 tempest-VolumeImageDependencyTests-392802147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8c043e31-5b46-4008-b5c1-2a7a0586327d" returned: 1 in 1.087s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:45:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b03a7830-2699-4d53-9a64-31e00a5d6887 tempest-VolumeImageDependencyTests-392802147 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8c043e31-5b46-4008-b5c1-2a7a0586327d' failed. Not Retrying. {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 09 14:45:20 devstack cinder-volume[87230]: DEBUG cinder.volume.volume_utils [None req-b03a7830-2699-4d53-9a64-31e00a5d6887 tempest-VolumeImageDependencyTests-392802147 None] Downloaded image 8293fddf-260e-463d-9248-03a538290e64 ((None, [{'url': 'file:///opt/stack/data/glance/images/8293fddf-260e-463d-9248-03a538290e64', 'metadata': {}}])) to volume 8c043e31-5b46-4008-b5c1-2a7a0586327d successfully. {{(pid=87230) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 09 14:45:20 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-b03a7830-2699-4d53-9a64-31e00a5d6887 tempest-VolumeImageDependencyTests-392802147 None] Temporary image 8293fddf-260e-463d-9248-03a538290e64 for user 65eeefc3873f4691bc73d99e83587bec is deleted. {{(pid=87230) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 09 14:45:20 devstack cinder-volume[87230]: DEBUG cinder.volume.volume_utils [None req-b03a7830-2699-4d53-9a64-31e00a5d6887 tempest-VolumeImageDependencyTests-392802147 None] Marking volume 8c043e31-5b46-4008-b5c1-2a7a0586327d as bootable. {{(pid=87230) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 09 14:45:20 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-b03a7830-2699-4d53-9a64-31e00a5d6887 tempest-VolumeImageDependencyTests-392802147 None] Copying metadata from image 8293fddf-260e-463d-9248-03a538290e64 to 8c043e31-5b46-4008-b5c1-2a7a0586327d. {{(pid=87230) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 09 14:45:20 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-b03a7830-2699-4d53-9a64-31e00a5d6887 tempest-VolumeImageDependencyTests-392802147 None] Creating volume glance metadata for volume 8c043e31-5b46-4008-b5c1-2a7a0586327d backed by image 8293fddf-260e-463d-9248-03a538290e64 with: {'image_id': '8293fddf-260e-463d-9248-03a538290e64', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'faf1d6b83f64abf9598ffae0593ab144', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87230) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 09 14:45:20 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b03a7830-2699-4d53-9a64-31e00a5d6887 tempest-VolumeImageDependencyTests-392802147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed6bb939-90f6-4d50-933b-9d683d60a362) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c043e31-5b46-4008-b5c1-2a7a0586327d', 'volume_size': 1, 'image_id': '8293fddf-260e-463d-9248-03a538290e64', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8293fddf-260e-463d-9248-03a538290e64', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'faf1d6b83f64abf9598ffae0593ab144', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0533bdd3cbc1476481cef4e8bd8b226d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2f6798779bdc4d6df12f8c2bb2bfa4b08ea43690bb6d163037b6a9738aa725b082fa4dd846ba84ec3a42772777873cdc7910095e88e368ba2f46c3b5dcec9b7b', 'id': '8293fddf-260e-463d-9248-03a538290e64', 'created_at': datetime.datetime(2026, 7, 9, 12, 45, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 12, 45, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8293fddf-260e-463d-9248-03a538290e64/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x720a54453080>}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:45:20 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b03a7830-2699-4d53-9a64-31e00a5d6887 tempest-VolumeImageDependencyTests-392802147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (472c3f81-f45d-4b2b-b346-759767c35e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:45:20 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-b03a7830-2699-4d53-9a64-31e00a5d6887 tempest-VolumeImageDependencyTests-392802147 None] Volume volume-8c043e31-5b46-4008-b5c1-2a7a0586327d (8c043e31-5b46-4008-b5c1-2a7a0586327d): created successfully
Jul 09 14:45:20 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b03a7830-2699-4d53-9a64-31e00a5d6887 tempest-VolumeImageDependencyTests-392802147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (472c3f81-f45d-4b2b-b346-759767c35e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:45:20 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b03a7830-2699-4d53-9a64-31e00a5d6887 tempest-VolumeImageDependencyTests-392802147 None] Flow 'volume_create_manager' (31a63a58-e11b-49d3-af7a-1ae0a94e7a93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:45:20 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-b03a7830-2699-4d53-9a64-31e00a5d6887 tempest-VolumeImageDependencyTests-392802147 None] Created volume successfully.
Jul 09 14:45:20 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-07e06b18-cbb0-43b4-b5f9-7b92ad0cb4fd req-c435a088-6c0f-473f-bbd6-c2c1e81cebec tempest-TestShelveInstance-1427794981 None] Terminate volume connection completed successfully.
Jul 09 14:45:20 devstack sudo[101054]: pam_unix(sudo:session): session closed for user root
Jul 09 14:45:20 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-07e06b18-cbb0-43b4-b5f9-7b92ad0cb4fd req-c435a088-6c0f-473f-bbd6-c2c1e81cebec tempest-TestShelveInstance-1427794981 None] Deleting attachment 9f330044-1fd6-436f-b189-d27f3c50379f. {{(pid=87230) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 09 14:45:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-97476368-04e3-4e5b-9245-c887fff330ad tempest-VolumesImageMetadata-64242335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a080b871-c1e0-43ba-afb6-b129198b0c47 1G" returned: 0 in 1.020s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:45:20 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[3109b49e-6a6e-4145-a9bf-083647bbf8aa]: (4, 'raw') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:45:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-97476368-04e3-4e5b-9245-c887fff330ad tempest-VolumesImageMetadata-64242335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a080b871-c1e0-43ba-afb6-b129198b0c47 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:45:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-79c7d0df-f262-447d-b499-e3516a5f9e06 tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:45:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-79c7d0df-f262-447d-b499-e3516a5f9e06 tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:45:20 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-79c7d0df-f262-447d-b499-e3516a5f9e06 tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] Creating offline snapshot 4f491508-506b-439e-848c-b7b338f0da54 of volume 82f34a80-bfa3-429a-ad43-a590837a1ae6 {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 14:45:20 devstack sudo[101079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a080b871-c1e0-43ba-afb6-b129198b0c47
Jul 09 14:45:20 devstack sudo[101079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:45:20 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[70165998-3d41-40d6-96bb-944474d57a4c]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:45:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-79c7d0df-f262-447d-b499-e3516a5f9e06 tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-82f34a80-bfa3-429a-ad43-a590837a1ae6 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:45:20 devstack sudo[101081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-82f34a80-bfa3-429a-ad43-a590837a1ae6
Jul 09 14:45:20 devstack sudo[101081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:45:20 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8b6c03a8-b5bc-497e-9bc8-a37ead99455f tempest-VolumeImageDependencyTests-392802147 None] Acquiring lock "cinder-8c043e31-5b46-4008-b5c1-2a7a0586327d-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:45:20 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8b6c03a8-b5bc-497e-9bc8-a37ead99455f tempest-VolumeImageDependencyTests-392802147 None] Lock "cinder-8c043e31-5b46-4008-b5c1-2a7a0586327d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:45:20 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8b6c03a8-b5bc-497e-9bc8-a37ead99455f tempest-VolumeImageDependencyTests-392802147 None] Acquiring lock "cinder-quobyte-8c043e31-5b46-4008-b5c1-2a7a0586327d" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:45:20 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8b6c03a8-b5bc-497e-9bc8-a37ead99455f tempest-VolumeImageDependencyTests-392802147 None] Lock "cinder-quobyte-8c043e31-5b46-4008-b5c1-2a7a0586327d" acquired by "delete_volume" :: waited 0.022s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:45:20 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[6085517c-c49c-4aba-91b4-98f40741e521]: (4, 'raw') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:45:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8b6c03a8-b5bc-497e-9bc8-a37ead99455f tempest-VolumeImageDependencyTests-392802147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8c043e31-5b46-4008-b5c1-2a7a0586327d {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:45:20 devstack sudo[101084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8c043e31-5b46-4008-b5c1-2a7a0586327d
Jul 09 14:45:20 devstack sudo[101084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:45:21 devstack sudo[101079]: pam_unix(sudo:session): session closed for user root
Jul 09 14:45:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-97476368-04e3-4e5b-9245-c887fff330ad tempest-VolumesImageMetadata-64242335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a080b871-c1e0-43ba-afb6-b129198b0c47" returned: 0 in 0.937s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:45:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-97476368-04e3-4e5b-9245-c887fff330ad tempest-VolumesImageMetadata-64242335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a080b871-c1e0-43ba-afb6-b129198b0c47 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:45:21 devstack sudo[101081]: pam_unix(sudo:session): session closed for user root
Jul 09 14:45:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-79c7d0df-f262-447d-b499-e3516a5f9e06 tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-82f34a80-bfa3-429a-ad43-a590837a1ae6" returned: 0 in 0.928s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:45:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-79c7d0df-f262-447d-b499-e3516a5f9e06 tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-82f34a80-bfa3-429a-ad43-a590837a1ae6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-82f34a80-bfa3-429a-ad43-a590837a1ae6.4f491508-506b-439e-848c-b7b338f0da54 2G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:45:21 devstack sudo[101093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a080b871-c1e0-43ba-afb6-b129198b0c47
Jul 09 14:45:21 devstack sudo[101093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:45:21 devstack sudo[101094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-82f34a80-bfa3-429a-ad43-a590837a1ae6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-82f34a80-bfa3-429a-ad43-a590837a1ae6.4f491508-506b-439e-848c-b7b338f0da54 2G
Jul 09 14:45:21 devstack sudo[101094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:45:21 devstack sudo[101084]: pam_unix(sudo:session): session closed for user root
Jul 09 14:45:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8b6c03a8-b5bc-497e-9bc8-a37ead99455f tempest-VolumeImageDependencyTests-392802147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8c043e31-5b46-4008-b5c1-2a7a0586327d" returned: 0 in 0.915s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:45:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8b6c03a8-b5bc-497e-9bc8-a37ead99455f tempest-VolumeImageDependencyTests-392802147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8c043e31-5b46-4008-b5c1-2a7a0586327d {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:45:21 devstack sudo[101099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8c043e31-5b46-4008-b5c1-2a7a0586327d
Jul 09 14:45:21 devstack sudo[101099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:45:22 devstack sudo[101093]: pam_unix(sudo:session): session closed for user root
Jul 09 14:45:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-97476368-04e3-4e5b-9245-c887fff330ad tempest-VolumesImageMetadata-64242335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a080b871-c1e0-43ba-afb6-b129198b0c47" returned: 1 in 0.921s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:45:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-97476368-04e3-4e5b-9245-c887fff330ad tempest-VolumesImageMetadata-64242335 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a080b871-c1e0-43ba-afb6-b129198b0c47' failed. Not Retrying. {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 09 14:45:22 devstack cinder-volume[87230]: DEBUG cinder.volume.volume_utils [None req-97476368-04e3-4e5b-9245-c887fff330ad tempest-VolumesImageMetadata-64242335 None] Downloaded image 5eba314f-9adb-4fc7-aaad-9e9a3b7dae70 ((None, [{'url': 'file:///opt/stack/data/glance/images/5eba314f-9adb-4fc7-aaad-9e9a3b7dae70', 'metadata': {}}])) to volume a080b871-c1e0-43ba-afb6-b129198b0c47 successfully. {{(pid=87230) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 09 14:45:22 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-97476368-04e3-4e5b-9245-c887fff330ad tempest-VolumesImageMetadata-64242335 None] Temporary image 5eba314f-9adb-4fc7-aaad-9e9a3b7dae70 for user 72a6a289afe643138a96162c9a58ec74 is deleted. {{(pid=87230) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 09 14:45:22 devstack cinder-volume[87230]: DEBUG cinder.volume.volume_utils [None req-97476368-04e3-4e5b-9245-c887fff330ad tempest-VolumesImageMetadata-64242335 None] Marking volume a080b871-c1e0-43ba-afb6-b129198b0c47 as bootable. {{(pid=87230) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 09 14:45:22 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-97476368-04e3-4e5b-9245-c887fff330ad tempest-VolumesImageMetadata-64242335 None] Copying metadata from image 5eba314f-9adb-4fc7-aaad-9e9a3b7dae70 to a080b871-c1e0-43ba-afb6-b129198b0c47. {{(pid=87230) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 09 14:45:22 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-97476368-04e3-4e5b-9245-c887fff330ad tempest-VolumesImageMetadata-64242335 None] Creating volume glance metadata for volume a080b871-c1e0-43ba-afb6-b129198b0c47 backed by image 5eba314f-9adb-4fc7-aaad-9e9a3b7dae70 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5eba314f-9adb-4fc7-aaad-9e9a3b7dae70', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87230) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 09 14:45:22 devstack sudo[101094]: pam_unix(sudo:session): session closed for user root
Jul 09 14:45:22 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-97476368-04e3-4e5b-9245-c887fff330ad tempest-VolumesImageMetadata-64242335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3f91691-d07e-418d-81a7-74eea6081595) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a080b871-c1e0-43ba-afb6-b129198b0c47', 'volume_size': 1, 'image_id': '5eba314f-9adb-4fc7-aaad-9e9a3b7dae70', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5eba314f-9adb-4fc7-aaad-9e9a3b7dae70', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '10a7640b39774d00a67b2de818bf4a10', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5eba314f-9adb-4fc7-aaad-9e9a3b7dae70', 'created_at': datetime.datetime(2026, 7, 9, 12, 24, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 12, 24, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5eba314f-9adb-4fc7-aaad-9e9a3b7dae70/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x720a54606240>}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:45:22 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-97476368-04e3-4e5b-9245-c887fff330ad tempest-VolumesImageMetadata-64242335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6822c038-2a83-4f42-9305-a99ee69f8249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:45:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-79c7d0df-f262-447d-b499-e3516a5f9e06 tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-82f34a80-bfa3-429a-ad43-a590837a1ae6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-82f34a80-bfa3-429a-ad43-a590837a1ae6.4f491508-506b-439e-848c-b7b338f0da54 2G" returned: 0 in 0.968s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:45:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-79c7d0df-f262-447d-b499-e3516a5f9e06 tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82f34a80-bfa3-429a-ad43-a590837a1ae6 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-82f34a80-bfa3-429a-ad43-a590837a1ae6.4f491508-506b-439e-848c-b7b338f0da54 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:45:22 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-97476368-04e3-4e5b-9245-c887fff330ad tempest-VolumesImageMetadata-64242335 None] Volume volume-a080b871-c1e0-43ba-afb6-b129198b0c47 (a080b871-c1e0-43ba-afb6-b129198b0c47): created successfully
Jul 09 14:45:22 devstack sudo[101107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82f34a80-bfa3-429a-ad43-a590837a1ae6 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-82f34a80-bfa3-429a-ad43-a590837a1ae6.4f491508-506b-439e-848c-b7b338f0da54
Jul 09 14:45:22 devstack sudo[101107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:45:22 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-97476368-04e3-4e5b-9245-c887fff330ad tempest-VolumesImageMetadata-64242335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6822c038-2a83-4f42-9305-a99ee69f8249) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:45:22 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-97476368-04e3-4e5b-9245-c887fff330ad tempest-VolumesImageMetadata-64242335 None] Flow 'volume_create_manager' (c2b5a651-a770-4128-9d5b-c8c070787450) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:45:22 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-97476368-04e3-4e5b-9245-c887fff330ad tempest-VolumesImageMetadata-64242335 None] Created volume successfully.
Jul 09 14:45:22 devstack sudo[101099]: pam_unix(sudo:session): session closed for user root
Jul 09 14:45:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8b6c03a8-b5bc-497e-9bc8-a37ead99455f tempest-VolumeImageDependencyTests-392802147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8c043e31-5b46-4008-b5c1-2a7a0586327d" returned: 1 in 0.957s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:45:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8b6c03a8-b5bc-497e-9bc8-a37ead99455f tempest-VolumeImageDependencyTests-392802147 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8c043e31-5b46-4008-b5c1-2a7a0586327d' failed. Not Retrying. {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 09 14:45:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8b6c03a8-b5bc-497e-9bc8-a37ead99455f tempest-VolumeImageDependencyTests-392802147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8c043e31-5b46-4008-b5c1-2a7a0586327d {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:45:22 devstack sudo[101112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8c043e31-5b46-4008-b5c1-2a7a0586327d
Jul 09 14:45:22 devstack sudo[101112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:45:23 devstack sudo[101107]: pam_unix(sudo:session): session closed for user root
Jul 09 14:45:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-79c7d0df-f262-447d-b499-e3516a5f9e06 tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82f34a80-bfa3-429a-ad43-a590837a1ae6 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-82f34a80-bfa3-429a-ad43-a590837a1ae6.4f491508-506b-439e-848c-b7b338f0da54" returned: 0 in 0.866s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:45:23 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-79c7d0df-f262-447d-b499-e3516a5f9e06 tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-82f34a80-bfa3-429a-ad43-a590837a1ae6.4f491508-506b-439e-848c-b7b338f0da54 is being set with open permissions: ugo+rw
Jul 09 14:45:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-79c7d0df-f262-447d-b499-e3516a5f9e06 tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-82f34a80-bfa3-429a-ad43-a590837a1ae6.4f491508-506b-439e-848c-b7b338f0da54 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:45:23 devstack sudo[101118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-82f34a80-bfa3-429a-ad43-a590837a1ae6.4f491508-506b-439e-848c-b7b338f0da54
Jul 09 14:45:23 devstack sudo[101118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:45:23 devstack sudo[101112]: pam_unix(sudo:session): session closed for user root
Jul 09 14:45:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8b6c03a8-b5bc-497e-9bc8-a37ead99455f tempest-VolumeImageDependencyTests-392802147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8c043e31-5b46-4008-b5c1-2a7a0586327d" returned: 0 in 0.930s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:45:23 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8b6c03a8-b5bc-497e-9bc8-a37ead99455f tempest-VolumeImageDependencyTests-392802147 None] Lock "cinder-quobyte-8c043e31-5b46-4008-b5c1-2a7a0586327d" released by "delete_volume" :: held 2.899s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:45:23 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-719bb68b-fc87-4a8b-838a-7b1a6d624cd2 tempest-VolumesImageMetadata-64242335 None] Acquiring lock "cinder-a080b871-c1e0-43ba-afb6-b129198b0c47-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:45:23 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-719bb68b-fc87-4a8b-838a-7b1a6d624cd2 tempest-VolumesImageMetadata-64242335 None] Lock "cinder-a080b871-c1e0-43ba-afb6-b129198b0c47-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:45:23 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-8b6c03a8-b5bc-497e-9bc8-a37ead99455f tempest-VolumeImageDependencyTests-392802147 None] Created reservations ['be1195e2-2d74-47ae-9334-84b835a5e37c', '0e66401e-db88-4f1a-9936-7dbaf37f89a3', '3eae86d0-9353-461e-95df-d8359d9ac4be', 'b55d44b6-9b66-41c4-a915-6eb1da33839a'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:45:23 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-719bb68b-fc87-4a8b-838a-7b1a6d624cd2 tempest-VolumesImageMetadata-64242335 None] Acquiring lock "cinder-quobyte-a080b871-c1e0-43ba-afb6-b129198b0c47" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:45:23 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-719bb68b-fc87-4a8b-838a-7b1a6d624cd2 tempest-VolumesImageMetadata-64242335 None] Lock "cinder-quobyte-a080b871-c1e0-43ba-afb6-b129198b0c47" acquired by "delete_volume" :: waited 0.038s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:45:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8b6c03a8-b5bc-497e-9bc8-a37ead99455f tempest-VolumeImageDependencyTests-392802147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:45:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8b6c03a8-b5bc-497e-9bc8-a37ead99455f tempest-VolumeImageDependencyTests-392802147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:45:23 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-8b6c03a8-b5bc-497e-9bc8-a37ead99455f tempest-VolumeImageDependencyTests-392802147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:45:23 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-8b6c03a8-b5bc-497e-9bc8-a37ead99455f tempest-VolumeImageDependencyTests-392802147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:45:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8b6c03a8-b5bc-497e-9bc8-a37ead99455f tempest-VolumeImageDependencyTests-392802147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:45:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8b6c03a8-b5bc-497e-9bc8-a37ead99455f tempest-VolumeImageDependencyTests-392802147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:45:23 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[e911a531-f5e5-468c-bcd1-5074a0b058f2]: (4, 'raw') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:45:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-719bb68b-fc87-4a8b-838a-7b1a6d624cd2 tempest-VolumesImageMetadata-64242335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a080b871-c1e0-43ba-afb6-b129198b0c47 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:45:23 devstack sudo[101124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:45:23 devstack sudo[101124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:45:24 devstack sudo[101118]: pam_unix(sudo:session): session closed for user root
Jul 09 14:45:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-79c7d0df-f262-447d-b499-e3516a5f9e06 tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-82f34a80-bfa3-429a-ad43-a590837a1ae6.4f491508-506b-439e-848c-b7b338f0da54" returned: 0 in 0.823s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:45:24 devstack sudo[101125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a080b871-c1e0-43ba-afb6-b129198b0c47
Jul 09 14:45:24 devstack sudo[101125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:45:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-79c7d0df-f262-447d-b499-e3516a5f9e06 tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-82f34a80-bfa3-429a-ad43-a590837a1ae6.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:45:24 devstack sudo[101128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-82f34a80-bfa3-429a-ad43-a590837a1ae6.info
Jul 09 14:45:24 devstack sudo[101128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:45:24 devstack sudo[101124]: pam_unix(sudo:session): session closed for user root
Jul 09 14:45:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8b6c03a8-b5bc-497e-9bc8-a37ead99455f tempest-VolumeImageDependencyTests-392802147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.949s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:45:24 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-8b6c03a8-b5bc-497e-9bc8-a37ead99455f tempest-VolumeImageDependencyTests-392802147 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:45:24 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-8b6c03a8-b5bc-497e-9bc8-a37ead99455f tempest-VolumeImageDependencyTests-392802147 None] Deleted volume successfully.
Jul 09 14:45:24 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8b6c03a8-b5bc-497e-9bc8-a37ead99455f tempest-VolumeImageDependencyTests-392802147 None] Lock "cinder-8c043e31-5b46-4008-b5c1-2a7a0586327d-delete_volume" released by "delete_volume" :: held 4.179s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:45:24 devstack sudo[101128]: pam_unix(sudo:session): session closed for user root
Jul 09 14:45:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-79c7d0df-f262-447d-b499-e3516a5f9e06 tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-82f34a80-bfa3-429a-ad43-a590837a1ae6.info" returned: 0 in 0.831s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:45:24 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-79c7d0df-f262-447d-b499-e3516a5f9e06 tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-82f34a80-bfa3-429a-ad43-a590837a1ae6.info is being set with open permissions: ugo+rw
Jul 09 14:45:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-79c7d0df-f262-447d-b499-e3516a5f9e06 tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-82f34a80-bfa3-429a-ad43-a590837a1ae6.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:45:24 devstack sudo[101125]: pam_unix(sudo:session): session closed for user root
Jul 09 14:45:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-719bb68b-fc87-4a8b-838a-7b1a6d624cd2 tempest-VolumesImageMetadata-64242335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a080b871-c1e0-43ba-afb6-b129198b0c47" returned: 0 in 1.042s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:45:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-719bb68b-fc87-4a8b-838a-7b1a6d624cd2 tempest-VolumesImageMetadata-64242335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a080b871-c1e0-43ba-afb6-b129198b0c47 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:45:25 devstack sudo[101134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-82f34a80-bfa3-429a-ad43-a590837a1ae6.info
Jul 09 14:45:25 devstack sudo[101134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:45:25 devstack sudo[101135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a080b871-c1e0-43ba-afb6-b129198b0c47
Jul 09 14:45:25 devstack sudo[101135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:45:25 devstack sudo[101134]: pam_unix(sudo:session): session closed for user root
Jul 09 14:45:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-79c7d0df-f262-447d-b499-e3516a5f9e06 tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-82f34a80-bfa3-429a-ad43-a590837a1ae6.info" returned: 0 in 0.770s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:45:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-79c7d0df-f262-447d-b499-e3516a5f9e06 tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.310s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:45:25 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-79c7d0df-f262-447d-b499-e3516a5f9e06 tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] Create snapshot completed successfully
Jul 09 14:45:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-0c5e4677-c530-4cad-bdc2-de9cc2ca5324 req-4cc7180e-dcf3-49c5-a7d5-927ce6d123a1 tempest-TestShelveInstance-1427794981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:45:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-0c5e4677-c530-4cad-bdc2-de9cc2ca5324 req-4cc7180e-dcf3-49c5-a7d5-927ce6d123a1 tempest-TestShelveInstance-1427794981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:45:25 devstack sudo[101135]: pam_unix(sudo:session): session closed for user root
Jul 09 14:45:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-719bb68b-fc87-4a8b-838a-7b1a6d624cd2 tempest-VolumesImageMetadata-64242335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a080b871-c1e0-43ba-afb6-b129198b0c47" returned: 1 in 1.000s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:45:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-719bb68b-fc87-4a8b-838a-7b1a6d624cd2 tempest-VolumesImageMetadata-64242335 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a080b871-c1e0-43ba-afb6-b129198b0c47' failed. Not Retrying. {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 09 14:45:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-719bb68b-fc87-4a8b-838a-7b1a6d624cd2 tempest-VolumesImageMetadata-64242335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a080b871-c1e0-43ba-afb6-b129198b0c47 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:45:26 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[d083e496-6a44-42d9-8aab-22670691e0f8]: (4, 'raw') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:45:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-0c5e4677-c530-4cad-bdc2-de9cc2ca5324 req-4cc7180e-dcf3-49c5-a7d5-927ce6d123a1 tempest-TestShelveInstance-1427794981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-cda2942f-b3a7-4c7a-a361-bd744f42b5b2 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:45:26 devstack sudo[101151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a080b871-c1e0-43ba-afb6-b129198b0c47
Jul 09 14:45:26 devstack sudo[101151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:45:26 devstack sudo[101152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-cda2942f-b3a7-4c7a-a361-bd744f42b5b2
Jul 09 14:45:26 devstack sudo[101152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:45:26 devstack sudo[101151]: pam_unix(sudo:session): session closed for user root
Jul 09 14:45:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-719bb68b-fc87-4a8b-838a-7b1a6d624cd2 tempest-VolumesImageMetadata-64242335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a080b871-c1e0-43ba-afb6-b129198b0c47" returned: 0 in 0.743s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:45:26 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-719bb68b-fc87-4a8b-838a-7b1a6d624cd2 tempest-VolumesImageMetadata-64242335 None] Lock "cinder-quobyte-a080b871-c1e0-43ba-afb6-b129198b0c47" released by "delete_volume" :: held 2.895s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:45:26 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-719bb68b-fc87-4a8b-838a-7b1a6d624cd2 tempest-VolumesImageMetadata-64242335 None] Created reservations ['2434ffaa-2387-490b-a308-fedd1b22bdec', 'edfb6fce-a918-4c5b-8c3f-ca9d7eed7695', 'bf042575-72f3-447f-932a-dd5c9cedb874', '35e6a3f2-9dd9-428d-912d-d4902b690cf4'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:45:26 devstack sudo[101152]: pam_unix(sudo:session): session closed for user root
Jul 09 14:45:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-0c5e4677-c530-4cad-bdc2-de9cc2ca5324 req-4cc7180e-dcf3-49c5-a7d5-927ce6d123a1 tempest-TestShelveInstance-1427794981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-cda2942f-b3a7-4c7a-a361-bd744f42b5b2" returned: 0 in 0.829s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:45:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-0c5e4677-c530-4cad-bdc2-de9cc2ca5324 req-4cc7180e-dcf3-49c5-a7d5-927ce6d123a1 tempest-TestShelveInstance-1427794981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-cda2942f-b3a7-4c7a-a361-bd744f42b5b2 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:45:26 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-02302faf-d733-4db3-aee4-ade04ab6a33d tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] Acquiring lock "cinder-4f491508-506b-439e-848c-b7b338f0da54-delete_snapshot" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:45:26 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-02302faf-d733-4db3-aee4-ade04ab6a33d tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] Lock "cinder-4f491508-506b-439e-848c-b7b338f0da54-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:45:26 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-02302faf-d733-4db3-aee4-ade04ab6a33d tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] Acquiring lock "cinder-quobyte-82f34a80-bfa3-429a-ad43-a590837a1ae6" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:45:26 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-02302faf-d733-4db3-aee4-ade04ab6a33d tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] Lock "cinder-quobyte-82f34a80-bfa3-429a-ad43-a590837a1ae6" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:45:26 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-02302faf-d733-4db3-aee4-ade04ab6a33d tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] Acquiring lock "cinder-quobyte-4f491508-506b-439e-848c-b7b338f0da54" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:45:26 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-02302faf-d733-4db3-aee4-ade04ab6a33d tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] Lock "cinder-quobyte-4f491508-506b-439e-848c-b7b338f0da54" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:45:26 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-02302faf-d733-4db3-aee4-ade04ab6a33d tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] Deleting offline snapshot 4f491508-506b-439e-848c-b7b338f0da54 of volume 82f34a80-bfa3-429a-ad43-a590837a1ae6 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 14:45:27 devstack sudo[101158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-cda2942f-b3a7-4c7a-a361-bd744f42b5b2
Jul 09 14:45:27 devstack sudo[101158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:45:27 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-02302faf-d733-4db3-aee4-ade04ab6a33d tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] snapshot_file for this snap is: volume-82f34a80-bfa3-429a-ad43-a590837a1ae6.4f491508-506b-439e-848c-b7b338f0da54 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 14:45:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-719bb68b-fc87-4a8b-838a-7b1a6d624cd2 tempest-VolumesImageMetadata-64242335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:45:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-719bb68b-fc87-4a8b-838a-7b1a6d624cd2 tempest-VolumesImageMetadata-64242335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:45:27 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-719bb68b-fc87-4a8b-838a-7b1a6d624cd2 tempest-VolumesImageMetadata-64242335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:45:27 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-719bb68b-fc87-4a8b-838a-7b1a6d624cd2 tempest-VolumesImageMetadata-64242335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:45:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-719bb68b-fc87-4a8b-838a-7b1a6d624cd2 tempest-VolumesImageMetadata-64242335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:45:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-719bb68b-fc87-4a8b-838a-7b1a6d624cd2 tempest-VolumesImageMetadata-64242335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:45:27 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[259a9190-775d-4694-9e7d-9d9feaeb7bbe]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:45:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-02302faf-d733-4db3-aee4-ade04ab6a33d tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-82f34a80-bfa3-429a-ad43-a590837a1ae6.4f491508-506b-439e-848c-b7b338f0da54 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:45:27 devstack sudo[101160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:45:27 devstack sudo[101160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:45:27 devstack sudo[101161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-82f34a80-bfa3-429a-ad43-a590837a1ae6.4f491508-506b-439e-848c-b7b338f0da54
Jul 09 14:45:27 devstack sudo[101161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:45:28 devstack sudo[101160]: pam_unix(sudo:session): session closed for user root
Jul 09 14:45:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-719bb68b-fc87-4a8b-838a-7b1a6d624cd2 tempest-VolumesImageMetadata-64242335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.977s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:45:28 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-719bb68b-fc87-4a8b-838a-7b1a6d624cd2 tempest-VolumesImageMetadata-64242335 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:45:28 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-719bb68b-fc87-4a8b-838a-7b1a6d624cd2 tempest-VolumesImageMetadata-64242335 None] Deleted volume successfully.
Jul 09 14:45:28 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-719bb68b-fc87-4a8b-838a-7b1a6d624cd2 tempest-VolumesImageMetadata-64242335 None] Lock "cinder-a080b871-c1e0-43ba-afb6-b129198b0c47-delete_volume" released by "delete_volume" :: held 4.291s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:45:28 devstack sudo[101158]: pam_unix(sudo:session): session closed for user root
Jul 09 14:45:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-0c5e4677-c530-4cad-bdc2-de9cc2ca5324 req-4cc7180e-dcf3-49c5-a7d5-927ce6d123a1 tempest-TestShelveInstance-1427794981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-cda2942f-b3a7-4c7a-a361-bd744f42b5b2" returned: 1 in 1.231s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:45:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-0c5e4677-c530-4cad-bdc2-de9cc2ca5324 req-4cc7180e-dcf3-49c5-a7d5-927ce6d123a1 tempest-TestShelveInstance-1427794981 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-cda2942f-b3a7-4c7a-a361-bd744f42b5b2' failed. Not Retrying. {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 09 14:45:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-0c5e4677-c530-4cad-bdc2-de9cc2ca5324 req-4cc7180e-dcf3-49c5-a7d5-927ce6d123a1 tempest-TestShelveInstance-1427794981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.130s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:45:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-0c5e4677-c530-4cad-bdc2-de9cc2ca5324 req-4cc7180e-dcf3-49c5-a7d5-927ce6d123a1 tempest-TestShelveInstance-1427794981 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653', 'name': 'volume-cda2942f-b3a7-4c7a-a361-bd744f42b5b2', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '568a12e1-53de-44a1-9f5e-1c2c330bfa31', 'enforce_multipath': True} {{(pid=87230) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 09 14:45:28 devstack sudo[101161]: pam_unix(sudo:session): session closed for user root
Jul 09 14:45:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-02302faf-d733-4db3-aee4-ade04ab6a33d tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-82f34a80-bfa3-429a-ad43-a590837a1ae6.4f491508-506b-439e-848c-b7b338f0da54" returned: 0 in 1.136s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:45:28 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-02302faf-d733-4db3-aee4-ade04ab6a33d tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82f34a80-bfa3-429a-ad43-a590837a1ae6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 14:45:28 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[00466e5f-bf7e-40f8-add2-ac07eaf4c26c]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:45:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-02302faf-d733-4db3-aee4-ade04ab6a33d tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-82f34a80-bfa3-429a-ad43-a590837a1ae6 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:45:28 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-0c5e4677-c530-4cad-bdc2-de9cc2ca5324 req-4cc7180e-dcf3-49c5-a7d5-927ce6d123a1 tempest-TestShelveInstance-1427794981 None] attachment_update completed successfully.
Jul 09 14:45:28 devstack sudo[101171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-82f34a80-bfa3-429a-ad43-a590837a1ae6
Jul 09 14:45:28 devstack sudo[101171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:45:29 devstack sudo[101171]: pam_unix(sudo:session): session closed for user root
Jul 09 14:45:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-02302faf-d733-4db3-aee4-ade04ab6a33d tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-82f34a80-bfa3-429a-ad43-a590837a1ae6" returned: 0 in 0.970s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:45:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-02302faf-d733-4db3-aee4-ade04ab6a33d tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-82f34a80-bfa3-429a-ad43-a590837a1ae6.4f491508-506b-439e-848c-b7b338f0da54 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:45:29 devstack sudo[101177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-82f34a80-bfa3-429a-ad43-a590837a1ae6.4f491508-506b-439e-848c-b7b338f0da54
Jul 09 14:45:29 devstack sudo[101177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:45:29 devstack sudo[101177]: pam_unix(sudo:session): session closed for user root
Jul 09 14:45:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-02302faf-d733-4db3-aee4-ade04ab6a33d tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-82f34a80-bfa3-429a-ad43-a590837a1ae6.4f491508-506b-439e-848c-b7b338f0da54" returned: 0 in 0.807s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:45:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-02302faf-d733-4db3-aee4-ade04ab6a33d tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-82f34a80-bfa3-429a-ad43-a590837a1ae6.4f491508-506b-439e-848c-b7b338f0da54 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:45:30 devstack sudo[101182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-82f34a80-bfa3-429a-ad43-a590837a1ae6.4f491508-506b-439e-848c-b7b338f0da54
Jul 09 14:45:30 devstack sudo[101182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:45:30 devstack sudo[101182]: pam_unix(sudo:session): session closed for user root
Jul 09 14:45:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-02302faf-d733-4db3-aee4-ade04ab6a33d tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-82f34a80-bfa3-429a-ad43-a590837a1ae6.4f491508-506b-439e-848c-b7b338f0da54" returned: 0 in 0.750s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:45:30 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-02302faf-d733-4db3-aee4-ade04ab6a33d tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] Lock "cinder-quobyte-4f491508-506b-439e-848c-b7b338f0da54" released by "_delete_snapshot" :: held 3.865s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:45:30 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-02302faf-d733-4db3-aee4-ade04ab6a33d tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] Lock "cinder-quobyte-82f34a80-bfa3-429a-ad43-a590837a1ae6" released by "delete_snapshot" :: held 3.901s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:45:30 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-f38de068-28d1-4b8c-a605-a5941fc0cf4b tempest-SnapshotMetadataTestJSON-1106777620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:45:30 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f38de068-28d1-4b8c-a605-a5941fc0cf4b tempest-SnapshotMetadataTestJSON-1106777620 None] Flow 'volume_create_manager' (a5bcfbdf-8bd5-4ee5-914d-ef9d31ba140e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:45:30 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f38de068-28d1-4b8c-a605-a5941fc0cf4b tempest-SnapshotMetadataTestJSON-1106777620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d353424-4fd3-4f22-b8b3-c64ded154443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:45:30 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f38de068-28d1-4b8c-a605-a5941fc0cf4b tempest-SnapshotMetadataTestJSON-1106777620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d353424-4fd3-4f22-b8b3-c64ded154443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:45:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1996643280',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7e15f23-1604-4ac4-9437-dbe4c0c01109,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b80615a846744c44bfca8ed8cfc2f9ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:45:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:45:31Z,use_quota=True,user_id='0ee69aedec12442cbda86eeb30b7ec79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:45:30 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f38de068-28d1-4b8c-a605-a5941fc0cf4b tempest-SnapshotMetadataTestJSON-1106777620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ed45d71-9f88-4fca-8da6-1c4c57664d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:45:30 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f38de068-28d1-4b8c-a605-a5941fc0cf4b tempest-SnapshotMetadataTestJSON-1106777620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ed45d71-9f88-4fca-8da6-1c4c57664d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:45:30 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f38de068-28d1-4b8c-a605-a5941fc0cf4b tempest-SnapshotMetadataTestJSON-1106777620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42e5c184-a193-4a93-81f6-6d42dc655753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:45:30 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f38de068-28d1-4b8c-a605-a5941fc0cf4b tempest-SnapshotMetadataTestJSON-1106777620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42e5c184-a193-4a93-81f6-6d42dc655753) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7e15f23-1604-4ac4-9437-dbe4c0c01109', 'volume_name': 'volume-a7e15f23-1604-4ac4-9437-dbe4c0c01109', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:45:30 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f38de068-28d1-4b8c-a605-a5941fc0cf4b tempest-SnapshotMetadataTestJSON-1106777620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf75ecb1-68b7-451e-9695-4b59aaf2d613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:45:30 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f38de068-28d1-4b8c-a605-a5941fc0cf4b tempest-SnapshotMetadataTestJSON-1106777620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf75ecb1-68b7-451e-9695-4b59aaf2d613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:45:30 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f38de068-28d1-4b8c-a605-a5941fc0cf4b tempest-SnapshotMetadataTestJSON-1106777620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b574aaf5-827e-4c15-a826-888e047aa683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:45:30 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-f38de068-28d1-4b8c-a605-a5941fc0cf4b tempest-SnapshotMetadataTestJSON-1106777620 None] Volume a7e15f23-1604-4ac4-9437-dbe4c0c01109: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7e15f23-1604-4ac4-9437-dbe4c0c01109', 'volume_size': 1}
Jul 09 14:45:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f38de068-28d1-4b8c-a605-a5941fc0cf4b tempest-SnapshotMetadataTestJSON-1106777620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:45:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f38de068-28d1-4b8c-a605-a5941fc0cf4b tempest-SnapshotMetadataTestJSON-1106777620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:45:30 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f38de068-28d1-4b8c-a605-a5941fc0cf4b tempest-SnapshotMetadataTestJSON-1106777620 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:45:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1996643280',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7e15f23-1604-4ac4-9437-dbe4c0c01109,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b80615a846744c44bfca8ed8cfc2f9ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:45:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:45:31Z,use_quota=True,user_id='0ee69aedec12442cbda86eeb30b7ec79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:45:30 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-f38de068-28d1-4b8c-a605-a5941fc0cf4b tempest-SnapshotMetadataTestJSON-1106777620 None] Creating volume a7e15f23-1604-4ac4-9437-dbe4c0c01109 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:45:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f38de068-28d1-4b8c-a605-a5941fc0cf4b tempest-SnapshotMetadataTestJSON-1106777620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:45:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f38de068-28d1-4b8c-a605-a5941fc0cf4b tempest-SnapshotMetadataTestJSON-1106777620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:45:30 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f38de068-28d1-4b8c-a605-a5941fc0cf4b tempest-SnapshotMetadataTestJSON-1106777620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:45:30 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f38de068-28d1-4b8c-a605-a5941fc0cf4b tempest-SnapshotMetadataTestJSON-1106777620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:45:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f38de068-28d1-4b8c-a605-a5941fc0cf4b tempest-SnapshotMetadataTestJSON-1106777620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:45:30 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f38de068-28d1-4b8c-a605-a5941fc0cf4b tempest-SnapshotMetadataTestJSON-1106777620 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:45:30 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-f38de068-28d1-4b8c-a605-a5941fc0cf4b tempest-SnapshotMetadataTestJSON-1106777620 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:45:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f38de068-28d1-4b8c-a605-a5941fc0cf4b tempest-SnapshotMetadataTestJSON-1106777620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a7e15f23-1604-4ac4-9437-dbe4c0c01109 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:45:30 devstack sudo[101186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a7e15f23-1604-4ac4-9437-dbe4c0c01109 1073741824
Jul 09 14:45:31 devstack sudo[101186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:45:31 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-02302faf-d733-4db3-aee4-ade04ab6a33d tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] Created reservations ['6024ad4e-9e1e-4de1-9995-84f2412318bf', '7221c986-26e8-4507-b0c4-d2b5b27d10b3', 'b01a0b3c-563b-4a6e-bce6-75cb34d5d0e6', '136938b5-d474-487a-b310-fd05dbad975c'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:45:31 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-02302faf-d733-4db3-aee4-ade04ab6a33d tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] Delete snapshot completed successfully.
Jul 09 14:45:31 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-02302faf-d733-4db3-aee4-ade04ab6a33d tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] Lock "cinder-4f491508-506b-439e-848c-b7b338f0da54-delete_snapshot" released by "delete_snapshot" :: held 4.165s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:45:31 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-34975d46-3481-4b67-afa9-7669d596bb01 tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] Acquiring lock "cinder-82f34a80-bfa3-429a-ad43-a590837a1ae6-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:45:31 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-34975d46-3481-4b67-afa9-7669d596bb01 tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] Lock "cinder-82f34a80-bfa3-429a-ad43-a590837a1ae6-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:45:31 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-34975d46-3481-4b67-afa9-7669d596bb01 tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] Acquiring lock "cinder-quobyte-82f34a80-bfa3-429a-ad43-a590837a1ae6" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:45:31 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-34975d46-3481-4b67-afa9-7669d596bb01 tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] Lock "cinder-quobyte-82f34a80-bfa3-429a-ad43-a590837a1ae6" acquired by "delete_volume" :: waited 0.020s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:45:31 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[d54da4a0-3bb6-4880-8e32-eaa7651d9e7f]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:45:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-34975d46-3481-4b67-afa9-7669d596bb01 tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-82f34a80-bfa3-429a-ad43-a590837a1ae6 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:45:31 devstack sudo[101188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-82f34a80-bfa3-429a-ad43-a590837a1ae6
Jul 09 14:45:31 devstack sudo[101188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:45:32 devstack sudo[101186]: pam_unix(sudo:session): session closed for user root
Jul 09 14:45:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f38de068-28d1-4b8c-a605-a5941fc0cf4b tempest-SnapshotMetadataTestJSON-1106777620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a7e15f23-1604-4ac4-9437-dbe4c0c01109 1073741824" returned: 0 in 1.090s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:45:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f38de068-28d1-4b8c-a605-a5941fc0cf4b tempest-SnapshotMetadataTestJSON-1106777620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a7e15f23-1604-4ac4-9437-dbe4c0c01109 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:45:32 devstack sudo[101194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a7e15f23-1604-4ac4-9437-dbe4c0c01109
Jul 09 14:45:32 devstack sudo[101194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:45:32 devstack sudo[101188]: pam_unix(sudo:session): session closed for user root
Jul 09 14:45:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-34975d46-3481-4b67-afa9-7669d596bb01 tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-82f34a80-bfa3-429a-ad43-a590837a1ae6" returned: 0 in 0.908s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:45:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-34975d46-3481-4b67-afa9-7669d596bb01 tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-82f34a80-bfa3-429a-ad43-a590837a1ae6 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:45:32 devstack sudo[101199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-82f34a80-bfa3-429a-ad43-a590837a1ae6
Jul 09 14:45:32 devstack sudo[101199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:45:32 devstack sudo[101194]: pam_unix(sudo:session): session closed for user root
Jul 09 14:45:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f38de068-28d1-4b8c-a605-a5941fc0cf4b tempest-SnapshotMetadataTestJSON-1106777620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a7e15f23-1604-4ac4-9437-dbe4c0c01109" returned: 0 in 0.712s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:45:32 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f38de068-28d1-4b8c-a605-a5941fc0cf4b tempest-SnapshotMetadataTestJSON-1106777620 None] <== create_volume: return (1852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:45:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f38de068-28d1-4b8c-a605-a5941fc0cf4b tempest-SnapshotMetadataTestJSON-1106777620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.857s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:45:32 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f38de068-28d1-4b8c-a605-a5941fc0cf4b tempest-SnapshotMetadataTestJSON-1106777620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b574aaf5-827e-4c15-a826-888e047aa683) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7e15f23-1604-4ac4-9437-dbe4c0c01109', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:45:32 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f38de068-28d1-4b8c-a605-a5941fc0cf4b tempest-SnapshotMetadataTestJSON-1106777620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e21c8a7a-04b3-48da-aa37-e258442f5807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:45:32 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-f38de068-28d1-4b8c-a605-a5941fc0cf4b tempest-SnapshotMetadataTestJSON-1106777620 None] Volume volume-a7e15f23-1604-4ac4-9437-dbe4c0c01109 (a7e15f23-1604-4ac4-9437-dbe4c0c01109): created successfully
Jul 09 14:45:32 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f38de068-28d1-4b8c-a605-a5941fc0cf4b tempest-SnapshotMetadataTestJSON-1106777620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e21c8a7a-04b3-48da-aa37-e258442f5807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:45:32 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f38de068-28d1-4b8c-a605-a5941fc0cf4b tempest-SnapshotMetadataTestJSON-1106777620 None] Flow 'volume_create_manager' (a5bcfbdf-8bd5-4ee5-914d-ef9d31ba140e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:45:32 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-f38de068-28d1-4b8c-a605-a5941fc0cf4b tempest-SnapshotMetadataTestJSON-1106777620 None] Created volume successfully.
Jul 09 14:45:33 devstack sudo[101199]: pam_unix(sudo:session): session closed for user root
Jul 09 14:45:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-34975d46-3481-4b67-afa9-7669d596bb01 tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-82f34a80-bfa3-429a-ad43-a590837a1ae6" returned: 0 in 0.656s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:45:33 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-34975d46-3481-4b67-afa9-7669d596bb01 tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] Lock "cinder-quobyte-82f34a80-bfa3-429a-ad43-a590837a1ae6" released by "delete_volume" :: held 1.646s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:45:33 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-34975d46-3481-4b67-afa9-7669d596bb01 tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] Created reservations ['0a0c89cc-c3cd-438d-b38c-613f266fcf32', '96a1c3a1-c20e-4738-a41e-c4e06b46c52e', '4246bd7e-3d1d-46f5-8356-c94f477a7a4e', 'f39a0318-df74-4def-ab20-0b9aab33d75d'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:45:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-34975d46-3481-4b67-afa9-7669d596bb01 tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:45:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-34975d46-3481-4b67-afa9-7669d596bb01 tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:45:33 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-34975d46-3481-4b67-afa9-7669d596bb01 tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:45:33 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-34975d46-3481-4b67-afa9-7669d596bb01 tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:45:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-34975d46-3481-4b67-afa9-7669d596bb01 tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:45:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-34975d46-3481-4b67-afa9-7669d596bb01 tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:45:33 devstack sudo[101203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:45:33 devstack sudo[101203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:45:33 devstack sudo[101203]: pam_unix(sudo:session): session closed for user root
Jul 09 14:45:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-34975d46-3481-4b67-afa9-7669d596bb01 tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.684s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:45:33 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-34975d46-3481-4b67-afa9-7669d596bb01 tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:45:33 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-34975d46-3481-4b67-afa9-7669d596bb01 tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] Deleted volume successfully.
Jul 09 14:45:33 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-34975d46-3481-4b67-afa9-7669d596bb01 tempest-VolumesSnapshotNegativeTestJSON-2034292596 None] Lock "cinder-82f34a80-bfa3-429a-ad43-a590837a1ae6-delete_volume" released by "delete_volume" :: held 2.571s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:45:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d8c30cfa-d8bf-4048-8b73-2866594fdcd2 tempest-SnapshotMetadataTestJSON-1106777620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:45:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d8c30cfa-d8bf-4048-8b73-2866594fdcd2 tempest-SnapshotMetadataTestJSON-1106777620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:45:34 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-d8c30cfa-d8bf-4048-8b73-2866594fdcd2 tempest-SnapshotMetadataTestJSON-1106777620 None] Creating offline snapshot ed1866fa-04d7-4636-a95c-9f75ff93b096 of volume a7e15f23-1604-4ac4-9437-dbe4c0c01109 {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 14:45:34 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[b93a6206-c1c1-41c8-acdd-f8b1022d101b]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:45:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d8c30cfa-d8bf-4048-8b73-2866594fdcd2 tempest-SnapshotMetadataTestJSON-1106777620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a7e15f23-1604-4ac4-9437-dbe4c0c01109 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:45:34 devstack sudo[101207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a7e15f23-1604-4ac4-9437-dbe4c0c01109
Jul 09 14:45:34 devstack sudo[101207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:45:35 devstack sudo[101207]: pam_unix(sudo:session): session closed for user root
Jul 09 14:45:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d8c30cfa-d8bf-4048-8b73-2866594fdcd2 tempest-SnapshotMetadataTestJSON-1106777620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a7e15f23-1604-4ac4-9437-dbe4c0c01109" returned: 0 in 0.818s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:45:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d8c30cfa-d8bf-4048-8b73-2866594fdcd2 tempest-SnapshotMetadataTestJSON-1106777620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a7e15f23-1604-4ac4-9437-dbe4c0c01109,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a7e15f23-1604-4ac4-9437-dbe4c0c01109.ed1866fa-04d7-4636-a95c-9f75ff93b096 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:45:35 devstack sudo[101212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a7e15f23-1604-4ac4-9437-dbe4c0c01109,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a7e15f23-1604-4ac4-9437-dbe4c0c01109.ed1866fa-04d7-4636-a95c-9f75ff93b096 1G
Jul 09 14:45:35 devstack sudo[101212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:45:35 devstack sudo[101212]: pam_unix(sudo:session): session closed for user root
Jul 09 14:45:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d8c30cfa-d8bf-4048-8b73-2866594fdcd2 tempest-SnapshotMetadataTestJSON-1106777620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a7e15f23-1604-4ac4-9437-dbe4c0c01109,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a7e15f23-1604-4ac4-9437-dbe4c0c01109.ed1866fa-04d7-4636-a95c-9f75ff93b096 1G" returned: 0 in 0.885s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:45:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d8c30cfa-d8bf-4048-8b73-2866594fdcd2 tempest-SnapshotMetadataTestJSON-1106777620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7e15f23-1604-4ac4-9437-dbe4c0c01109 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a7e15f23-1604-4ac4-9437-dbe4c0c01109.ed1866fa-04d7-4636-a95c-9f75ff93b096 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:45:36 devstack sudo[101219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7e15f23-1604-4ac4-9437-dbe4c0c01109 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a7e15f23-1604-4ac4-9437-dbe4c0c01109.ed1866fa-04d7-4636-a95c-9f75ff93b096
Jul 09 14:45:36 devstack sudo[101219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:45:36 devstack sudo[101219]: pam_unix(sudo:session): session closed for user root
Jul 09 14:45:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d8c30cfa-d8bf-4048-8b73-2866594fdcd2 tempest-SnapshotMetadataTestJSON-1106777620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7e15f23-1604-4ac4-9437-dbe4c0c01109 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a7e15f23-1604-4ac4-9437-dbe4c0c01109.ed1866fa-04d7-4636-a95c-9f75ff93b096" returned: 0 in 0.841s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:45:36 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-d8c30cfa-d8bf-4048-8b73-2866594fdcd2 tempest-SnapshotMetadataTestJSON-1106777620 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a7e15f23-1604-4ac4-9437-dbe4c0c01109.ed1866fa-04d7-4636-a95c-9f75ff93b096 is being set with open permissions: ugo+rw
Jul 09 14:45:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d8c30cfa-d8bf-4048-8b73-2866594fdcd2 tempest-SnapshotMetadataTestJSON-1106777620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a7e15f23-1604-4ac4-9437-dbe4c0c01109.ed1866fa-04d7-4636-a95c-9f75ff93b096 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:45:36 devstack sudo[101290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a7e15f23-1604-4ac4-9437-dbe4c0c01109.ed1866fa-04d7-4636-a95c-9f75ff93b096
Jul 09 14:45:36 devstack sudo[101290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:45:37 devstack sudo[101290]: pam_unix(sudo:session): session closed for user root
Jul 09 14:45:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d8c30cfa-d8bf-4048-8b73-2866594fdcd2 tempest-SnapshotMetadataTestJSON-1106777620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a7e15f23-1604-4ac4-9437-dbe4c0c01109.ed1866fa-04d7-4636-a95c-9f75ff93b096" returned: 0 in 0.835s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:45:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d8c30cfa-d8bf-4048-8b73-2866594fdcd2 tempest-SnapshotMetadataTestJSON-1106777620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a7e15f23-1604-4ac4-9437-dbe4c0c01109.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:45:37 devstack sudo[101323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a7e15f23-1604-4ac4-9437-dbe4c0c01109.info
Jul 09 14:45:37 devstack sudo[101323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:45:38 devstack sudo[101323]: pam_unix(sudo:session): session closed for user root
Jul 09 14:45:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d8c30cfa-d8bf-4048-8b73-2866594fdcd2 tempest-SnapshotMetadataTestJSON-1106777620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a7e15f23-1604-4ac4-9437-dbe4c0c01109.info" returned: 0 in 0.867s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:45:38 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-d8c30cfa-d8bf-4048-8b73-2866594fdcd2 tempest-SnapshotMetadataTestJSON-1106777620 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a7e15f23-1604-4ac4-9437-dbe4c0c01109.info is being set with open permissions: ugo+rw
Jul 09 14:45:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d8c30cfa-d8bf-4048-8b73-2866594fdcd2 tempest-SnapshotMetadataTestJSON-1106777620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a7e15f23-1604-4ac4-9437-dbe4c0c01109.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:45:38 devstack sudo[101341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a7e15f23-1604-4ac4-9437-dbe4c0c01109.info
Jul 09 14:45:38 devstack sudo[101341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:45:39 devstack sudo[101341]: pam_unix(sudo:session): session closed for user root
Jul 09 14:45:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d8c30cfa-d8bf-4048-8b73-2866594fdcd2 tempest-SnapshotMetadataTestJSON-1106777620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a7e15f23-1604-4ac4-9437-dbe4c0c01109.info" returned: 0 in 0.769s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:45:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d8c30cfa-d8bf-4048-8b73-2866594fdcd2 tempest-SnapshotMetadataTestJSON-1106777620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.132s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:45:39 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-d8c30cfa-d8bf-4048-8b73-2866594fdcd2 tempest-SnapshotMetadataTestJSON-1106777620 None] Create snapshot completed successfully
Jul 09 14:45:40 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-561a04f3-9620-4d23-8e01-0f8cb2354a02 tempest-SnapshotMetadataTestJSON-1106777620 None] Acquiring lock "cinder-ed1866fa-04d7-4636-a95c-9f75ff93b096-delete_snapshot" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:45:40 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-561a04f3-9620-4d23-8e01-0f8cb2354a02 tempest-SnapshotMetadataTestJSON-1106777620 None] Lock "cinder-ed1866fa-04d7-4636-a95c-9f75ff93b096-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:45:40 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-561a04f3-9620-4d23-8e01-0f8cb2354a02 tempest-SnapshotMetadataTestJSON-1106777620 None] Acquiring lock "cinder-quobyte-a7e15f23-1604-4ac4-9437-dbe4c0c01109" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:45:40 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-561a04f3-9620-4d23-8e01-0f8cb2354a02 tempest-SnapshotMetadataTestJSON-1106777620 None] Lock "cinder-quobyte-a7e15f23-1604-4ac4-9437-dbe4c0c01109" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:45:40 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-561a04f3-9620-4d23-8e01-0f8cb2354a02 tempest-SnapshotMetadataTestJSON-1106777620 None] Acquiring lock "cinder-quobyte-ed1866fa-04d7-4636-a95c-9f75ff93b096" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:45:40 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-561a04f3-9620-4d23-8e01-0f8cb2354a02 tempest-SnapshotMetadataTestJSON-1106777620 None] Lock "cinder-quobyte-ed1866fa-04d7-4636-a95c-9f75ff93b096" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:45:40 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-561a04f3-9620-4d23-8e01-0f8cb2354a02 tempest-SnapshotMetadataTestJSON-1106777620 None] Deleting offline snapshot ed1866fa-04d7-4636-a95c-9f75ff93b096 of volume a7e15f23-1604-4ac4-9437-dbe4c0c01109 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 14:45:40 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-561a04f3-9620-4d23-8e01-0f8cb2354a02 tempest-SnapshotMetadataTestJSON-1106777620 None] snapshot_file for this snap is: volume-a7e15f23-1604-4ac4-9437-dbe4c0c01109.ed1866fa-04d7-4636-a95c-9f75ff93b096 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 14:45:40 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[7050c092-3321-418c-a5b9-5ee3968a1f95]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:45:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-561a04f3-9620-4d23-8e01-0f8cb2354a02 tempest-SnapshotMetadataTestJSON-1106777620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a7e15f23-1604-4ac4-9437-dbe4c0c01109.ed1866fa-04d7-4636-a95c-9f75ff93b096 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:45:40 devstack sudo[101677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a7e15f23-1604-4ac4-9437-dbe4c0c01109.ed1866fa-04d7-4636-a95c-9f75ff93b096
Jul 09 14:45:40 devstack sudo[101677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:45:41 devstack sudo[101677]: pam_unix(sudo:session): session closed for user root
Jul 09 14:45:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-561a04f3-9620-4d23-8e01-0f8cb2354a02 tempest-SnapshotMetadataTestJSON-1106777620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a7e15f23-1604-4ac4-9437-dbe4c0c01109.ed1866fa-04d7-4636-a95c-9f75ff93b096" returned: 0 in 1.036s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:45:41 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-561a04f3-9620-4d23-8e01-0f8cb2354a02 tempest-SnapshotMetadataTestJSON-1106777620 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7e15f23-1604-4ac4-9437-dbe4c0c01109(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 14:45:41 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d313d79-4670-4500-822e-fcc11a01d5c6]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:45:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-561a04f3-9620-4d23-8e01-0f8cb2354a02 tempest-SnapshotMetadataTestJSON-1106777620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a7e15f23-1604-4ac4-9437-dbe4c0c01109 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:45:41 devstack sudo[101684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a7e15f23-1604-4ac4-9437-dbe4c0c01109
Jul 09 14:45:41 devstack sudo[101684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:45:42 devstack sudo[101684]: pam_unix(sudo:session): session closed for user root
Jul 09 14:45:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-561a04f3-9620-4d23-8e01-0f8cb2354a02 tempest-SnapshotMetadataTestJSON-1106777620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a7e15f23-1604-4ac4-9437-dbe4c0c01109" returned: 0 in 0.843s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:45:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-561a04f3-9620-4d23-8e01-0f8cb2354a02 tempest-SnapshotMetadataTestJSON-1106777620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a7e15f23-1604-4ac4-9437-dbe4c0c01109.ed1866fa-04d7-4636-a95c-9f75ff93b096 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:45:42 devstack sudo[101689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a7e15f23-1604-4ac4-9437-dbe4c0c01109.ed1866fa-04d7-4636-a95c-9f75ff93b096
Jul 09 14:45:42 devstack sudo[101689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:45:43 devstack sudo[101689]: pam_unix(sudo:session): session closed for user root
Jul 09 14:45:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-561a04f3-9620-4d23-8e01-0f8cb2354a02 tempest-SnapshotMetadataTestJSON-1106777620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a7e15f23-1604-4ac4-9437-dbe4c0c01109.ed1866fa-04d7-4636-a95c-9f75ff93b096" returned: 0 in 1.008s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:45:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-561a04f3-9620-4d23-8e01-0f8cb2354a02 tempest-SnapshotMetadataTestJSON-1106777620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a7e15f23-1604-4ac4-9437-dbe4c0c01109.ed1866fa-04d7-4636-a95c-9f75ff93b096 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:45:43 devstack sudo[101695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a7e15f23-1604-4ac4-9437-dbe4c0c01109.ed1866fa-04d7-4636-a95c-9f75ff93b096
Jul 09 14:45:43 devstack sudo[101695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:45:44 devstack sudo[101695]: pam_unix(sudo:session): session closed for user root
Jul 09 14:45:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-561a04f3-9620-4d23-8e01-0f8cb2354a02 tempest-SnapshotMetadataTestJSON-1106777620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a7e15f23-1604-4ac4-9437-dbe4c0c01109.ed1866fa-04d7-4636-a95c-9f75ff93b096" returned: 0 in 1.144s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:45:44 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-561a04f3-9620-4d23-8e01-0f8cb2354a02 tempest-SnapshotMetadataTestJSON-1106777620 None] Lock "cinder-quobyte-ed1866fa-04d7-4636-a95c-9f75ff93b096" released by "_delete_snapshot" :: held 4.211s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:45:44 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-561a04f3-9620-4d23-8e01-0f8cb2354a02 tempest-SnapshotMetadataTestJSON-1106777620 None] Lock "cinder-quobyte-a7e15f23-1604-4ac4-9437-dbe4c0c01109" released by "delete_snapshot" :: held 4.247s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:45:44 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-561a04f3-9620-4d23-8e01-0f8cb2354a02 tempest-SnapshotMetadataTestJSON-1106777620 None] Created reservations ['8b6fa6f2-a73d-41bd-96e5-67beaf11c7e0', '549800c9-06f9-4a0d-b300-35343cc84f09', '018b56f6-38ad-4636-b8c1-ee236adfddd2', '11178e41-e3b6-4e90-80d0-59618cbf2d8e'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:45:44 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-561a04f3-9620-4d23-8e01-0f8cb2354a02 tempest-SnapshotMetadataTestJSON-1106777620 None] Delete snapshot completed successfully.
Jul 09 14:45:44 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-561a04f3-9620-4d23-8e01-0f8cb2354a02 tempest-SnapshotMetadataTestJSON-1106777620 None] Lock "cinder-ed1866fa-04d7-4636-a95c-9f75ff93b096-delete_snapshot" released by "delete_snapshot" :: held 4.445s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:45:45 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-9c9d1502-a0ec-4069-ac2e-8aa61259640a tempest-SnapshotMetadataTestJSON-1106777620 None] Acquiring lock "cinder-a7e15f23-1604-4ac4-9437-dbe4c0c01109-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:45:45 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-9c9d1502-a0ec-4069-ac2e-8aa61259640a tempest-SnapshotMetadataTestJSON-1106777620 None] Lock "cinder-a7e15f23-1604-4ac4-9437-dbe4c0c01109-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:45:45 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-9c9d1502-a0ec-4069-ac2e-8aa61259640a tempest-SnapshotMetadataTestJSON-1106777620 None] Acquiring lock "cinder-quobyte-a7e15f23-1604-4ac4-9437-dbe4c0c01109" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:45:45 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-9c9d1502-a0ec-4069-ac2e-8aa61259640a tempest-SnapshotMetadataTestJSON-1106777620 None] Lock "cinder-quobyte-a7e15f23-1604-4ac4-9437-dbe4c0c01109" acquired by "delete_volume" :: waited 0.025s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:45:46 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[9836b38a-7e84-4362-9aad-40fe6089b1de]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:45:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9c9d1502-a0ec-4069-ac2e-8aa61259640a tempest-SnapshotMetadataTestJSON-1106777620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a7e15f23-1604-4ac4-9437-dbe4c0c01109 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:45:46 devstack sudo[101734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a7e15f23-1604-4ac4-9437-dbe4c0c01109
Jul 09 14:45:46 devstack sudo[101734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:45:46 devstack sudo[101734]: pam_unix(sudo:session): session closed for user root
Jul 09 14:45:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9c9d1502-a0ec-4069-ac2e-8aa61259640a tempest-SnapshotMetadataTestJSON-1106777620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a7e15f23-1604-4ac4-9437-dbe4c0c01109" returned: 0 in 0.798s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:45:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9c9d1502-a0ec-4069-ac2e-8aa61259640a tempest-SnapshotMetadataTestJSON-1106777620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a7e15f23-1604-4ac4-9437-dbe4c0c01109 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:45:46 devstack sudo[101739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a7e15f23-1604-4ac4-9437-dbe4c0c01109
Jul 09 14:45:46 devstack sudo[101739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:45:47 devstack sudo[101739]: pam_unix(sudo:session): session closed for user root
Jul 09 14:45:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9c9d1502-a0ec-4069-ac2e-8aa61259640a tempest-SnapshotMetadataTestJSON-1106777620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a7e15f23-1604-4ac4-9437-dbe4c0c01109" returned: 0 in 0.843s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:45:47 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-9c9d1502-a0ec-4069-ac2e-8aa61259640a tempest-SnapshotMetadataTestJSON-1106777620 None] Lock "cinder-quobyte-a7e15f23-1604-4ac4-9437-dbe4c0c01109" released by "delete_volume" :: held 1.733s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:45:47 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-9c9d1502-a0ec-4069-ac2e-8aa61259640a tempest-SnapshotMetadataTestJSON-1106777620 None] Created reservations ['3bc64017-1b31-4558-a0bf-cfc64768da60', '3468ca0e-e8c0-4358-9b53-75486dc44a58', '79ee2000-8026-417e-9802-2f5760273972', '4c999da9-e362-4a12-ad3f-1cebd18c64d8'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:45:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9c9d1502-a0ec-4069-ac2e-8aa61259640a tempest-SnapshotMetadataTestJSON-1106777620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:45:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9c9d1502-a0ec-4069-ac2e-8aa61259640a tempest-SnapshotMetadataTestJSON-1106777620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:45:47 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9c9d1502-a0ec-4069-ac2e-8aa61259640a tempest-SnapshotMetadataTestJSON-1106777620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:45:47 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9c9d1502-a0ec-4069-ac2e-8aa61259640a tempest-SnapshotMetadataTestJSON-1106777620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:45:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9c9d1502-a0ec-4069-ac2e-8aa61259640a tempest-SnapshotMetadataTestJSON-1106777620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:45:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9c9d1502-a0ec-4069-ac2e-8aa61259640a tempest-SnapshotMetadataTestJSON-1106777620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:45:48 devstack sudo[101742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:45:48 devstack sudo[101742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:45:48 devstack sudo[101742]: pam_unix(sudo:session): session closed for user root
Jul 09 14:45:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9c9d1502-a0ec-4069-ac2e-8aa61259640a tempest-SnapshotMetadataTestJSON-1106777620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.844s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:45:48 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-9c9d1502-a0ec-4069-ac2e-8aa61259640a tempest-SnapshotMetadataTestJSON-1106777620 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:45:48 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-9c9d1502-a0ec-4069-ac2e-8aa61259640a tempest-SnapshotMetadataTestJSON-1106777620 None] Deleted volume successfully.
Jul 09 14:45:48 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-9c9d1502-a0ec-4069-ac2e-8aa61259640a tempest-SnapshotMetadataTestJSON-1106777620 None] Lock "cinder-a7e15f23-1604-4ac4-9437-dbe4c0c01109-delete_volume" released by "delete_volume" :: held 2.975s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:45:52 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 14:45:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:45:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:45:52 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:45:52 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:45:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:45:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:45:52 devstack sudo[101746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:45:52 devstack sudo[101746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:45:53 devstack sudo[101746]: pam_unix(sudo:session): session closed for user root
Jul 09 14:45:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.921s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:45:53 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:45:53 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Running periodic task VolumeManager._thread_info {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 14:45:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] thread count: 28 {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 09 14:45:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] thread info: [<_MainThread(MainThread, started 125388812103808)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125388713797504)>, <Thread(Thread-3 (stat_writer), started daemon 125388699995392)>, <Thread(Rabbit-heartbeat, started daemon 125388700522560)>, <Thread(Thread-5 (_runner), started daemon 125388698545216)>, <Thread(Thread-7 (_runner), started daemon 125388698611264)>, <Thread(fd_logger, started daemon 125388703020672)>, <Thread(privsep_reader, started daemon 125388696441088)>, <Thread(tpool_thread_0, started daemon 125388687943360)>, <Thread(tpool_thread_1, started daemon 125388679550656)>, <Thread(tpool_thread_2, started daemon 125388671141568)>, <Thread(tpool_thread_3, started daemon 125388662732480)>, <Thread(tpool_thread_4, started daemon 125388654323392)>, <Thread(tpool_thread_5, started daemon 125388645914304)>, <Thread(tpool_thread_6, started daemon 125388637505216)>, <Thread(tpool_thread_7, started daemon 125388629096128)>, <Thread(tpool_thread_8, started daemon 125388620687040)>, <Thread(tpool_thread_9, started daemon 125388612277952)>, <Thread(tpool_thread_10, started daemon 125388603868864)>, <Thread(tpool_thread_11, started daemon 125388595459776)>, <Thread(tpool_thread_12, started daemon 125388587050688)>, <Thread(tpool_thread_13, started daemon 125388578641600)>, <Thread(tpool_thread_14, started daemon 125388570232512)>, <Thread(tpool_thread_15, started daemon 125388561823424)>, <Thread(tpool_thread_16, started daemon 125388553414336)>, <Thread(tpool_thread_17, started daemon 125388545005248)>, <Thread(tpool_thread_18, started daemon 125388536596160)>, <Thread(tpool_thread_19, started daemon 125388528187072)>] {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 09 14:45:53 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-40fefc4d-9236-4ae4-8c9f-46190c6e5ff4 tempest-VolumesTransfersV355Test-183643349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:45:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-40fefc4d-9236-4ae4-8c9f-46190c6e5ff4 tempest-VolumesTransfersV355Test-183643349 None] Flow 'volume_create_manager' (5203aa12-cd40-44a7-964a-7b73e2ebb525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:45:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-40fefc4d-9236-4ae4-8c9f-46190c6e5ff4 tempest-VolumesTransfersV355Test-183643349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90fc4c27-1825-4e1c-8ab6-a3061cc0efb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:45:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-40fefc4d-9236-4ae4-8c9f-46190c6e5ff4 tempest-VolumesTransfersV355Test-183643349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90fc4c27-1825-4e1c-8ab6-a3061cc0efb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:45:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-757633193',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65e3f3e6-abea-4ea9-b6fd-4a7fdb0a415a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='375ffe20e4ae42eeba973be2381ffb59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:45:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:45:54Z,use_quota=True,user_id='796bbf9e2187456ab1838292fa5259e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:45:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-40fefc4d-9236-4ae4-8c9f-46190c6e5ff4 tempest-VolumesTransfersV355Test-183643349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d554c35b-c0c9-4485-8cd1-10d3650ed065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:45:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-40fefc4d-9236-4ae4-8c9f-46190c6e5ff4 tempest-VolumesTransfersV355Test-183643349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d554c35b-c0c9-4485-8cd1-10d3650ed065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:45:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-40fefc4d-9236-4ae4-8c9f-46190c6e5ff4 tempest-VolumesTransfersV355Test-183643349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4980aa99-6548-47a3-8b75-1ce1f3753b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:45:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-40fefc4d-9236-4ae4-8c9f-46190c6e5ff4 tempest-VolumesTransfersV355Test-183643349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4980aa99-6548-47a3-8b75-1ce1f3753b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65e3f3e6-abea-4ea9-b6fd-4a7fdb0a415a', 'volume_name': 'volume-65e3f3e6-abea-4ea9-b6fd-4a7fdb0a415a', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:45:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-40fefc4d-9236-4ae4-8c9f-46190c6e5ff4 tempest-VolumesTransfersV355Test-183643349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ae9fb81-f483-4279-b30f-1275b51ef3cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:45:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-40fefc4d-9236-4ae4-8c9f-46190c6e5ff4 tempest-VolumesTransfersV355Test-183643349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ae9fb81-f483-4279-b30f-1275b51ef3cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:45:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-40fefc4d-9236-4ae4-8c9f-46190c6e5ff4 tempest-VolumesTransfersV355Test-183643349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1807215d-482e-4066-adee-59df168f0d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:45:53 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-40fefc4d-9236-4ae4-8c9f-46190c6e5ff4 tempest-VolumesTransfersV355Test-183643349 None] Volume 65e3f3e6-abea-4ea9-b6fd-4a7fdb0a415a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65e3f3e6-abea-4ea9-b6fd-4a7fdb0a415a', 'volume_size': 1}
Jul 09 14:45:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-40fefc4d-9236-4ae4-8c9f-46190c6e5ff4 tempest-VolumesTransfersV355Test-183643349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:45:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-40fefc4d-9236-4ae4-8c9f-46190c6e5ff4 tempest-VolumesTransfersV355Test-183643349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:45:53 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-40fefc4d-9236-4ae4-8c9f-46190c6e5ff4 tempest-VolumesTransfersV355Test-183643349 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:45:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-757633193',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65e3f3e6-abea-4ea9-b6fd-4a7fdb0a415a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='375ffe20e4ae42eeba973be2381ffb59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:45:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:45:54Z,use_quota=True,user_id='796bbf9e2187456ab1838292fa5259e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:45:53 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-40fefc4d-9236-4ae4-8c9f-46190c6e5ff4 tempest-VolumesTransfersV355Test-183643349 None] Creating volume 65e3f3e6-abea-4ea9-b6fd-4a7fdb0a415a {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:45:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-40fefc4d-9236-4ae4-8c9f-46190c6e5ff4 tempest-VolumesTransfersV355Test-183643349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:45:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-40fefc4d-9236-4ae4-8c9f-46190c6e5ff4 tempest-VolumesTransfersV355Test-183643349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:45:53 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-40fefc4d-9236-4ae4-8c9f-46190c6e5ff4 tempest-VolumesTransfersV355Test-183643349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:45:53 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-40fefc4d-9236-4ae4-8c9f-46190c6e5ff4 tempest-VolumesTransfersV355Test-183643349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:45:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-40fefc4d-9236-4ae4-8c9f-46190c6e5ff4 tempest-VolumesTransfersV355Test-183643349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:45:53 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-40fefc4d-9236-4ae4-8c9f-46190c6e5ff4 tempest-VolumesTransfersV355Test-183643349 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:45:53 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-40fefc4d-9236-4ae4-8c9f-46190c6e5ff4 tempest-VolumesTransfersV355Test-183643349 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:45:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-40fefc4d-9236-4ae4-8c9f-46190c6e5ff4 tempest-VolumesTransfersV355Test-183643349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-65e3f3e6-abea-4ea9-b6fd-4a7fdb0a415a 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:45:53 devstack sudo[101749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-65e3f3e6-abea-4ea9-b6fd-4a7fdb0a415a 1073741824
Jul 09 14:45:53 devstack sudo[101749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:45:55 devstack sudo[101749]: pam_unix(sudo:session): session closed for user root
Jul 09 14:45:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-40fefc4d-9236-4ae4-8c9f-46190c6e5ff4 tempest-VolumesTransfersV355Test-183643349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-65e3f3e6-abea-4ea9-b6fd-4a7fdb0a415a 1073741824" returned: 0 in 1.131s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:45:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-40fefc4d-9236-4ae4-8c9f-46190c6e5ff4 tempest-VolumesTransfersV355Test-183643349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-65e3f3e6-abea-4ea9-b6fd-4a7fdb0a415a {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:45:55 devstack sudo[101764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-65e3f3e6-abea-4ea9-b6fd-4a7fdb0a415a
Jul 09 14:45:55 devstack sudo[101764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:45:55 devstack sudo[101764]: pam_unix(sudo:session): session closed for user root
Jul 09 14:45:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-40fefc4d-9236-4ae4-8c9f-46190c6e5ff4 tempest-VolumesTransfersV355Test-183643349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-65e3f3e6-abea-4ea9-b6fd-4a7fdb0a415a" returned: 0 in 0.849s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:45:55 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-40fefc4d-9236-4ae4-8c9f-46190c6e5ff4 tempest-VolumesTransfersV355Test-183643349 None] <== create_volume: return (2040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:45:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-40fefc4d-9236-4ae4-8c9f-46190c6e5ff4 tempest-VolumesTransfersV355Test-183643349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.045s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:45:55 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-40fefc4d-9236-4ae4-8c9f-46190c6e5ff4 tempest-VolumesTransfersV355Test-183643349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1807215d-482e-4066-adee-59df168f0d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65e3f3e6-abea-4ea9-b6fd-4a7fdb0a415a', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:45:55 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-40fefc4d-9236-4ae4-8c9f-46190c6e5ff4 tempest-VolumesTransfersV355Test-183643349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f888fffd-ab0e-476a-af92-e2c9ec1a3343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:45:55 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-40fefc4d-9236-4ae4-8c9f-46190c6e5ff4 tempest-VolumesTransfersV355Test-183643349 None] Volume volume-65e3f3e6-abea-4ea9-b6fd-4a7fdb0a415a (65e3f3e6-abea-4ea9-b6fd-4a7fdb0a415a): created successfully
Jul 09 14:45:55 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-40fefc4d-9236-4ae4-8c9f-46190c6e5ff4 tempest-VolumesTransfersV355Test-183643349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f888fffd-ab0e-476a-af92-e2c9ec1a3343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:45:55 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-40fefc4d-9236-4ae4-8c9f-46190c6e5ff4 tempest-VolumesTransfersV355Test-183643349 None] Flow 'volume_create_manager' (5203aa12-cd40-44a7-964a-7b73e2ebb525) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:45:55 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-40fefc4d-9236-4ae4-8c9f-46190c6e5ff4 tempest-VolumesTransfersV355Test-183643349 None] Created volume successfully.
Jul 09 14:45:57 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-bc544dfc-7727-434b-ba02-d331e7489faf tempest-VolumesTransfersV355Test-1222649498 None] Transfer volume completed successfully.
Jul 09 14:45:58 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-035a492a-f76d-413d-8563-fd18d7db8aa0 tempest-VolumesTransfersV355Test-1784209548 None] Acquiring lock "cinder-65e3f3e6-abea-4ea9-b6fd-4a7fdb0a415a-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:45:58 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-035a492a-f76d-413d-8563-fd18d7db8aa0 tempest-VolumesTransfersV355Test-1784209548 None] Lock "cinder-65e3f3e6-abea-4ea9-b6fd-4a7fdb0a415a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:45:58 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-035a492a-f76d-413d-8563-fd18d7db8aa0 tempest-VolumesTransfersV355Test-1784209548 None] Acquiring lock "cinder-quobyte-65e3f3e6-abea-4ea9-b6fd-4a7fdb0a415a" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:45:58 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-035a492a-f76d-413d-8563-fd18d7db8aa0 tempest-VolumesTransfersV355Test-1784209548 None] Lock "cinder-quobyte-65e3f3e6-abea-4ea9-b6fd-4a7fdb0a415a" acquired by "delete_volume" :: waited 0.015s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:45:58 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c92587-286b-41ac-8410-30dbb20103d2]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:45:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-035a492a-f76d-413d-8563-fd18d7db8aa0 tempest-VolumesTransfersV355Test-1784209548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-65e3f3e6-abea-4ea9-b6fd-4a7fdb0a415a {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:45:58 devstack sudo[101798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-65e3f3e6-abea-4ea9-b6fd-4a7fdb0a415a
Jul 09 14:45:58 devstack sudo[101798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:45:59 devstack sudo[101798]: pam_unix(sudo:session): session closed for user root
Jul 09 14:45:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-035a492a-f76d-413d-8563-fd18d7db8aa0 tempest-VolumesTransfersV355Test-1784209548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-65e3f3e6-abea-4ea9-b6fd-4a7fdb0a415a" returned: 0 in 0.778s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:45:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-035a492a-f76d-413d-8563-fd18d7db8aa0 tempest-VolumesTransfersV355Test-1784209548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-65e3f3e6-abea-4ea9-b6fd-4a7fdb0a415a {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:45:59 devstack sudo[101804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-65e3f3e6-abea-4ea9-b6fd-4a7fdb0a415a
Jul 09 14:45:59 devstack sudo[101804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:46:00 devstack sudo[101804]: pam_unix(sudo:session): session closed for user root
Jul 09 14:46:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-035a492a-f76d-413d-8563-fd18d7db8aa0 tempest-VolumesTransfersV355Test-1784209548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-65e3f3e6-abea-4ea9-b6fd-4a7fdb0a415a" returned: 0 in 0.660s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:46:00 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-035a492a-f76d-413d-8563-fd18d7db8aa0 tempest-VolumesTransfersV355Test-1784209548 None] Lock "cinder-quobyte-65e3f3e6-abea-4ea9-b6fd-4a7fdb0a415a" released by "delete_volume" :: held 1.495s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:46:00 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-035a492a-f76d-413d-8563-fd18d7db8aa0 tempest-VolumesTransfersV355Test-1784209548 None] Created reservations ['c8f508fc-311c-446b-bb5e-91f7e345a57d', '9ed6497e-8f60-4f2d-a755-b43b21b98b07', 'f6b74221-a4fa-4e2b-8249-219bb76d313e', '395757dd-f6f8-4419-a29a-b48fff94f045'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:46:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-035a492a-f76d-413d-8563-fd18d7db8aa0 tempest-VolumesTransfersV355Test-1784209548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:46:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-035a492a-f76d-413d-8563-fd18d7db8aa0 tempest-VolumesTransfersV355Test-1784209548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:46:00 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-035a492a-f76d-413d-8563-fd18d7db8aa0 tempest-VolumesTransfersV355Test-1784209548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:46:00 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-035a492a-f76d-413d-8563-fd18d7db8aa0 tempest-VolumesTransfersV355Test-1784209548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:46:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-035a492a-f76d-413d-8563-fd18d7db8aa0 tempest-VolumesTransfersV355Test-1784209548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:46:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-035a492a-f76d-413d-8563-fd18d7db8aa0 tempest-VolumesTransfersV355Test-1784209548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:46:00 devstack sudo[101807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:46:00 devstack sudo[101807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:46:00 devstack sudo[101807]: pam_unix(sudo:session): session closed for user root
Jul 09 14:46:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-035a492a-f76d-413d-8563-fd18d7db8aa0 tempest-VolumesTransfersV355Test-1784209548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.708s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:46:00 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-035a492a-f76d-413d-8563-fd18d7db8aa0 tempest-VolumesTransfersV355Test-1784209548 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:46:00 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-035a492a-f76d-413d-8563-fd18d7db8aa0 tempest-VolumesTransfersV355Test-1784209548 None] Deleted volume successfully.
Jul 09 14:46:00 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-035a492a-f76d-413d-8563-fd18d7db8aa0 tempest-VolumesTransfersV355Test-1784209548 None] Lock "cinder-65e3f3e6-abea-4ea9-b6fd-4a7fdb0a415a-delete_volume" released by "delete_volume" :: held 2.442s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:46:01 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8233851-ef43-417d-9bf4-4abc3a6bb9c4 tempest-VolumesTransfersV355Test-183643349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:46:01 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b8233851-ef43-417d-9bf4-4abc3a6bb9c4 tempest-VolumesTransfersV355Test-183643349 None] Flow 'volume_create_manager' (d59886a2-ebbe-427e-80ea-63170ffe1503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:46:01 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b8233851-ef43-417d-9bf4-4abc3a6bb9c4 tempest-VolumesTransfersV355Test-183643349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9abd4550-73a8-4bbd-9990-6981605d2dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:46:01 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b8233851-ef43-417d-9bf4-4abc3a6bb9c4 tempest-VolumesTransfersV355Test-183643349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9abd4550-73a8-4bbd-9990-6981605d2dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:46:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-856787000',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ebce845-70cb-4a86-bca4-84c5de4eba3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='375ffe20e4ae42eeba973be2381ffb59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:46:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:46:01Z,use_quota=True,user_id='796bbf9e2187456ab1838292fa5259e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:46:01 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b8233851-ef43-417d-9bf4-4abc3a6bb9c4 tempest-VolumesTransfersV355Test-183643349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10034468-1248-4ff8-bb8e-4407084ebf9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:46:01 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b8233851-ef43-417d-9bf4-4abc3a6bb9c4 tempest-VolumesTransfersV355Test-183643349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10034468-1248-4ff8-bb8e-4407084ebf9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:46:01 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b8233851-ef43-417d-9bf4-4abc3a6bb9c4 tempest-VolumesTransfersV355Test-183643349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f234463-ab7b-4344-b36e-2c8e23314462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:46:01 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b8233851-ef43-417d-9bf4-4abc3a6bb9c4 tempest-VolumesTransfersV355Test-183643349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f234463-ab7b-4344-b36e-2c8e23314462) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ebce845-70cb-4a86-bca4-84c5de4eba3b', 'volume_name': 'volume-4ebce845-70cb-4a86-bca4-84c5de4eba3b', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:46:01 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b8233851-ef43-417d-9bf4-4abc3a6bb9c4 tempest-VolumesTransfersV355Test-183643349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (263f6251-3b07-4fca-b846-79f01a64fdab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:46:01 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b8233851-ef43-417d-9bf4-4abc3a6bb9c4 tempest-VolumesTransfersV355Test-183643349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (263f6251-3b07-4fca-b846-79f01a64fdab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:46:01 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b8233851-ef43-417d-9bf4-4abc3a6bb9c4 tempest-VolumesTransfersV355Test-183643349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d463d215-8d17-47bd-bfa6-89d92ec7afb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:46:01 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-b8233851-ef43-417d-9bf4-4abc3a6bb9c4 tempest-VolumesTransfersV355Test-183643349 None] Volume 4ebce845-70cb-4a86-bca4-84c5de4eba3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ebce845-70cb-4a86-bca4-84c5de4eba3b', 'volume_size': 1}
Jul 09 14:46:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b8233851-ef43-417d-9bf4-4abc3a6bb9c4 tempest-VolumesTransfersV355Test-183643349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:46:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b8233851-ef43-417d-9bf4-4abc3a6bb9c4 tempest-VolumesTransfersV355Test-183643349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:46:01 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b8233851-ef43-417d-9bf4-4abc3a6bb9c4 tempest-VolumesTransfersV355Test-183643349 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:46:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-856787000',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ebce845-70cb-4a86-bca4-84c5de4eba3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='375ffe20e4ae42eeba973be2381ffb59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:46:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:46:01Z,use_quota=True,user_id='796bbf9e2187456ab1838292fa5259e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:46:01 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-b8233851-ef43-417d-9bf4-4abc3a6bb9c4 tempest-VolumesTransfersV355Test-183643349 None] Creating volume 4ebce845-70cb-4a86-bca4-84c5de4eba3b {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:46:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b8233851-ef43-417d-9bf4-4abc3a6bb9c4 tempest-VolumesTransfersV355Test-183643349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:46:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b8233851-ef43-417d-9bf4-4abc3a6bb9c4 tempest-VolumesTransfersV355Test-183643349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:46:01 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b8233851-ef43-417d-9bf4-4abc3a6bb9c4 tempest-VolumesTransfersV355Test-183643349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:46:01 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b8233851-ef43-417d-9bf4-4abc3a6bb9c4 tempest-VolumesTransfersV355Test-183643349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:46:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b8233851-ef43-417d-9bf4-4abc3a6bb9c4 tempest-VolumesTransfersV355Test-183643349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:46:01 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b8233851-ef43-417d-9bf4-4abc3a6bb9c4 tempest-VolumesTransfersV355Test-183643349 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:46:01 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-b8233851-ef43-417d-9bf4-4abc3a6bb9c4 tempest-VolumesTransfersV355Test-183643349 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:46:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b8233851-ef43-417d-9bf4-4abc3a6bb9c4 tempest-VolumesTransfersV355Test-183643349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-4ebce845-70cb-4a86-bca4-84c5de4eba3b 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:46:01 devstack sudo[101811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-4ebce845-70cb-4a86-bca4-84c5de4eba3b 1073741824
Jul 09 14:46:01 devstack sudo[101811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:46:02 devstack sudo[101811]: pam_unix(sudo:session): session closed for user root
Jul 09 14:46:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b8233851-ef43-417d-9bf4-4abc3a6bb9c4 tempest-VolumesTransfersV355Test-183643349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-4ebce845-70cb-4a86-bca4-84c5de4eba3b 1073741824" returned: 0 in 0.936s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:46:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b8233851-ef43-417d-9bf4-4abc3a6bb9c4 tempest-VolumesTransfersV355Test-183643349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-4ebce845-70cb-4a86-bca4-84c5de4eba3b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:46:02 devstack sudo[101820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-4ebce845-70cb-4a86-bca4-84c5de4eba3b
Jul 09 14:46:02 devstack sudo[101820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:46:03 devstack sudo[101820]: pam_unix(sudo:session): session closed for user root
Jul 09 14:46:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b8233851-ef43-417d-9bf4-4abc3a6bb9c4 tempest-VolumesTransfersV355Test-183643349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-4ebce845-70cb-4a86-bca4-84c5de4eba3b" returned: 0 in 0.733s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:46:03 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b8233851-ef43-417d-9bf4-4abc3a6bb9c4 tempest-VolumesTransfersV355Test-183643349 None] <== create_volume: return (1721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:46:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b8233851-ef43-417d-9bf4-4abc3a6bb9c4 tempest-VolumesTransfersV355Test-183643349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.724s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:46:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b8233851-ef43-417d-9bf4-4abc3a6bb9c4 tempest-VolumesTransfersV355Test-183643349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d463d215-8d17-47bd-bfa6-89d92ec7afb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ebce845-70cb-4a86-bca4-84c5de4eba3b', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:46:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b8233851-ef43-417d-9bf4-4abc3a6bb9c4 tempest-VolumesTransfersV355Test-183643349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9746614-2d85-4c9c-bcd2-8603b5ae7f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:46:03 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-b8233851-ef43-417d-9bf4-4abc3a6bb9c4 tempest-VolumesTransfersV355Test-183643349 None] Volume volume-4ebce845-70cb-4a86-bca4-84c5de4eba3b (4ebce845-70cb-4a86-bca4-84c5de4eba3b): created successfully
Jul 09 14:46:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b8233851-ef43-417d-9bf4-4abc3a6bb9c4 tempest-VolumesTransfersV355Test-183643349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9746614-2d85-4c9c-bcd2-8603b5ae7f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:46:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b8233851-ef43-417d-9bf4-4abc3a6bb9c4 tempest-VolumesTransfersV355Test-183643349 None] Flow 'volume_create_manager' (d59886a2-ebbe-427e-80ea-63170ffe1503) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:46:03 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-b8233851-ef43-417d-9bf4-4abc3a6bb9c4 tempest-VolumesTransfersV355Test-183643349 None] Created volume successfully.
Jul 09 14:46:03 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-818138a6-94aa-478a-befe-b6b143b78956 tempest-VolumesTransfersV355Test-1784209548 None] Acquiring lock "cinder-4ebce845-70cb-4a86-bca4-84c5de4eba3b-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:46:03 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-818138a6-94aa-478a-befe-b6b143b78956 tempest-VolumesTransfersV355Test-1784209548 None] Lock "cinder-4ebce845-70cb-4a86-bca4-84c5de4eba3b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:46:03 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-818138a6-94aa-478a-befe-b6b143b78956 tempest-VolumesTransfersV355Test-1784209548 None] Acquiring lock "cinder-quobyte-4ebce845-70cb-4a86-bca4-84c5de4eba3b" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:46:03 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-818138a6-94aa-478a-befe-b6b143b78956 tempest-VolumesTransfersV355Test-1784209548 None] Lock "cinder-quobyte-4ebce845-70cb-4a86-bca4-84c5de4eba3b" acquired by "delete_volume" :: waited 0.019s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:46:03 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[6afd64f8-b25a-4342-bc62-e545d4f14ce3]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:46:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-818138a6-94aa-478a-befe-b6b143b78956 tempest-VolumesTransfersV355Test-1784209548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-4ebce845-70cb-4a86-bca4-84c5de4eba3b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:46:03 devstack sudo[101823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-4ebce845-70cb-4a86-bca4-84c5de4eba3b
Jul 09 14:46:03 devstack sudo[101823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:46:04 devstack sudo[101823]: pam_unix(sudo:session): session closed for user root
Jul 09 14:46:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-818138a6-94aa-478a-befe-b6b143b78956 tempest-VolumesTransfersV355Test-1784209548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-4ebce845-70cb-4a86-bca4-84c5de4eba3b" returned: 0 in 0.799s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:46:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-818138a6-94aa-478a-befe-b6b143b78956 tempest-VolumesTransfersV355Test-1784209548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-4ebce845-70cb-4a86-bca4-84c5de4eba3b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:46:04 devstack sudo[101828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-4ebce845-70cb-4a86-bca4-84c5de4eba3b
Jul 09 14:46:04 devstack sudo[101828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:46:05 devstack sudo[101828]: pam_unix(sudo:session): session closed for user root
Jul 09 14:46:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-818138a6-94aa-478a-befe-b6b143b78956 tempest-VolumesTransfersV355Test-1784209548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-4ebce845-70cb-4a86-bca4-84c5de4eba3b" returned: 0 in 0.642s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:46:05 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-818138a6-94aa-478a-befe-b6b143b78956 tempest-VolumesTransfersV355Test-1784209548 None] Lock "cinder-quobyte-4ebce845-70cb-4a86-bca4-84c5de4eba3b" released by "delete_volume" :: held 1.491s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:46:05 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-818138a6-94aa-478a-befe-b6b143b78956 tempest-VolumesTransfersV355Test-1784209548 None] Created reservations ['e9283957-fdc2-4602-9e89-1eb5621a086b', '0aa3595f-c314-4b2b-866f-c8124b1b2ee0', 'b790c248-eec7-455f-8005-7eba869b9475', '3b90b735-3fd5-42bf-bb9c-6d54f7e286b9'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:46:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-818138a6-94aa-478a-befe-b6b143b78956 tempest-VolumesTransfersV355Test-1784209548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:46:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-818138a6-94aa-478a-befe-b6b143b78956 tempest-VolumesTransfersV355Test-1784209548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:46:05 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-818138a6-94aa-478a-befe-b6b143b78956 tempest-VolumesTransfersV355Test-1784209548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:46:05 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-818138a6-94aa-478a-befe-b6b143b78956 tempest-VolumesTransfersV355Test-1784209548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:46:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-818138a6-94aa-478a-befe-b6b143b78956 tempest-VolumesTransfersV355Test-1784209548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:46:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-818138a6-94aa-478a-befe-b6b143b78956 tempest-VolumesTransfersV355Test-1784209548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:46:05 devstack sudo[101831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:46:05 devstack sudo[101831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:46:06 devstack sudo[101831]: pam_unix(sudo:session): session closed for user root
Jul 09 14:46:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-818138a6-94aa-478a-befe-b6b143b78956 tempest-VolumesTransfersV355Test-1784209548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.703s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:46:06 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-818138a6-94aa-478a-befe-b6b143b78956 tempest-VolumesTransfersV355Test-1784209548 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:46:06 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-818138a6-94aa-478a-befe-b6b143b78956 tempest-VolumesTransfersV355Test-1784209548 None] Deleted volume successfully.
Jul 09 14:46:06 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-818138a6-94aa-478a-befe-b6b143b78956 tempest-VolumesTransfersV355Test-1784209548 None] Lock "cinder-4ebce845-70cb-4a86-bca4-84c5de4eba3b-delete_volume" released by "delete_volume" :: held 2.415s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:46:12 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:UPDATE=94,cinder:DELETE=5,cinder:SELECT=96,cinder:INSERT=36 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 14:46:12 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=86,cinder:UPDATE=112,cinder:INSERT=35,cinder:DELETE=12 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 14:46:12 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4839e15-3310-4f38-b316-a1ca453f2877 tempest-VolumesListTestJSON-1845005127 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:46:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b4839e15-3310-4f38-b316-a1ca453f2877 tempest-VolumesListTestJSON-1845005127 None] Flow 'volume_create_manager' (42ba8a0f-9bf0-4f64-a53d-a2944d5b14a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:46:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b4839e15-3310-4f38-b316-a1ca453f2877 tempest-VolumesListTestJSON-1845005127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7420543e-6c1e-4352-a2bc-6496c7a08cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:46:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b4839e15-3310-4f38-b316-a1ca453f2877 tempest-VolumesListTestJSON-1845005127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7420543e-6c1e-4352-a2bc-6496c7a08cb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:46:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2060784599',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a85f50e7-62c4-4044-8ddf-0b613d6ff8f6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='12b727e69be54464b3f7176bb1c3610e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:46:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:46:12Z,use_quota=True,user_id='d1105087f80a45c1851f9f5100a8f7d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:46:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b4839e15-3310-4f38-b316-a1ca453f2877 tempest-VolumesListTestJSON-1845005127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cce81d69-7514-4e28-8855-d54b88d290c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:46:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b4839e15-3310-4f38-b316-a1ca453f2877 tempest-VolumesListTestJSON-1845005127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cce81d69-7514-4e28-8855-d54b88d290c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:46:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b4839e15-3310-4f38-b316-a1ca453f2877 tempest-VolumesListTestJSON-1845005127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3937015e-81d7-4c01-8dce-31cab9aac11f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:46:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b4839e15-3310-4f38-b316-a1ca453f2877 tempest-VolumesListTestJSON-1845005127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3937015e-81d7-4c01-8dce-31cab9aac11f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a85f50e7-62c4-4044-8ddf-0b613d6ff8f6', 'volume_name': 'volume-a85f50e7-62c4-4044-8ddf-0b613d6ff8f6', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:46:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b4839e15-3310-4f38-b316-a1ca453f2877 tempest-VolumesListTestJSON-1845005127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05584c7e-3265-465f-bcf5-4375cbbbec6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:46:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b4839e15-3310-4f38-b316-a1ca453f2877 tempest-VolumesListTestJSON-1845005127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05584c7e-3265-465f-bcf5-4375cbbbec6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:46:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b4839e15-3310-4f38-b316-a1ca453f2877 tempest-VolumesListTestJSON-1845005127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b512dd54-351f-4f38-bb40-dd3e033800a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:46:12 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-b4839e15-3310-4f38-b316-a1ca453f2877 tempest-VolumesListTestJSON-1845005127 None] Volume a85f50e7-62c4-4044-8ddf-0b613d6ff8f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a85f50e7-62c4-4044-8ddf-0b613d6ff8f6', 'volume_size': 1}
Jul 09 14:46:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b4839e15-3310-4f38-b316-a1ca453f2877 tempest-VolumesListTestJSON-1845005127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:46:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b4839e15-3310-4f38-b316-a1ca453f2877 tempest-VolumesListTestJSON-1845005127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:46:12 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b4839e15-3310-4f38-b316-a1ca453f2877 tempest-VolumesListTestJSON-1845005127 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:46:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2060784599',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a85f50e7-62c4-4044-8ddf-0b613d6ff8f6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='12b727e69be54464b3f7176bb1c3610e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:46:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:46:12Z,use_quota=True,user_id='d1105087f80a45c1851f9f5100a8f7d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:46:12 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-b4839e15-3310-4f38-b316-a1ca453f2877 tempest-VolumesListTestJSON-1845005127 None] Creating volume a85f50e7-62c4-4044-8ddf-0b613d6ff8f6 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:46:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b4839e15-3310-4f38-b316-a1ca453f2877 tempest-VolumesListTestJSON-1845005127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:46:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b4839e15-3310-4f38-b316-a1ca453f2877 tempest-VolumesListTestJSON-1845005127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:46:12 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b4839e15-3310-4f38-b316-a1ca453f2877 tempest-VolumesListTestJSON-1845005127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:46:12 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b4839e15-3310-4f38-b316-a1ca453f2877 tempest-VolumesListTestJSON-1845005127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:46:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b4839e15-3310-4f38-b316-a1ca453f2877 tempest-VolumesListTestJSON-1845005127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:46:12 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b4839e15-3310-4f38-b316-a1ca453f2877 tempest-VolumesListTestJSON-1845005127 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:46:12 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-b4839e15-3310-4f38-b316-a1ca453f2877 tempest-VolumesListTestJSON-1845005127 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:46:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b4839e15-3310-4f38-b316-a1ca453f2877 tempest-VolumesListTestJSON-1845005127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a85f50e7-62c4-4044-8ddf-0b613d6ff8f6 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:46:12 devstack sudo[101869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a85f50e7-62c4-4044-8ddf-0b613d6ff8f6 1073741824
Jul 09 14:46:12 devstack sudo[101869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:46:13 devstack sudo[101869]: pam_unix(sudo:session): session closed for user root
Jul 09 14:46:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b4839e15-3310-4f38-b316-a1ca453f2877 tempest-VolumesListTestJSON-1845005127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a85f50e7-62c4-4044-8ddf-0b613d6ff8f6 1073741824" returned: 0 in 0.822s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:46:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b4839e15-3310-4f38-b316-a1ca453f2877 tempest-VolumesListTestJSON-1845005127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a85f50e7-62c4-4044-8ddf-0b613d6ff8f6 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:46:13 devstack sudo[101886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a85f50e7-62c4-4044-8ddf-0b613d6ff8f6
Jul 09 14:46:13 devstack sudo[101886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:46:14 devstack sudo[101886]: pam_unix(sudo:session): session closed for user root
Jul 09 14:46:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b4839e15-3310-4f38-b316-a1ca453f2877 tempest-VolumesListTestJSON-1845005127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a85f50e7-62c4-4044-8ddf-0b613d6ff8f6" returned: 0 in 0.922s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:46:14 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b4839e15-3310-4f38-b316-a1ca453f2877 tempest-VolumesListTestJSON-1845005127 None] <== create_volume: return (1840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:46:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b4839e15-3310-4f38-b316-a1ca453f2877 tempest-VolumesListTestJSON-1845005127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.843s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:46:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b4839e15-3310-4f38-b316-a1ca453f2877 tempest-VolumesListTestJSON-1845005127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b512dd54-351f-4f38-bb40-dd3e033800a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a85f50e7-62c4-4044-8ddf-0b613d6ff8f6', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:46:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b4839e15-3310-4f38-b316-a1ca453f2877 tempest-VolumesListTestJSON-1845005127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec3f618d-bdbc-4f6e-86d3-d9b428fc1038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:46:14 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-b4839e15-3310-4f38-b316-a1ca453f2877 tempest-VolumesListTestJSON-1845005127 None] Volume volume-a85f50e7-62c4-4044-8ddf-0b613d6ff8f6 (a85f50e7-62c4-4044-8ddf-0b613d6ff8f6): created successfully
Jul 09 14:46:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b4839e15-3310-4f38-b316-a1ca453f2877 tempest-VolumesListTestJSON-1845005127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec3f618d-bdbc-4f6e-86d3-d9b428fc1038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:46:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b4839e15-3310-4f38-b316-a1ca453f2877 tempest-VolumesListTestJSON-1845005127 None] Flow 'volume_create_manager' (42ba8a0f-9bf0-4f64-a53d-a2944d5b14a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:46:14 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-b4839e15-3310-4f38-b316-a1ca453f2877 tempest-VolumesListTestJSON-1845005127 None] Created volume successfully.
Jul 09 14:46:14 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3c198b6-2cf2-46ab-94dd-6432feb82c6f tempest-VolumesListTestJSON-1845005127 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:46:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c3c198b6-2cf2-46ab-94dd-6432feb82c6f tempest-VolumesListTestJSON-1845005127 None] Flow 'volume_create_manager' (5810f32c-6c1e-4711-bf35-460f7b7cd129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:46:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c3c198b6-2cf2-46ab-94dd-6432feb82c6f tempest-VolumesListTestJSON-1845005127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da666587-9838-4193-9df4-ab964d0aba00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:46:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c3c198b6-2cf2-46ab-94dd-6432feb82c6f tempest-VolumesListTestJSON-1845005127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da666587-9838-4193-9df4-ab964d0aba00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:46:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1090407874',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9121c0fc-0ddb-4b23-872c-2816d2f7dcbf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='12b727e69be54464b3f7176bb1c3610e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:46:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:46:15Z,use_quota=True,user_id='d1105087f80a45c1851f9f5100a8f7d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:46:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c3c198b6-2cf2-46ab-94dd-6432feb82c6f tempest-VolumesListTestJSON-1845005127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (359b4a5b-022e-4a10-8426-b7f194a7bf39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:46:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c3c198b6-2cf2-46ab-94dd-6432feb82c6f tempest-VolumesListTestJSON-1845005127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (359b4a5b-022e-4a10-8426-b7f194a7bf39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:46:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c3c198b6-2cf2-46ab-94dd-6432feb82c6f tempest-VolumesListTestJSON-1845005127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac560726-886e-49a6-b511-58457106a8e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:46:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c3c198b6-2cf2-46ab-94dd-6432feb82c6f tempest-VolumesListTestJSON-1845005127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac560726-886e-49a6-b511-58457106a8e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9121c0fc-0ddb-4b23-872c-2816d2f7dcbf', 'volume_name': 'volume-9121c0fc-0ddb-4b23-872c-2816d2f7dcbf', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:46:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c3c198b6-2cf2-46ab-94dd-6432feb82c6f tempest-VolumesListTestJSON-1845005127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc70997d-b82a-4548-aaec-4db402a212f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:46:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c3c198b6-2cf2-46ab-94dd-6432feb82c6f tempest-VolumesListTestJSON-1845005127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc70997d-b82a-4548-aaec-4db402a212f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:46:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c3c198b6-2cf2-46ab-94dd-6432feb82c6f tempest-VolumesListTestJSON-1845005127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34097883-1bf3-4495-a268-aaedad0a2071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:46:14 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-c3c198b6-2cf2-46ab-94dd-6432feb82c6f tempest-VolumesListTestJSON-1845005127 None] Volume 9121c0fc-0ddb-4b23-872c-2816d2f7dcbf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9121c0fc-0ddb-4b23-872c-2816d2f7dcbf', 'volume_size': 1}
Jul 09 14:46:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c3c198b6-2cf2-46ab-94dd-6432feb82c6f tempest-VolumesListTestJSON-1845005127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:46:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c3c198b6-2cf2-46ab-94dd-6432feb82c6f tempest-VolumesListTestJSON-1845005127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:46:14 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-c3c198b6-2cf2-46ab-94dd-6432feb82c6f tempest-VolumesListTestJSON-1845005127 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:46:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1090407874',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9121c0fc-0ddb-4b23-872c-2816d2f7dcbf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='12b727e69be54464b3f7176bb1c3610e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:46:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:46:15Z,use_quota=True,user_id='d1105087f80a45c1851f9f5100a8f7d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:46:14 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-c3c198b6-2cf2-46ab-94dd-6432feb82c6f tempest-VolumesListTestJSON-1845005127 None] Creating volume 9121c0fc-0ddb-4b23-872c-2816d2f7dcbf {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:46:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c3c198b6-2cf2-46ab-94dd-6432feb82c6f tempest-VolumesListTestJSON-1845005127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:46:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c3c198b6-2cf2-46ab-94dd-6432feb82c6f tempest-VolumesListTestJSON-1845005127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:46:14 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-c3c198b6-2cf2-46ab-94dd-6432feb82c6f tempest-VolumesListTestJSON-1845005127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:46:14 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-c3c198b6-2cf2-46ab-94dd-6432feb82c6f tempest-VolumesListTestJSON-1845005127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:46:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c3c198b6-2cf2-46ab-94dd-6432feb82c6f tempest-VolumesListTestJSON-1845005127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:46:14 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-c3c198b6-2cf2-46ab-94dd-6432feb82c6f tempest-VolumesListTestJSON-1845005127 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:46:14 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-c3c198b6-2cf2-46ab-94dd-6432feb82c6f tempest-VolumesListTestJSON-1845005127 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:46:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c3c198b6-2cf2-46ab-94dd-6432feb82c6f tempest-VolumesListTestJSON-1845005127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-9121c0fc-0ddb-4b23-872c-2816d2f7dcbf 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:46:14 devstack sudo[101933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-9121c0fc-0ddb-4b23-872c-2816d2f7dcbf 1073741824
Jul 09 14:46:14 devstack sudo[101933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:46:15 devstack sudo[101933]: pam_unix(sudo:session): session closed for user root
Jul 09 14:46:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c3c198b6-2cf2-46ab-94dd-6432feb82c6f tempest-VolumesListTestJSON-1845005127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-9121c0fc-0ddb-4b23-872c-2816d2f7dcbf 1073741824" returned: 0 in 0.886s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:46:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c3c198b6-2cf2-46ab-94dd-6432feb82c6f tempest-VolumesListTestJSON-1845005127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-9121c0fc-0ddb-4b23-872c-2816d2f7dcbf {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:46:15 devstack sudo[101949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-9121c0fc-0ddb-4b23-872c-2816d2f7dcbf
Jul 09 14:46:15 devstack sudo[101949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:46:16 devstack sudo[101949]: pam_unix(sudo:session): session closed for user root
Jul 09 14:46:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c3c198b6-2cf2-46ab-94dd-6432feb82c6f tempest-VolumesListTestJSON-1845005127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-9121c0fc-0ddb-4b23-872c-2816d2f7dcbf" returned: 0 in 0.679s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:46:16 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-c3c198b6-2cf2-46ab-94dd-6432feb82c6f tempest-VolumesListTestJSON-1845005127 None] <== create_volume: return (1606ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:46:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c3c198b6-2cf2-46ab-94dd-6432feb82c6f tempest-VolumesListTestJSON-1845005127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.610s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:46:16 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c3c198b6-2cf2-46ab-94dd-6432feb82c6f tempest-VolumesListTestJSON-1845005127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34097883-1bf3-4495-a268-aaedad0a2071) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9121c0fc-0ddb-4b23-872c-2816d2f7dcbf', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:46:16 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c3c198b6-2cf2-46ab-94dd-6432feb82c6f tempest-VolumesListTestJSON-1845005127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (303ea8bc-2f70-4693-810a-ca4d8713fdfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:46:16 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-c3c198b6-2cf2-46ab-94dd-6432feb82c6f tempest-VolumesListTestJSON-1845005127 None] Volume volume-9121c0fc-0ddb-4b23-872c-2816d2f7dcbf (9121c0fc-0ddb-4b23-872c-2816d2f7dcbf): created successfully
Jul 09 14:46:16 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c3c198b6-2cf2-46ab-94dd-6432feb82c6f tempest-VolumesListTestJSON-1845005127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (303ea8bc-2f70-4693-810a-ca4d8713fdfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:46:16 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c3c198b6-2cf2-46ab-94dd-6432feb82c6f tempest-VolumesListTestJSON-1845005127 None] Flow 'volume_create_manager' (5810f32c-6c1e-4711-bf35-460f7b7cd129) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:46:16 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-c3c198b6-2cf2-46ab-94dd-6432feb82c6f tempest-VolumesListTestJSON-1845005127 None] Created volume successfully.
Jul 09 14:46:17 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-36670b40-cbaa-4eee-a21c-fea73f839878 tempest-VolumesListTestJSON-1845005127 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:46:17 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-36670b40-cbaa-4eee-a21c-fea73f839878 tempest-VolumesListTestJSON-1845005127 None] Flow 'volume_create_manager' (f9e725cb-2f56-4fa7-a837-59531695bc88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:46:17 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-36670b40-cbaa-4eee-a21c-fea73f839878 tempest-VolumesListTestJSON-1845005127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53620a04-4ea8-4fbc-abf5-08dbce05a729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:46:17 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-36670b40-cbaa-4eee-a21c-fea73f839878 tempest-VolumesListTestJSON-1845005127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53620a04-4ea8-4fbc-abf5-08dbce05a729) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:46:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1383119010',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d146daf9-ab79-49a8-8e4a-828fe731ed9b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='12b727e69be54464b3f7176bb1c3610e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:46:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:46:17Z,use_quota=True,user_id='d1105087f80a45c1851f9f5100a8f7d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:46:17 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-36670b40-cbaa-4eee-a21c-fea73f839878 tempest-VolumesListTestJSON-1845005127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46f1481d-03b0-407b-9820-19809d5ff3d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:46:17 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-36670b40-cbaa-4eee-a21c-fea73f839878 tempest-VolumesListTestJSON-1845005127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46f1481d-03b0-407b-9820-19809d5ff3d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:46:17 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-36670b40-cbaa-4eee-a21c-fea73f839878 tempest-VolumesListTestJSON-1845005127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf051345-c251-4740-ae2c-ab761ee851be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:46:17 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-36670b40-cbaa-4eee-a21c-fea73f839878 tempest-VolumesListTestJSON-1845005127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf051345-c251-4740-ae2c-ab761ee851be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd146daf9-ab79-49a8-8e4a-828fe731ed9b', 'volume_name': 'volume-d146daf9-ab79-49a8-8e4a-828fe731ed9b', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:46:17 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-36670b40-cbaa-4eee-a21c-fea73f839878 tempest-VolumesListTestJSON-1845005127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5189e42d-d998-4a3e-adc1-37aac9286dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:46:17 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-36670b40-cbaa-4eee-a21c-fea73f839878 tempest-VolumesListTestJSON-1845005127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5189e42d-d998-4a3e-adc1-37aac9286dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:46:17 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-36670b40-cbaa-4eee-a21c-fea73f839878 tempest-VolumesListTestJSON-1845005127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8c13f65-b994-4edf-a324-114ec06a5491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:46:17 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-36670b40-cbaa-4eee-a21c-fea73f839878 tempest-VolumesListTestJSON-1845005127 None] Volume d146daf9-ab79-49a8-8e4a-828fe731ed9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d146daf9-ab79-49a8-8e4a-828fe731ed9b', 'volume_size': 1}
Jul 09 14:46:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-36670b40-cbaa-4eee-a21c-fea73f839878 tempest-VolumesListTestJSON-1845005127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:46:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-36670b40-cbaa-4eee-a21c-fea73f839878 tempest-VolumesListTestJSON-1845005127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:46:17 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-36670b40-cbaa-4eee-a21c-fea73f839878 tempest-VolumesListTestJSON-1845005127 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:46:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1383119010',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d146daf9-ab79-49a8-8e4a-828fe731ed9b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='12b727e69be54464b3f7176bb1c3610e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:46:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:46:17Z,use_quota=True,user_id='d1105087f80a45c1851f9f5100a8f7d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:46:17 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-36670b40-cbaa-4eee-a21c-fea73f839878 tempest-VolumesListTestJSON-1845005127 None] Creating volume d146daf9-ab79-49a8-8e4a-828fe731ed9b {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:46:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-36670b40-cbaa-4eee-a21c-fea73f839878 tempest-VolumesListTestJSON-1845005127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:46:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-36670b40-cbaa-4eee-a21c-fea73f839878 tempest-VolumesListTestJSON-1845005127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:46:17 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-36670b40-cbaa-4eee-a21c-fea73f839878 tempest-VolumesListTestJSON-1845005127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:46:17 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-36670b40-cbaa-4eee-a21c-fea73f839878 tempest-VolumesListTestJSON-1845005127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:46:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-36670b40-cbaa-4eee-a21c-fea73f839878 tempest-VolumesListTestJSON-1845005127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:46:17 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-36670b40-cbaa-4eee-a21c-fea73f839878 tempest-VolumesListTestJSON-1845005127 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:46:17 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-36670b40-cbaa-4eee-a21c-fea73f839878 tempest-VolumesListTestJSON-1845005127 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:46:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-36670b40-cbaa-4eee-a21c-fea73f839878 tempest-VolumesListTestJSON-1845005127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d146daf9-ab79-49a8-8e4a-828fe731ed9b 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:46:17 devstack sudo[101958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d146daf9-ab79-49a8-8e4a-828fe731ed9b 1073741824
Jul 09 14:46:17 devstack sudo[101958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:46:18 devstack sudo[101958]: pam_unix(sudo:session): session closed for user root
Jul 09 14:46:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-36670b40-cbaa-4eee-a21c-fea73f839878 tempest-VolumesListTestJSON-1845005127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d146daf9-ab79-49a8-8e4a-828fe731ed9b 1073741824" returned: 0 in 1.361s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:46:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-36670b40-cbaa-4eee-a21c-fea73f839878 tempest-VolumesListTestJSON-1845005127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d146daf9-ab79-49a8-8e4a-828fe731ed9b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:46:19 devstack sudo[101966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d146daf9-ab79-49a8-8e4a-828fe731ed9b
Jul 09 14:46:19 devstack sudo[101966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:46:19 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6359117-c01f-4336-af76-67719f096c23 tempest-TestMinimumBasicScenario-277009565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:46:19 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c6359117-c01f-4336-af76-67719f096c23 tempest-TestMinimumBasicScenario-277009565 None] Flow 'volume_create_manager' (a6a62b44-9dd7-4233-bd6b-56c285851391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:46:19 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c6359117-c01f-4336-af76-67719f096c23 tempest-TestMinimumBasicScenario-277009565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17828045-e46e-47bd-8b14-e3a7bdb76f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:46:19 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c6359117-c01f-4336-af76-67719f096c23 tempest-TestMinimumBasicScenario-277009565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17828045-e46e-47bd-8b14-e3a7bdb76f9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:46:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-967544840',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d0220f5-d7e5-4378-90ee-aed36701908a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54218efeedd54198b5158ebfb8e0d168',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:46:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:46:19Z,use_quota=True,user_id='e3881fc99d7b49c6acd80b0cdbb25c14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:46:19 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c6359117-c01f-4336-af76-67719f096c23 tempest-TestMinimumBasicScenario-277009565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4549e604-0f30-4c77-acdb-ce5380fc71a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:46:19 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c6359117-c01f-4336-af76-67719f096c23 tempest-TestMinimumBasicScenario-277009565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4549e604-0f30-4c77-acdb-ce5380fc71a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:46:19 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c6359117-c01f-4336-af76-67719f096c23 tempest-TestMinimumBasicScenario-277009565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04ad55e6-866d-47ad-a47b-5dc2d69bc148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:46:19 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c6359117-c01f-4336-af76-67719f096c23 tempest-TestMinimumBasicScenario-277009565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04ad55e6-866d-47ad-a47b-5dc2d69bc148) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d0220f5-d7e5-4378-90ee-aed36701908a', 'volume_name': 'volume-3d0220f5-d7e5-4378-90ee-aed36701908a', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:46:19 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c6359117-c01f-4336-af76-67719f096c23 tempest-TestMinimumBasicScenario-277009565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (611c611d-79af-475c-95ea-660e4b0192a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:46:19 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c6359117-c01f-4336-af76-67719f096c23 tempest-TestMinimumBasicScenario-277009565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (611c611d-79af-475c-95ea-660e4b0192a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:46:19 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c6359117-c01f-4336-af76-67719f096c23 tempest-TestMinimumBasicScenario-277009565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e447c225-2068-40de-bef7-af6cf33f8e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:46:19 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-c6359117-c01f-4336-af76-67719f096c23 tempest-TestMinimumBasicScenario-277009565 None] Volume 3d0220f5-d7e5-4378-90ee-aed36701908a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d0220f5-d7e5-4378-90ee-aed36701908a', 'volume_size': 1}
Jul 09 14:46:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c6359117-c01f-4336-af76-67719f096c23 tempest-TestMinimumBasicScenario-277009565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:46:19 devstack sudo[101966]: pam_unix(sudo:session): session closed for user root
Jul 09 14:46:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-36670b40-cbaa-4eee-a21c-fea73f839878 tempest-VolumesListTestJSON-1845005127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d146daf9-ab79-49a8-8e4a-828fe731ed9b" returned: 0 in 0.798s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:46:19 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-36670b40-cbaa-4eee-a21c-fea73f839878 tempest-VolumesListTestJSON-1845005127 None] <== create_volume: return (2239ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:46:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-36670b40-cbaa-4eee-a21c-fea73f839878 tempest-VolumesListTestJSON-1845005127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.242s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:46:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c6359117-c01f-4336-af76-67719f096c23 tempest-TestMinimumBasicScenario-277009565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.337s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:46:19 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-c6359117-c01f-4336-af76-67719f096c23 tempest-TestMinimumBasicScenario-277009565 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:46:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-967544840',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d0220f5-d7e5-4378-90ee-aed36701908a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54218efeedd54198b5158ebfb8e0d168',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:46:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:46:19Z,use_quota=True,user_id='e3881fc99d7b49c6acd80b0cdbb25c14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:46:19 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-c6359117-c01f-4336-af76-67719f096c23 tempest-TestMinimumBasicScenario-277009565 None] Creating volume 3d0220f5-d7e5-4378-90ee-aed36701908a {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:46:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c6359117-c01f-4336-af76-67719f096c23 tempest-TestMinimumBasicScenario-277009565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:46:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c6359117-c01f-4336-af76-67719f096c23 tempest-TestMinimumBasicScenario-277009565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:46:19 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-c6359117-c01f-4336-af76-67719f096c23 tempest-TestMinimumBasicScenario-277009565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:46:19 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-c6359117-c01f-4336-af76-67719f096c23 tempest-TestMinimumBasicScenario-277009565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:46:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c6359117-c01f-4336-af76-67719f096c23 tempest-TestMinimumBasicScenario-277009565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:46:19 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-c6359117-c01f-4336-af76-67719f096c23 tempest-TestMinimumBasicScenario-277009565 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:46:19 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-c6359117-c01f-4336-af76-67719f096c23 tempest-TestMinimumBasicScenario-277009565 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:46:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c6359117-c01f-4336-af76-67719f096c23 tempest-TestMinimumBasicScenario-277009565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-3d0220f5-d7e5-4378-90ee-aed36701908a 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:46:19 devstack sudo[101973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-3d0220f5-d7e5-4378-90ee-aed36701908a 1073741824
Jul 09 14:46:19 devstack sudo[101973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:46:19 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-36670b40-cbaa-4eee-a21c-fea73f839878 tempest-VolumesListTestJSON-1845005127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8c13f65-b994-4edf-a324-114ec06a5491) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d146daf9-ab79-49a8-8e4a-828fe731ed9b', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:46:19 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-36670b40-cbaa-4eee-a21c-fea73f839878 tempest-VolumesListTestJSON-1845005127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dbc054d-5d98-4042-a7e9-8018d774943d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:46:19 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-36670b40-cbaa-4eee-a21c-fea73f839878 tempest-VolumesListTestJSON-1845005127 None] Volume volume-d146daf9-ab79-49a8-8e4a-828fe731ed9b (d146daf9-ab79-49a8-8e4a-828fe731ed9b): created successfully
Jul 09 14:46:19 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-36670b40-cbaa-4eee-a21c-fea73f839878 tempest-VolumesListTestJSON-1845005127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dbc054d-5d98-4042-a7e9-8018d774943d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:46:19 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-36670b40-cbaa-4eee-a21c-fea73f839878 tempest-VolumesListTestJSON-1845005127 None] Flow 'volume_create_manager' (f9e725cb-2f56-4fa7-a837-59531695bc88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:46:19 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-36670b40-cbaa-4eee-a21c-fea73f839878 tempest-VolumesListTestJSON-1845005127 None] Created volume successfully.
Jul 09 14:46:21 devstack sudo[101973]: pam_unix(sudo:session): session closed for user root
Jul 09 14:46:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c6359117-c01f-4336-af76-67719f096c23 tempest-TestMinimumBasicScenario-277009565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-3d0220f5-d7e5-4378-90ee-aed36701908a 1073741824" returned: 0 in 1.322s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:46:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c6359117-c01f-4336-af76-67719f096c23 tempest-TestMinimumBasicScenario-277009565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-3d0220f5-d7e5-4378-90ee-aed36701908a {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:46:21 devstack sudo[102000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-3d0220f5-d7e5-4378-90ee-aed36701908a
Jul 09 14:46:21 devstack sudo[102000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:46:22 devstack sudo[102000]: pam_unix(sudo:session): session closed for user root
Jul 09 14:46:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c6359117-c01f-4336-af76-67719f096c23 tempest-TestMinimumBasicScenario-277009565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-3d0220f5-d7e5-4378-90ee-aed36701908a" returned: 0 in 0.890s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:46:22 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-c6359117-c01f-4336-af76-67719f096c23 tempest-TestMinimumBasicScenario-277009565 None] <== create_volume: return (2308ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:46:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c6359117-c01f-4336-af76-67719f096c23 tempest-TestMinimumBasicScenario-277009565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.311s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:46:22 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c6359117-c01f-4336-af76-67719f096c23 tempest-TestMinimumBasicScenario-277009565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e447c225-2068-40de-bef7-af6cf33f8e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d0220f5-d7e5-4378-90ee-aed36701908a', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:46:22 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c6359117-c01f-4336-af76-67719f096c23 tempest-TestMinimumBasicScenario-277009565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b151d828-8ddf-4fb6-b69c-76306b86be8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:46:22 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-c6359117-c01f-4336-af76-67719f096c23 tempest-TestMinimumBasicScenario-277009565 None] Volume volume-3d0220f5-d7e5-4378-90ee-aed36701908a (3d0220f5-d7e5-4378-90ee-aed36701908a): created successfully
Jul 09 14:46:22 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c6359117-c01f-4336-af76-67719f096c23 tempest-TestMinimumBasicScenario-277009565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b151d828-8ddf-4fb6-b69c-76306b86be8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:46:22 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c6359117-c01f-4336-af76-67719f096c23 tempest-TestMinimumBasicScenario-277009565 None] Flow 'volume_create_manager' (a6a62b44-9dd7-4233-bd6b-56c285851391) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:46:22 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-c6359117-c01f-4336-af76-67719f096c23 tempest-TestMinimumBasicScenario-277009565 None] Created volume successfully.
Jul 09 14:46:22 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-9f367e87-24de-4dfd-b00a-aa92ff79fcc9 req-debefb45-f269-424a-b5d8-2fa7d394ee17 tempest-TestShelveInstance-1427794981 None] Terminate volume connection completed successfully.
Jul 09 14:46:22 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-9f367e87-24de-4dfd-b00a-aa92ff79fcc9 req-debefb45-f269-424a-b5d8-2fa7d394ee17 tempest-TestShelveInstance-1427794981 None] Deleting attachment 568a12e1-53de-44a1-9f5e-1c2c330bfa31. {{(pid=87230) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 09 14:46:23 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-59c4b572-ff0b-4797-8b40-28d40135e081 tempest-VolumesListTestJSON-1845005127 None] Acquiring lock "cinder-d146daf9-ab79-49a8-8e4a-828fe731ed9b-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:46:23 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-59c4b572-ff0b-4797-8b40-28d40135e081 tempest-VolumesListTestJSON-1845005127 None] Lock "cinder-d146daf9-ab79-49a8-8e4a-828fe731ed9b-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:46:23 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-59c4b572-ff0b-4797-8b40-28d40135e081 tempest-VolumesListTestJSON-1845005127 None] Acquiring lock "cinder-quobyte-d146daf9-ab79-49a8-8e4a-828fe731ed9b" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:46:23 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-59c4b572-ff0b-4797-8b40-28d40135e081 tempest-VolumesListTestJSON-1845005127 None] Lock "cinder-quobyte-d146daf9-ab79-49a8-8e4a-828fe731ed9b" acquired by "delete_volume" :: waited 0.021s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:46:23 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[11882d1f-32e5-4370-9422-f7c706b5fbda]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:46:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-59c4b572-ff0b-4797-8b40-28d40135e081 tempest-VolumesListTestJSON-1845005127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d146daf9-ab79-49a8-8e4a-828fe731ed9b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:46:23 devstack cinder-volume[87230]: DEBUG cinder.coordination [req-9f367e87-24de-4dfd-b00a-aa92ff79fcc9 req-176338a0-440e-4dec-9161-b334d3e13535 tempest-TestShelveInstance-1427794981 None] Acquiring lock "cinder-cda2942f-b3a7-4c7a-a361-bd744f42b5b2-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:46:23 devstack cinder-volume[87230]: DEBUG cinder.coordination [req-9f367e87-24de-4dfd-b00a-aa92ff79fcc9 req-176338a0-440e-4dec-9161-b334d3e13535 tempest-TestShelveInstance-1427794981 None] Lock "cinder-cda2942f-b3a7-4c7a-a361-bd744f42b5b2-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:46:23 devstack sudo[102007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d146daf9-ab79-49a8-8e4a-828fe731ed9b
Jul 09 14:46:23 devstack sudo[102007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:46:23 devstack cinder-volume[87230]: DEBUG cinder.coordination [req-9f367e87-24de-4dfd-b00a-aa92ff79fcc9 req-176338a0-440e-4dec-9161-b334d3e13535 tempest-TestShelveInstance-1427794981 None] Acquiring lock "cinder-quobyte-cda2942f-b3a7-4c7a-a361-bd744f42b5b2" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:46:23 devstack cinder-volume[87230]: DEBUG cinder.coordination [req-9f367e87-24de-4dfd-b00a-aa92ff79fcc9 req-176338a0-440e-4dec-9161-b334d3e13535 tempest-TestShelveInstance-1427794981 None] Lock "cinder-quobyte-cda2942f-b3a7-4c7a-a361-bd744f42b5b2" acquired by "delete_volume" :: waited 0.031s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:46:23 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead6e9b8-d751-473a-be8e-e376db0efed9]: (4, 'raw') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:46:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-9f367e87-24de-4dfd-b00a-aa92ff79fcc9 req-176338a0-440e-4dec-9161-b334d3e13535 tempest-TestShelveInstance-1427794981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-cda2942f-b3a7-4c7a-a361-bd744f42b5b2 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:46:23 devstack sudo[102009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-cda2942f-b3a7-4c7a-a361-bd744f42b5b2
Jul 09 14:46:23 devstack sudo[102009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:46:24 devstack sudo[102007]: pam_unix(sudo:session): session closed for user root
Jul 09 14:46:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-59c4b572-ff0b-4797-8b40-28d40135e081 tempest-VolumesListTestJSON-1845005127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d146daf9-ab79-49a8-8e4a-828fe731ed9b" returned: 0 in 0.871s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:46:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-59c4b572-ff0b-4797-8b40-28d40135e081 tempest-VolumesListTestJSON-1845005127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d146daf9-ab79-49a8-8e4a-828fe731ed9b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:46:24 devstack sudo[102014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d146daf9-ab79-49a8-8e4a-828fe731ed9b
Jul 09 14:46:24 devstack sudo[102014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:46:24 devstack sudo[102009]: pam_unix(sudo:session): session closed for user root
Jul 09 14:46:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-9f367e87-24de-4dfd-b00a-aa92ff79fcc9 req-176338a0-440e-4dec-9161-b334d3e13535 tempest-TestShelveInstance-1427794981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-cda2942f-b3a7-4c7a-a361-bd744f42b5b2" returned: 0 in 0.915s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:46:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-9f367e87-24de-4dfd-b00a-aa92ff79fcc9 req-176338a0-440e-4dec-9161-b334d3e13535 tempest-TestShelveInstance-1427794981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-cda2942f-b3a7-4c7a-a361-bd744f42b5b2 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:46:24 devstack sudo[102018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-cda2942f-b3a7-4c7a-a361-bd744f42b5b2
Jul 09 14:46:24 devstack sudo[102018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:46:25 devstack sudo[102014]: pam_unix(sudo:session): session closed for user root
Jul 09 14:46:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-59c4b572-ff0b-4797-8b40-28d40135e081 tempest-VolumesListTestJSON-1845005127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d146daf9-ab79-49a8-8e4a-828fe731ed9b" returned: 0 in 0.917s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:46:25 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-59c4b572-ff0b-4797-8b40-28d40135e081 tempest-VolumesListTestJSON-1845005127 None] Lock "cinder-quobyte-d146daf9-ab79-49a8-8e4a-828fe731ed9b" released by "delete_volume" :: held 1.834s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:46:25 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-59c4b572-ff0b-4797-8b40-28d40135e081 tempest-VolumesListTestJSON-1845005127 None] Created reservations ['f2bd22a3-346c-46b0-8928-5560b0aaf13a', '4f81265e-598c-45ab-836f-dcf5f63b3e63', '7dc5a55d-971f-4a61-a6c0-015edc5d46ab', '825ba54f-2e9e-4027-8832-d8546f871646'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:46:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-59c4b572-ff0b-4797-8b40-28d40135e081 tempest-VolumesListTestJSON-1845005127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:46:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-59c4b572-ff0b-4797-8b40-28d40135e081 tempest-VolumesListTestJSON-1845005127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:46:25 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-59c4b572-ff0b-4797-8b40-28d40135e081 tempest-VolumesListTestJSON-1845005127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:46:25 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-59c4b572-ff0b-4797-8b40-28d40135e081 tempest-VolumesListTestJSON-1845005127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:46:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-59c4b572-ff0b-4797-8b40-28d40135e081 tempest-VolumesListTestJSON-1845005127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:46:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-59c4b572-ff0b-4797-8b40-28d40135e081 tempest-VolumesListTestJSON-1845005127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:46:25 devstack sudo[102021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:46:25 devstack sudo[102021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:46:25 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-fd5e71b2-31eb-4843-b29e-adaaefb3f105 tempest-VolumesListTestJSON-1845005127 None] Acquiring lock "cinder-9121c0fc-0ddb-4b23-872c-2816d2f7dcbf-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:46:25 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-fd5e71b2-31eb-4843-b29e-adaaefb3f105 tempest-VolumesListTestJSON-1845005127 None] Lock "cinder-9121c0fc-0ddb-4b23-872c-2816d2f7dcbf-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:46:25 devstack sudo[102018]: pam_unix(sudo:session): session closed for user root
Jul 09 14:46:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-9f367e87-24de-4dfd-b00a-aa92ff79fcc9 req-176338a0-440e-4dec-9161-b334d3e13535 tempest-TestShelveInstance-1427794981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-cda2942f-b3a7-4c7a-a361-bd744f42b5b2" returned: 1 in 1.101s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:46:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-9f367e87-24de-4dfd-b00a-aa92ff79fcc9 req-176338a0-440e-4dec-9161-b334d3e13535 tempest-TestShelveInstance-1427794981 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-cda2942f-b3a7-4c7a-a361-bd744f42b5b2' failed. Not Retrying. {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 09 14:46:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-9f367e87-24de-4dfd-b00a-aa92ff79fcc9 req-176338a0-440e-4dec-9161-b334d3e13535 tempest-TestShelveInstance-1427794981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-cda2942f-b3a7-4c7a-a361-bd744f42b5b2 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:46:25 devstack sudo[102031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-cda2942f-b3a7-4c7a-a361-bd744f42b5b2
Jul 09 14:46:25 devstack sudo[102031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:46:25 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-fd5e71b2-31eb-4843-b29e-adaaefb3f105 tempest-VolumesListTestJSON-1845005127 None] Acquiring lock "cinder-quobyte-9121c0fc-0ddb-4b23-872c-2816d2f7dcbf" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:46:25 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-fd5e71b2-31eb-4843-b29e-adaaefb3f105 tempest-VolumesListTestJSON-1845005127 None] Lock "cinder-quobyte-9121c0fc-0ddb-4b23-872c-2816d2f7dcbf" acquired by "delete_volume" :: waited 0.047s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:46:26 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[1840b0c2-9911-4ac7-90c1-d086f18f384e]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:46:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fd5e71b2-31eb-4843-b29e-adaaefb3f105 tempest-VolumesListTestJSON-1845005127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-9121c0fc-0ddb-4b23-872c-2816d2f7dcbf {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:46:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-84fdc540-0fee-4e14-a095-caa8cdc2b03d req-94ab9756-0548-4f05-b29b-18df6800dc02 tempest-TestMinimumBasicScenario-277009565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:46:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-84fdc540-0fee-4e14-a095-caa8cdc2b03d req-94ab9756-0548-4f05-b29b-18df6800dc02 tempest-TestMinimumBasicScenario-277009565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:46:26 devstack sudo[102036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-9121c0fc-0ddb-4b23-872c-2816d2f7dcbf
Jul 09 14:46:26 devstack sudo[102036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:46:26 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd58e0a-7c1b-4e55-bbd2-adb00dce232d]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:46:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-84fdc540-0fee-4e14-a095-caa8cdc2b03d req-94ab9756-0548-4f05-b29b-18df6800dc02 tempest-TestMinimumBasicScenario-277009565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-3d0220f5-d7e5-4378-90ee-aed36701908a {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:46:26 devstack sudo[102038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-3d0220f5-d7e5-4378-90ee-aed36701908a
Jul 09 14:46:26 devstack sudo[102038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:46:26 devstack sudo[102021]: pam_unix(sudo:session): session closed for user root
Jul 09 14:46:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-59c4b572-ff0b-4797-8b40-28d40135e081 tempest-VolumesListTestJSON-1845005127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 1.184s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:46:26 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-59c4b572-ff0b-4797-8b40-28d40135e081 tempest-VolumesListTestJSON-1845005127 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:46:26 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-59c4b572-ff0b-4797-8b40-28d40135e081 tempest-VolumesListTestJSON-1845005127 None] Deleted volume successfully.
Jul 09 14:46:26 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-59c4b572-ff0b-4797-8b40-28d40135e081 tempest-VolumesListTestJSON-1845005127 None] Lock "cinder-d146daf9-ab79-49a8-8e4a-828fe731ed9b-delete_volume" released by "delete_volume" :: held 3.380s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:46:27 devstack sudo[102031]: pam_unix(sudo:session): session closed for user root
Jul 09 14:46:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-9f367e87-24de-4dfd-b00a-aa92ff79fcc9 req-176338a0-440e-4dec-9161-b334d3e13535 tempest-TestShelveInstance-1427794981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-cda2942f-b3a7-4c7a-a361-bd744f42b5b2" returned: 0 in 1.583s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:46:27 devstack cinder-volume[87230]: DEBUG cinder.coordination [req-9f367e87-24de-4dfd-b00a-aa92ff79fcc9 req-176338a0-440e-4dec-9161-b334d3e13535 tempest-TestShelveInstance-1427794981 None] Lock "cinder-quobyte-cda2942f-b3a7-4c7a-a361-bd744f42b5b2" released by "delete_volume" :: held 3.697s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:46:27 devstack cinder-volume[87230]: DEBUG cinder.quota [req-9f367e87-24de-4dfd-b00a-aa92ff79fcc9 req-176338a0-440e-4dec-9161-b334d3e13535 tempest-TestShelveInstance-1427794981 None] Created reservations ['b908bcb5-65e1-4d10-b81d-5ab772d01dfa', 'd4336dd3-9364-40e2-ab0a-c8684f55d50c', 'f0d0f33c-613a-46a3-8bcd-d23882f4a2fe', 'd48afcc4-d694-4872-9f1e-71b58340c77f'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:46:27 devstack sudo[102036]: pam_unix(sudo:session): session closed for user root
Jul 09 14:46:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fd5e71b2-31eb-4843-b29e-adaaefb3f105 tempest-VolumesListTestJSON-1845005127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-9121c0fc-0ddb-4b23-872c-2816d2f7dcbf" returned: 0 in 1.491s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:46:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fd5e71b2-31eb-4843-b29e-adaaefb3f105 tempest-VolumesListTestJSON-1845005127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-9121c0fc-0ddb-4b23-872c-2816d2f7dcbf {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:46:27 devstack sudo[102045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-9121c0fc-0ddb-4b23-872c-2816d2f7dcbf
Jul 09 14:46:27 devstack sudo[102045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:46:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-9f367e87-24de-4dfd-b00a-aa92ff79fcc9 req-176338a0-440e-4dec-9161-b334d3e13535 tempest-TestShelveInstance-1427794981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:46:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-9f367e87-24de-4dfd-b00a-aa92ff79fcc9 req-176338a0-440e-4dec-9161-b334d3e13535 tempest-TestShelveInstance-1427794981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:46:27 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [req-9f367e87-24de-4dfd-b00a-aa92ff79fcc9 req-176338a0-440e-4dec-9161-b334d3e13535 tempest-TestShelveInstance-1427794981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:46:27 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [req-9f367e87-24de-4dfd-b00a-aa92ff79fcc9 req-176338a0-440e-4dec-9161-b334d3e13535 tempest-TestShelveInstance-1427794981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:46:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-9f367e87-24de-4dfd-b00a-aa92ff79fcc9 req-176338a0-440e-4dec-9161-b334d3e13535 tempest-TestShelveInstance-1427794981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:46:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-9f367e87-24de-4dfd-b00a-aa92ff79fcc9 req-176338a0-440e-4dec-9161-b334d3e13535 tempest-TestShelveInstance-1427794981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:46:27 devstack sudo[102050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:46:27 devstack sudo[102050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:46:27 devstack sudo[102038]: pam_unix(sudo:session): session closed for user root
Jul 09 14:46:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-84fdc540-0fee-4e14-a095-caa8cdc2b03d req-94ab9756-0548-4f05-b29b-18df6800dc02 tempest-TestMinimumBasicScenario-277009565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-3d0220f5-d7e5-4378-90ee-aed36701908a" returned: 0 in 1.580s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:46:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-84fdc540-0fee-4e14-a095-caa8cdc2b03d req-94ab9756-0548-4f05-b29b-18df6800dc02 tempest-TestMinimumBasicScenario-277009565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.617s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:46:27 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-84fdc540-0fee-4e14-a095-caa8cdc2b03d req-94ab9756-0548-4f05-b29b-18df6800dc02 tempest-TestMinimumBasicScenario-277009565 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653', 'name': 'volume-3d0220f5-d7e5-4378-90ee-aed36701908a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '378ca67b-b864-4cc6-b252-eedc87181577', 'enforce_multipath': True} {{(pid=87230) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 09 14:46:28 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-84fdc540-0fee-4e14-a095-caa8cdc2b03d req-94ab9756-0548-4f05-b29b-18df6800dc02 tempest-TestMinimumBasicScenario-277009565 None] attachment_update completed successfully.
Jul 09 14:46:28 devstack sudo[102045]: pam_unix(sudo:session): session closed for user root
Jul 09 14:46:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fd5e71b2-31eb-4843-b29e-adaaefb3f105 tempest-VolumesListTestJSON-1845005127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-9121c0fc-0ddb-4b23-872c-2816d2f7dcbf" returned: 0 in 0.919s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:46:28 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-fd5e71b2-31eb-4843-b29e-adaaefb3f105 tempest-VolumesListTestJSON-1845005127 None] Lock "cinder-quobyte-9121c0fc-0ddb-4b23-872c-2816d2f7dcbf" released by "delete_volume" :: held 2.514s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:46:28 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-fd5e71b2-31eb-4843-b29e-adaaefb3f105 tempest-VolumesListTestJSON-1845005127 None] Created reservations ['2cd0b489-78c4-429f-ab6b-709a9a42ba08', 'd8f88584-f2cc-4293-92e7-2955d5d179dc', 'a3f8579c-46a3-4d50-a660-f57b130861f4', 'a2b422a5-d60d-492d-933b-d628dd418175'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:46:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-fd5e71b2-31eb-4843-b29e-adaaefb3f105 tempest-VolumesListTestJSON-1845005127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:46:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-fd5e71b2-31eb-4843-b29e-adaaefb3f105 tempest-VolumesListTestJSON-1845005127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:46:28 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-fd5e71b2-31eb-4843-b29e-adaaefb3f105 tempest-VolumesListTestJSON-1845005127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:46:28 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-fd5e71b2-31eb-4843-b29e-adaaefb3f105 tempest-VolumesListTestJSON-1845005127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:46:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-fd5e71b2-31eb-4843-b29e-adaaefb3f105 tempest-VolumesListTestJSON-1845005127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:46:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fd5e71b2-31eb-4843-b29e-adaaefb3f105 tempest-VolumesListTestJSON-1845005127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:46:28 devstack sudo[102138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:46:28 devstack sudo[102138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:46:28 devstack sudo[102050]: pam_unix(sudo:session): session closed for user root
Jul 09 14:46:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-9f367e87-24de-4dfd-b00a-aa92ff79fcc9 req-176338a0-440e-4dec-9161-b334d3e13535 tempest-TestShelveInstance-1427794981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 1.085s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:46:28 devstack cinder-volume[87230]: DEBUG cinder.manager [req-9f367e87-24de-4dfd-b00a-aa92ff79fcc9 req-176338a0-440e-4dec-9161-b334d3e13535 tempest-TestShelveInstance-1427794981 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:46:28 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-9f367e87-24de-4dfd-b00a-aa92ff79fcc9 req-176338a0-440e-4dec-9161-b334d3e13535 tempest-TestShelveInstance-1427794981 None] Deleted volume successfully.
Jul 09 14:46:28 devstack cinder-volume[87230]: DEBUG cinder.coordination [req-9f367e87-24de-4dfd-b00a-aa92ff79fcc9 req-176338a0-440e-4dec-9161-b334d3e13535 tempest-TestShelveInstance-1427794981 None] Lock "cinder-cda2942f-b3a7-4c7a-a361-bd744f42b5b2-delete_volume" released by "delete_volume" :: held 5.164s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:46:29 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7a4eca21-9581-44a7-9930-0e8ec8d6d156 tempest-VolumesListTestJSON-1845005127 None] Acquiring lock "cinder-a85f50e7-62c4-4044-8ddf-0b613d6ff8f6-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:46:29 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7a4eca21-9581-44a7-9930-0e8ec8d6d156 tempest-VolumesListTestJSON-1845005127 None] Lock "cinder-a85f50e7-62c4-4044-8ddf-0b613d6ff8f6-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:46:29 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7a4eca21-9581-44a7-9930-0e8ec8d6d156 tempest-VolumesListTestJSON-1845005127 None] Acquiring lock "cinder-quobyte-a85f50e7-62c4-4044-8ddf-0b613d6ff8f6" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:46:29 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7a4eca21-9581-44a7-9930-0e8ec8d6d156 tempest-VolumesListTestJSON-1845005127 None] Lock "cinder-quobyte-a85f50e7-62c4-4044-8ddf-0b613d6ff8f6" acquired by "delete_volume" :: waited 0.029s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:46:29 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[af2251df-0c75-45a8-bf20-87bcb097fce8]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:46:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7a4eca21-9581-44a7-9930-0e8ec8d6d156 tempest-VolumesListTestJSON-1845005127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a85f50e7-62c4-4044-8ddf-0b613d6ff8f6 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:46:29 devstack sudo[102138]: pam_unix(sudo:session): session closed for user root
Jul 09 14:46:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fd5e71b2-31eb-4843-b29e-adaaefb3f105 tempest-VolumesListTestJSON-1845005127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.854s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:46:29 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-fd5e71b2-31eb-4843-b29e-adaaefb3f105 tempest-VolumesListTestJSON-1845005127 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:46:29 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-fd5e71b2-31eb-4843-b29e-adaaefb3f105 tempest-VolumesListTestJSON-1845005127 None] Deleted volume successfully.
Jul 09 14:46:29 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-fd5e71b2-31eb-4843-b29e-adaaefb3f105 tempest-VolumesListTestJSON-1845005127 None] Lock "cinder-9121c0fc-0ddb-4b23-872c-2816d2f7dcbf-delete_volume" released by "delete_volume" :: held 3.769s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:46:29 devstack sudo[102457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a85f50e7-62c4-4044-8ddf-0b613d6ff8f6
Jul 09 14:46:29 devstack sudo[102457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:46:30 devstack sudo[102457]: pam_unix(sudo:session): session closed for user root
Jul 09 14:46:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7a4eca21-9581-44a7-9930-0e8ec8d6d156 tempest-VolumesListTestJSON-1845005127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a85f50e7-62c4-4044-8ddf-0b613d6ff8f6" returned: 0 in 0.798s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:46:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7a4eca21-9581-44a7-9930-0e8ec8d6d156 tempest-VolumesListTestJSON-1845005127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a85f50e7-62c4-4044-8ddf-0b613d6ff8f6 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:46:30 devstack sudo[102462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a85f50e7-62c4-4044-8ddf-0b613d6ff8f6
Jul 09 14:46:30 devstack sudo[102462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:46:31 devstack sudo[102462]: pam_unix(sudo:session): session closed for user root
Jul 09 14:46:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7a4eca21-9581-44a7-9930-0e8ec8d6d156 tempest-VolumesListTestJSON-1845005127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a85f50e7-62c4-4044-8ddf-0b613d6ff8f6" returned: 0 in 0.711s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:46:31 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7a4eca21-9581-44a7-9930-0e8ec8d6d156 tempest-VolumesListTestJSON-1845005127 None] Lock "cinder-quobyte-a85f50e7-62c4-4044-8ddf-0b613d6ff8f6" released by "delete_volume" :: held 1.577s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:46:31 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-7a4eca21-9581-44a7-9930-0e8ec8d6d156 tempest-VolumesListTestJSON-1845005127 None] Created reservations ['9a0ac2b4-4bc1-4425-b2eb-4400cdd0e873', 'f583fe4e-7dbb-4163-a9d5-b50857167768', 'a47d7a41-73e5-4a69-84f7-f6e96d653433', '1eda914b-5c8d-45a3-81b8-42459dfef343'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:46:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7a4eca21-9581-44a7-9930-0e8ec8d6d156 tempest-VolumesListTestJSON-1845005127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:46:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7a4eca21-9581-44a7-9930-0e8ec8d6d156 tempest-VolumesListTestJSON-1845005127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:46:31 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7a4eca21-9581-44a7-9930-0e8ec8d6d156 tempest-VolumesListTestJSON-1845005127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:46:31 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7a4eca21-9581-44a7-9930-0e8ec8d6d156 tempest-VolumesListTestJSON-1845005127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:46:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7a4eca21-9581-44a7-9930-0e8ec8d6d156 tempest-VolumesListTestJSON-1845005127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:46:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7a4eca21-9581-44a7-9930-0e8ec8d6d156 tempest-VolumesListTestJSON-1845005127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:46:31 devstack sudo[102466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:46:31 devstack sudo[102466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:46:31 devstack sudo[102466]: pam_unix(sudo:session): session closed for user root
Jul 09 14:46:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7a4eca21-9581-44a7-9930-0e8ec8d6d156 tempest-VolumesListTestJSON-1845005127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.730s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:46:31 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-7a4eca21-9581-44a7-9930-0e8ec8d6d156 tempest-VolumesListTestJSON-1845005127 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:46:31 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-7a4eca21-9581-44a7-9930-0e8ec8d6d156 tempest-VolumesListTestJSON-1845005127 None] Deleted volume successfully.
Jul 09 14:46:31 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7a4eca21-9581-44a7-9930-0e8ec8d6d156 tempest-VolumesListTestJSON-1845005127 None] Lock "cinder-a85f50e7-62c4-4044-8ddf-0b613d6ff8f6-delete_volume" released by "delete_volume" :: held 2.587s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:46:41 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=36,cinder:UPDATE=40,cinder:INSERT=12,cinder:DELETE=5 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 14:46:41 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=32,cinder:UPDATE=50,cinder:INSERT=8,cinder:DELETE=3 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 14:46:43 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba2ac541-ddee-4ce3-bd6d-db31034f3e4d tempest-ProjectReaderTests-736709583 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:46:43 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ba2ac541-ddee-4ce3-bd6d-db31034f3e4d tempest-ProjectReaderTests-736709583 None] Flow 'volume_create_manager' (ac6ea9ba-a2a8-44b2-9454-5bcecd31def0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:46:43 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ba2ac541-ddee-4ce3-bd6d-db31034f3e4d tempest-ProjectReaderTests-736709583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a269f3c-8522-4240-94fd-7fd09ab9e375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:46:43 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ba2ac541-ddee-4ce3-bd6d-db31034f3e4d tempest-ProjectReaderTests-736709583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a269f3c-8522-4240-94fd-7fd09ab9e375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:46:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1095377915',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09d8d47b-d5d1-4c5a-86d4-f3f90048b002,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d9ee42bf5e342c48536dc6a80c892d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:46:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:46:44Z,use_quota=True,user_id='cbf40bf3e46641928059fedd8cdb018c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:46:43 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ba2ac541-ddee-4ce3-bd6d-db31034f3e4d tempest-ProjectReaderTests-736709583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2cf40be-fd00-458e-bead-26b069b0924b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:46:43 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ba2ac541-ddee-4ce3-bd6d-db31034f3e4d tempest-ProjectReaderTests-736709583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2cf40be-fd00-458e-bead-26b069b0924b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:46:43 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ba2ac541-ddee-4ce3-bd6d-db31034f3e4d tempest-ProjectReaderTests-736709583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1137fb7-15ac-4446-ae1a-832e4e303415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:46:43 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ba2ac541-ddee-4ce3-bd6d-db31034f3e4d tempest-ProjectReaderTests-736709583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1137fb7-15ac-4446-ae1a-832e4e303415) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09d8d47b-d5d1-4c5a-86d4-f3f90048b002', 'volume_name': 'volume-09d8d47b-d5d1-4c5a-86d4-f3f90048b002', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:46:43 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ba2ac541-ddee-4ce3-bd6d-db31034f3e4d tempest-ProjectReaderTests-736709583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d34f3bb-1f15-4f31-832c-1d6198519c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:46:43 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ba2ac541-ddee-4ce3-bd6d-db31034f3e4d tempest-ProjectReaderTests-736709583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d34f3bb-1f15-4f31-832c-1d6198519c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:46:43 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ba2ac541-ddee-4ce3-bd6d-db31034f3e4d tempest-ProjectReaderTests-736709583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f80949fc-43b9-4bd2-a978-cccf20669c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:46:43 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-ba2ac541-ddee-4ce3-bd6d-db31034f3e4d tempest-ProjectReaderTests-736709583 None] Volume 09d8d47b-d5d1-4c5a-86d4-f3f90048b002: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09d8d47b-d5d1-4c5a-86d4-f3f90048b002', 'volume_size': 1}
Jul 09 14:46:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-ba2ac541-ddee-4ce3-bd6d-db31034f3e4d tempest-ProjectReaderTests-736709583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:46:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-ba2ac541-ddee-4ce3-bd6d-db31034f3e4d tempest-ProjectReaderTests-736709583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:46:43 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-ba2ac541-ddee-4ce3-bd6d-db31034f3e4d tempest-ProjectReaderTests-736709583 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:46:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1095377915',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09d8d47b-d5d1-4c5a-86d4-f3f90048b002,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d9ee42bf5e342c48536dc6a80c892d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:46:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:46:44Z,use_quota=True,user_id='cbf40bf3e46641928059fedd8cdb018c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:46:43 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-ba2ac541-ddee-4ce3-bd6d-db31034f3e4d tempest-ProjectReaderTests-736709583 None] Creating volume 09d8d47b-d5d1-4c5a-86d4-f3f90048b002 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:46:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-ba2ac541-ddee-4ce3-bd6d-db31034f3e4d tempest-ProjectReaderTests-736709583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:46:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-ba2ac541-ddee-4ce3-bd6d-db31034f3e4d tempest-ProjectReaderTests-736709583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:46:43 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-ba2ac541-ddee-4ce3-bd6d-db31034f3e4d tempest-ProjectReaderTests-736709583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:46:43 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-ba2ac541-ddee-4ce3-bd6d-db31034f3e4d tempest-ProjectReaderTests-736709583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:46:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-ba2ac541-ddee-4ce3-bd6d-db31034f3e4d tempest-ProjectReaderTests-736709583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:46:43 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-ba2ac541-ddee-4ce3-bd6d-db31034f3e4d tempest-ProjectReaderTests-736709583 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:46:43 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-ba2ac541-ddee-4ce3-bd6d-db31034f3e4d tempest-ProjectReaderTests-736709583 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:46:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ba2ac541-ddee-4ce3-bd6d-db31034f3e4d tempest-ProjectReaderTests-736709583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-09d8d47b-d5d1-4c5a-86d4-f3f90048b002 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:46:43 devstack sudo[102484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-09d8d47b-d5d1-4c5a-86d4-f3f90048b002 1073741824
Jul 09 14:46:43 devstack sudo[102484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:46:44 devstack sudo[102484]: pam_unix(sudo:session): session closed for user root
Jul 09 14:46:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ba2ac541-ddee-4ce3-bd6d-db31034f3e4d tempest-ProjectReaderTests-736709583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-09d8d47b-d5d1-4c5a-86d4-f3f90048b002 1073741824" returned: 0 in 1.070s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:46:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ba2ac541-ddee-4ce3-bd6d-db31034f3e4d tempest-ProjectReaderTests-736709583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-09d8d47b-d5d1-4c5a-86d4-f3f90048b002 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:46:44 devstack sudo[102525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-09d8d47b-d5d1-4c5a-86d4-f3f90048b002
Jul 09 14:46:44 devstack sudo[102525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:46:45 devstack sudo[102525]: pam_unix(sudo:session): session closed for user root
Jul 09 14:46:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ba2ac541-ddee-4ce3-bd6d-db31034f3e4d tempest-ProjectReaderTests-736709583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-09d8d47b-d5d1-4c5a-86d4-f3f90048b002" returned: 0 in 0.721s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:46:45 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-ba2ac541-ddee-4ce3-bd6d-db31034f3e4d tempest-ProjectReaderTests-736709583 None] <== create_volume: return (1841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:46:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-ba2ac541-ddee-4ce3-bd6d-db31034f3e4d tempest-ProjectReaderTests-736709583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.844s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:46:45 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ba2ac541-ddee-4ce3-bd6d-db31034f3e4d tempest-ProjectReaderTests-736709583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f80949fc-43b9-4bd2-a978-cccf20669c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09d8d47b-d5d1-4c5a-86d4-f3f90048b002', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:46:45 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ba2ac541-ddee-4ce3-bd6d-db31034f3e4d tempest-ProjectReaderTests-736709583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0402920-fada-4238-8081-8ebca69633b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:46:45 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-ba2ac541-ddee-4ce3-bd6d-db31034f3e4d tempest-ProjectReaderTests-736709583 None] Volume volume-09d8d47b-d5d1-4c5a-86d4-f3f90048b002 (09d8d47b-d5d1-4c5a-86d4-f3f90048b002): created successfully
Jul 09 14:46:45 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ba2ac541-ddee-4ce3-bd6d-db31034f3e4d tempest-ProjectReaderTests-736709583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0402920-fada-4238-8081-8ebca69633b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:46:45 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ba2ac541-ddee-4ce3-bd6d-db31034f3e4d tempest-ProjectReaderTests-736709583 None] Flow 'volume_create_manager' (ac6ea9ba-a2a8-44b2-9454-5bcecd31def0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:46:45 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-ba2ac541-ddee-4ce3-bd6d-db31034f3e4d tempest-ProjectReaderTests-736709583 None] Created volume successfully.
Jul 09 14:46:47 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e23d85f4-5712-4815-b858-011c9ea84d60 tempest-ProjectReaderTests-736709583 None] Acquiring lock "cinder-09d8d47b-d5d1-4c5a-86d4-f3f90048b002-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:46:47 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e23d85f4-5712-4815-b858-011c9ea84d60 tempest-ProjectReaderTests-736709583 None] Lock "cinder-09d8d47b-d5d1-4c5a-86d4-f3f90048b002-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:46:47 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e23d85f4-5712-4815-b858-011c9ea84d60 tempest-ProjectReaderTests-736709583 None] Acquiring lock "cinder-quobyte-09d8d47b-d5d1-4c5a-86d4-f3f90048b002" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:46:47 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e23d85f4-5712-4815-b858-011c9ea84d60 tempest-ProjectReaderTests-736709583 None] Lock "cinder-quobyte-09d8d47b-d5d1-4c5a-86d4-f3f90048b002" acquired by "delete_volume" :: waited 0.018s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:46:47 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[789a9b6e-1c98-4c1d-b5bb-dd9d8f6ccc22]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:46:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e23d85f4-5712-4815-b858-011c9ea84d60 tempest-ProjectReaderTests-736709583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-09d8d47b-d5d1-4c5a-86d4-f3f90048b002 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:46:47 devstack sudo[102529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-09d8d47b-d5d1-4c5a-86d4-f3f90048b002
Jul 09 14:46:47 devstack sudo[102529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:46:48 devstack sudo[102529]: pam_unix(sudo:session): session closed for user root
Jul 09 14:46:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e23d85f4-5712-4815-b858-011c9ea84d60 tempest-ProjectReaderTests-736709583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-09d8d47b-d5d1-4c5a-86d4-f3f90048b002" returned: 0 in 0.837s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:46:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e23d85f4-5712-4815-b858-011c9ea84d60 tempest-ProjectReaderTests-736709583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-09d8d47b-d5d1-4c5a-86d4-f3f90048b002 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:46:48 devstack sudo[102534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-09d8d47b-d5d1-4c5a-86d4-f3f90048b002
Jul 09 14:46:48 devstack sudo[102534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:46:48 devstack sudo[102534]: pam_unix(sudo:session): session closed for user root
Jul 09 14:46:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e23d85f4-5712-4815-b858-011c9ea84d60 tempest-ProjectReaderTests-736709583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-09d8d47b-d5d1-4c5a-86d4-f3f90048b002" returned: 0 in 0.712s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:46:48 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e23d85f4-5712-4815-b858-011c9ea84d60 tempest-ProjectReaderTests-736709583 None] Lock "cinder-quobyte-09d8d47b-d5d1-4c5a-86d4-f3f90048b002" released by "delete_volume" :: held 1.606s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:46:48 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-e23d85f4-5712-4815-b858-011c9ea84d60 tempest-ProjectReaderTests-736709583 None] Created reservations ['f4094fd2-5a1d-439d-9be0-def6ee166bbb', 'd4971c99-bbe6-4949-be7a-1f0fe0ec27c8', 'd229180f-e4c9-4021-a7cf-9b46c1304ad8', '90197f9d-e118-4eba-802e-5421d2e16ddf'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:46:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e23d85f4-5712-4815-b858-011c9ea84d60 tempest-ProjectReaderTests-736709583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:46:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e23d85f4-5712-4815-b858-011c9ea84d60 tempest-ProjectReaderTests-736709583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:46:48 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-e23d85f4-5712-4815-b858-011c9ea84d60 tempest-ProjectReaderTests-736709583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:46:48 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-e23d85f4-5712-4815-b858-011c9ea84d60 tempest-ProjectReaderTests-736709583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:46:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e23d85f4-5712-4815-b858-011c9ea84d60 tempest-ProjectReaderTests-736709583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:46:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e23d85f4-5712-4815-b858-011c9ea84d60 tempest-ProjectReaderTests-736709583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:46:48 devstack sudo[102561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:46:48 devstack sudo[102561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:46:49 devstack sudo[102561]: pam_unix(sudo:session): session closed for user root
Jul 09 14:46:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e23d85f4-5712-4815-b858-011c9ea84d60 tempest-ProjectReaderTests-736709583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.689s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:46:49 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-e23d85f4-5712-4815-b858-011c9ea84d60 tempest-ProjectReaderTests-736709583 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:46:49 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-e23d85f4-5712-4815-b858-011c9ea84d60 tempest-ProjectReaderTests-736709583 None] Deleted volume successfully.
Jul 09 14:46:49 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e23d85f4-5712-4815-b858-011c9ea84d60 tempest-ProjectReaderTests-736709583 None] Lock "cinder-09d8d47b-d5d1-4c5a-86d4-f3f90048b002-delete_volume" released by "delete_volume" :: held 2.513s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:46:49 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4d57c90-3d40-4e00-8823-fa86d15db463 tempest-ProjectReaderTests-736709583 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:46:49 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e4d57c90-3d40-4e00-8823-fa86d15db463 tempest-ProjectReaderTests-736709583 None] Flow 'volume_create_manager' (79595665-697f-4859-85fe-800e8a2be56b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:46:49 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e4d57c90-3d40-4e00-8823-fa86d15db463 tempest-ProjectReaderTests-736709583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (039c6a85-5846-41fa-b504-a0fd6f0d28ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:46:50 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e4d57c90-3d40-4e00-8823-fa86d15db463 tempest-ProjectReaderTests-736709583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (039c6a85-5846-41fa-b504-a0fd6f0d28ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:46:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1518923077',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc3d066f-1aed-48d6-84ad-13dfb65e4b48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d9ee42bf5e342c48536dc6a80c892d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:46:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:46:50Z,use_quota=True,user_id='cbf40bf3e46641928059fedd8cdb018c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:46:50 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e4d57c90-3d40-4e00-8823-fa86d15db463 tempest-ProjectReaderTests-736709583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63efeefa-fae7-4db2-a41e-ba8dabcd014e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:46:50 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e4d57c90-3d40-4e00-8823-fa86d15db463 tempest-ProjectReaderTests-736709583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63efeefa-fae7-4db2-a41e-ba8dabcd014e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:46:50 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e4d57c90-3d40-4e00-8823-fa86d15db463 tempest-ProjectReaderTests-736709583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c27634f-c8c0-403d-a0cc-423d415aba2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:46:50 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e4d57c90-3d40-4e00-8823-fa86d15db463 tempest-ProjectReaderTests-736709583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c27634f-c8c0-403d-a0cc-423d415aba2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc3d066f-1aed-48d6-84ad-13dfb65e4b48', 'volume_name': 'volume-bc3d066f-1aed-48d6-84ad-13dfb65e4b48', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:46:50 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e4d57c90-3d40-4e00-8823-fa86d15db463 tempest-ProjectReaderTests-736709583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2594171f-c011-496d-9e96-d30f9dbe9ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:46:50 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e4d57c90-3d40-4e00-8823-fa86d15db463 tempest-ProjectReaderTests-736709583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2594171f-c011-496d-9e96-d30f9dbe9ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:46:50 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e4d57c90-3d40-4e00-8823-fa86d15db463 tempest-ProjectReaderTests-736709583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fd1d985-9186-4702-8468-5d48ab4882bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:46:50 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-e4d57c90-3d40-4e00-8823-fa86d15db463 tempest-ProjectReaderTests-736709583 None] Volume bc3d066f-1aed-48d6-84ad-13dfb65e4b48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc3d066f-1aed-48d6-84ad-13dfb65e4b48', 'volume_size': 1}
Jul 09 14:46:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e4d57c90-3d40-4e00-8823-fa86d15db463 tempest-ProjectReaderTests-736709583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:46:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e4d57c90-3d40-4e00-8823-fa86d15db463 tempest-ProjectReaderTests-736709583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:46:50 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-e4d57c90-3d40-4e00-8823-fa86d15db463 tempest-ProjectReaderTests-736709583 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:46:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1518923077',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc3d066f-1aed-48d6-84ad-13dfb65e4b48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d9ee42bf5e342c48536dc6a80c892d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:46:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:46:50Z,use_quota=True,user_id='cbf40bf3e46641928059fedd8cdb018c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:46:50 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-e4d57c90-3d40-4e00-8823-fa86d15db463 tempest-ProjectReaderTests-736709583 None] Creating volume bc3d066f-1aed-48d6-84ad-13dfb65e4b48 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:46:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e4d57c90-3d40-4e00-8823-fa86d15db463 tempest-ProjectReaderTests-736709583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:46:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e4d57c90-3d40-4e00-8823-fa86d15db463 tempest-ProjectReaderTests-736709583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:46:50 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-e4d57c90-3d40-4e00-8823-fa86d15db463 tempest-ProjectReaderTests-736709583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:46:50 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-e4d57c90-3d40-4e00-8823-fa86d15db463 tempest-ProjectReaderTests-736709583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:46:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e4d57c90-3d40-4e00-8823-fa86d15db463 tempest-ProjectReaderTests-736709583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:46:50 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-e4d57c90-3d40-4e00-8823-fa86d15db463 tempest-ProjectReaderTests-736709583 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:46:50 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-e4d57c90-3d40-4e00-8823-fa86d15db463 tempest-ProjectReaderTests-736709583 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:46:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e4d57c90-3d40-4e00-8823-fa86d15db463 tempest-ProjectReaderTests-736709583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bc3d066f-1aed-48d6-84ad-13dfb65e4b48 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:46:50 devstack sudo[102564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bc3d066f-1aed-48d6-84ad-13dfb65e4b48 1073741824
Jul 09 14:46:50 devstack sudo[102564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:46:51 devstack sudo[102564]: pam_unix(sudo:session): session closed for user root
Jul 09 14:46:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e4d57c90-3d40-4e00-8823-fa86d15db463 tempest-ProjectReaderTests-736709583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bc3d066f-1aed-48d6-84ad-13dfb65e4b48 1073741824" returned: 0 in 0.948s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:46:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e4d57c90-3d40-4e00-8823-fa86d15db463 tempest-ProjectReaderTests-736709583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bc3d066f-1aed-48d6-84ad-13dfb65e4b48 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:46:51 devstack sudo[102571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bc3d066f-1aed-48d6-84ad-13dfb65e4b48
Jul 09 14:46:51 devstack sudo[102571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:46:51 devstack sudo[102571]: pam_unix(sudo:session): session closed for user root
Jul 09 14:46:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e4d57c90-3d40-4e00-8823-fa86d15db463 tempest-ProjectReaderTests-736709583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bc3d066f-1aed-48d6-84ad-13dfb65e4b48" returned: 0 in 0.677s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:46:51 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-e4d57c90-3d40-4e00-8823-fa86d15db463 tempest-ProjectReaderTests-736709583 None] <== create_volume: return (1682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:46:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e4d57c90-3d40-4e00-8823-fa86d15db463 tempest-ProjectReaderTests-736709583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.686s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:46:51 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e4d57c90-3d40-4e00-8823-fa86d15db463 tempest-ProjectReaderTests-736709583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fd1d985-9186-4702-8468-5d48ab4882bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc3d066f-1aed-48d6-84ad-13dfb65e4b48', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:46:51 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e4d57c90-3d40-4e00-8823-fa86d15db463 tempest-ProjectReaderTests-736709583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12539664-ce62-4b64-ac41-efe7576e0377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:46:51 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-e4d57c90-3d40-4e00-8823-fa86d15db463 tempest-ProjectReaderTests-736709583 None] Volume volume-bc3d066f-1aed-48d6-84ad-13dfb65e4b48 (bc3d066f-1aed-48d6-84ad-13dfb65e4b48): created successfully
Jul 09 14:46:51 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e4d57c90-3d40-4e00-8823-fa86d15db463 tempest-ProjectReaderTests-736709583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12539664-ce62-4b64-ac41-efe7576e0377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:46:51 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e4d57c90-3d40-4e00-8823-fa86d15db463 tempest-ProjectReaderTests-736709583 None] Flow 'volume_create_manager' (79595665-697f-4859-85fe-800e8a2be56b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:46:51 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-e4d57c90-3d40-4e00-8823-fa86d15db463 tempest-ProjectReaderTests-736709583 None] Created volume successfully.
Jul 09 14:46:52 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-fda799dd-a9a6-4254-9382-77a2378108aa tempest-ProjectReaderTests-736709583 None] Acquiring lock "cinder-bc3d066f-1aed-48d6-84ad-13dfb65e4b48-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:46:52 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-fda799dd-a9a6-4254-9382-77a2378108aa tempest-ProjectReaderTests-736709583 None] Lock "cinder-bc3d066f-1aed-48d6-84ad-13dfb65e4b48-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:46:52 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-fda799dd-a9a6-4254-9382-77a2378108aa tempest-ProjectReaderTests-736709583 None] Acquiring lock "cinder-quobyte-bc3d066f-1aed-48d6-84ad-13dfb65e4b48" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:46:52 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-fda799dd-a9a6-4254-9382-77a2378108aa tempest-ProjectReaderTests-736709583 None] Lock "cinder-quobyte-bc3d066f-1aed-48d6-84ad-13dfb65e4b48" acquired by "delete_volume" :: waited 0.024s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:46:52 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[f28bfb62-3c44-499b-b26f-347deb0e6f5b]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:46:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fda799dd-a9a6-4254-9382-77a2378108aa tempest-ProjectReaderTests-736709583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bc3d066f-1aed-48d6-84ad-13dfb65e4b48 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:46:52 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 14:46:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:46:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:46:52 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:46:52 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:46:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:46:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:46:52 devstack sudo[102575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:46:52 devstack sudo[102575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:46:52 devstack sudo[102574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bc3d066f-1aed-48d6-84ad-13dfb65e4b48
Jul 09 14:46:52 devstack sudo[102574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:46:53 devstack sudo[102575]: pam_unix(sudo:session): session closed for user root
Jul 09 14:46:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.759s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:46:53 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:46:53 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Running periodic task VolumeManager._thread_info {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 14:46:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] thread count: 28 {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 09 14:46:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] thread info: [<_MainThread(MainThread, started 125388812103808)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125388713797504)>, <Thread(Thread-3 (stat_writer), started daemon 125388699995392)>, <Thread(Rabbit-heartbeat, started daemon 125388700522560)>, <Thread(Thread-5 (_runner), started daemon 125388698545216)>, <Thread(Thread-7 (_runner), started daemon 125388698611264)>, <Thread(fd_logger, started daemon 125388703020672)>, <Thread(privsep_reader, started daemon 125388696441088)>, <Thread(tpool_thread_0, started daemon 125388687943360)>, <Thread(tpool_thread_1, started daemon 125388679550656)>, <Thread(tpool_thread_2, started daemon 125388671141568)>, <Thread(tpool_thread_3, started daemon 125388662732480)>, <Thread(tpool_thread_4, started daemon 125388654323392)>, <Thread(tpool_thread_5, started daemon 125388645914304)>, <Thread(tpool_thread_6, started daemon 125388637505216)>, <Thread(tpool_thread_7, started daemon 125388629096128)>, <Thread(tpool_thread_8, started daemon 125388620687040)>, <Thread(tpool_thread_9, started daemon 125388612277952)>, <Thread(tpool_thread_10, started daemon 125388603868864)>, <Thread(tpool_thread_11, started daemon 125388595459776)>, <Thread(tpool_thread_12, started daemon 125388587050688)>, <Thread(tpool_thread_13, started daemon 125388578641600)>, <Thread(tpool_thread_14, started daemon 125388570232512)>, <Thread(tpool_thread_15, started daemon 125388561823424)>, <Thread(tpool_thread_16, started daemon 125388553414336)>, <Thread(tpool_thread_17, started daemon 125388545005248)>, <Thread(tpool_thread_18, started daemon 125388536596160)>, <Thread(tpool_thread_19, started daemon 125388528187072)>] {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 09 14:46:53 devstack sudo[102574]: pam_unix(sudo:session): session closed for user root
Jul 09 14:46:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fda799dd-a9a6-4254-9382-77a2378108aa tempest-ProjectReaderTests-736709583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bc3d066f-1aed-48d6-84ad-13dfb65e4b48" returned: 0 in 0.868s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:46:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fda799dd-a9a6-4254-9382-77a2378108aa tempest-ProjectReaderTests-736709583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bc3d066f-1aed-48d6-84ad-13dfb65e4b48 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:46:53 devstack sudo[102583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bc3d066f-1aed-48d6-84ad-13dfb65e4b48
Jul 09 14:46:53 devstack sudo[102583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:46:53 devstack sudo[102583]: pam_unix(sudo:session): session closed for user root
Jul 09 14:46:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fda799dd-a9a6-4254-9382-77a2378108aa tempest-ProjectReaderTests-736709583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bc3d066f-1aed-48d6-84ad-13dfb65e4b48" returned: 0 in 0.725s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:46:53 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-fda799dd-a9a6-4254-9382-77a2378108aa tempest-ProjectReaderTests-736709583 None] Lock "cinder-quobyte-bc3d066f-1aed-48d6-84ad-13dfb65e4b48" released by "delete_volume" :: held 1.671s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:46:54 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-fda799dd-a9a6-4254-9382-77a2378108aa tempest-ProjectReaderTests-736709583 None] Created reservations ['5ed1e2e7-0231-4d75-8d30-1f2842b441ef', 'c1b19296-27b5-43fd-bce2-d849030fd643', 'b9cb2510-ca89-4ba8-b96c-5c1ad6f19dca', '6c274022-39f7-4e4c-9562-d4a55a22b12c'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:46:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-fda799dd-a9a6-4254-9382-77a2378108aa tempest-ProjectReaderTests-736709583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:46:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-fda799dd-a9a6-4254-9382-77a2378108aa tempest-ProjectReaderTests-736709583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:46:54 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-fda799dd-a9a6-4254-9382-77a2378108aa tempest-ProjectReaderTests-736709583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:46:54 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-fda799dd-a9a6-4254-9382-77a2378108aa tempest-ProjectReaderTests-736709583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:46:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-fda799dd-a9a6-4254-9382-77a2378108aa tempest-ProjectReaderTests-736709583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:46:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fda799dd-a9a6-4254-9382-77a2378108aa tempest-ProjectReaderTests-736709583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:46:54 devstack sudo[102593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:46:54 devstack sudo[102593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:46:55 devstack sudo[102593]: pam_unix(sudo:session): session closed for user root
Jul 09 14:46:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fda799dd-a9a6-4254-9382-77a2378108aa tempest-ProjectReaderTests-736709583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.938s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:46:55 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-fda799dd-a9a6-4254-9382-77a2378108aa tempest-ProjectReaderTests-736709583 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:46:55 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-fda799dd-a9a6-4254-9382-77a2378108aa tempest-ProjectReaderTests-736709583 None] Deleted volume successfully.
Jul 09 14:46:55 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-fda799dd-a9a6-4254-9382-77a2378108aa tempest-ProjectReaderTests-736709583 None] Lock "cinder-bc3d066f-1aed-48d6-84ad-13dfb65e4b48-delete_volume" released by "delete_volume" :: held 2.952s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:46:59 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-150df10e-08eb-428e-b02c-5ab2052c9c5f tempest-TestServerVolumeAttachmentScenario-1599287603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:46:59 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-150df10e-08eb-428e-b02c-5ab2052c9c5f tempest-TestServerVolumeAttachmentScenario-1599287603 None] Flow 'volume_create_manager' (8455cf33-b0fa-4f64-8cf0-088e133eceb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:46:59 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-150df10e-08eb-428e-b02c-5ab2052c9c5f tempest-TestServerVolumeAttachmentScenario-1599287603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e692e337-5a1c-4d0e-bd65-a63a30053a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:46:59 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-150df10e-08eb-428e-b02c-5ab2052c9c5f tempest-TestServerVolumeAttachmentScenario-1599287603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e692e337-5a1c-4d0e-bd65-a63a30053a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:46:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-972250307',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db35f973-ace0-48e3-8726-54408208aedf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b96bdc777c34f80935e561c833cb951',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:47:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:47:00Z,use_quota=True,user_id='182ba614ef51420096dc9c933558ef99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:46:59 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-150df10e-08eb-428e-b02c-5ab2052c9c5f tempest-TestServerVolumeAttachmentScenario-1599287603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c75cb938-7230-4c43-a3a0-db0ef3398b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:46:59 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-150df10e-08eb-428e-b02c-5ab2052c9c5f tempest-TestServerVolumeAttachmentScenario-1599287603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c75cb938-7230-4c43-a3a0-db0ef3398b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:46:59 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-150df10e-08eb-428e-b02c-5ab2052c9c5f tempest-TestServerVolumeAttachmentScenario-1599287603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66e4c5c2-ee95-401a-8fe1-3be5d4585440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:46:59 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-150df10e-08eb-428e-b02c-5ab2052c9c5f tempest-TestServerVolumeAttachmentScenario-1599287603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66e4c5c2-ee95-401a-8fe1-3be5d4585440) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db35f973-ace0-48e3-8726-54408208aedf', 'volume_name': 'volume-db35f973-ace0-48e3-8726-54408208aedf', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:46:59 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-150df10e-08eb-428e-b02c-5ab2052c9c5f tempest-TestServerVolumeAttachmentScenario-1599287603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cb14feb-9461-48a1-aa67-acfc29d1b273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:46:59 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-150df10e-08eb-428e-b02c-5ab2052c9c5f tempest-TestServerVolumeAttachmentScenario-1599287603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cb14feb-9461-48a1-aa67-acfc29d1b273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:46:59 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-150df10e-08eb-428e-b02c-5ab2052c9c5f tempest-TestServerVolumeAttachmentScenario-1599287603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b26202f9-34d0-4744-bb8a-4d71c13e7b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:46:59 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-150df10e-08eb-428e-b02c-5ab2052c9c5f tempest-TestServerVolumeAttachmentScenario-1599287603 None] Volume db35f973-ace0-48e3-8726-54408208aedf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db35f973-ace0-48e3-8726-54408208aedf', 'volume_size': 1}
Jul 09 14:46:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-150df10e-08eb-428e-b02c-5ab2052c9c5f tempest-TestServerVolumeAttachmentScenario-1599287603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:46:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-150df10e-08eb-428e-b02c-5ab2052c9c5f tempest-TestServerVolumeAttachmentScenario-1599287603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:46:59 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-150df10e-08eb-428e-b02c-5ab2052c9c5f tempest-TestServerVolumeAttachmentScenario-1599287603 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:46:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-972250307',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db35f973-ace0-48e3-8726-54408208aedf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b96bdc777c34f80935e561c833cb951',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:47:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:47:00Z,use_quota=True,user_id='182ba614ef51420096dc9c933558ef99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:46:59 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-150df10e-08eb-428e-b02c-5ab2052c9c5f tempest-TestServerVolumeAttachmentScenario-1599287603 None] Creating volume db35f973-ace0-48e3-8726-54408208aedf {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:46:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-150df10e-08eb-428e-b02c-5ab2052c9c5f tempest-TestServerVolumeAttachmentScenario-1599287603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:46:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-150df10e-08eb-428e-b02c-5ab2052c9c5f tempest-TestServerVolumeAttachmentScenario-1599287603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:46:59 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-150df10e-08eb-428e-b02c-5ab2052c9c5f tempest-TestServerVolumeAttachmentScenario-1599287603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:46:59 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-150df10e-08eb-428e-b02c-5ab2052c9c5f tempest-TestServerVolumeAttachmentScenario-1599287603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:46:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-150df10e-08eb-428e-b02c-5ab2052c9c5f tempest-TestServerVolumeAttachmentScenario-1599287603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:46:59 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-150df10e-08eb-428e-b02c-5ab2052c9c5f tempest-TestServerVolumeAttachmentScenario-1599287603 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:46:59 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-150df10e-08eb-428e-b02c-5ab2052c9c5f tempest-TestServerVolumeAttachmentScenario-1599287603 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:46:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-150df10e-08eb-428e-b02c-5ab2052c9c5f tempest-TestServerVolumeAttachmentScenario-1599287603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-db35f973-ace0-48e3-8726-54408208aedf 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:46:59 devstack sudo[102636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-db35f973-ace0-48e3-8726-54408208aedf 1073741824
Jul 09 14:46:59 devstack sudo[102636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:47:00 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5d45023-3139-422c-a7fb-37c09ddbfcb4 tempest-TestServerVolumeAttachmentScenario-1599287603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:47:00 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f5d45023-3139-422c-a7fb-37c09ddbfcb4 tempest-TestServerVolumeAttachmentScenario-1599287603 None] Flow 'volume_create_manager' (d2f61ccf-a003-4978-b100-20ee4ac26f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:47:00 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f5d45023-3139-422c-a7fb-37c09ddbfcb4 tempest-TestServerVolumeAttachmentScenario-1599287603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f55bb393-de66-43f9-a0c0-b5633c40c4d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:47:00 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f5d45023-3139-422c-a7fb-37c09ddbfcb4 tempest-TestServerVolumeAttachmentScenario-1599287603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f55bb393-de66-43f9-a0c0-b5633c40c4d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:47:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1442848633',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d701d17f-df37-428b-8573-cc1ef023bc2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b96bdc777c34f80935e561c833cb951',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:47:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:47:00Z,use_quota=True,user_id='182ba614ef51420096dc9c933558ef99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:47:00 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f5d45023-3139-422c-a7fb-37c09ddbfcb4 tempest-TestServerVolumeAttachmentScenario-1599287603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9ee1c4e-17fb-4069-96e5-19b351291e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:47:00 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f5d45023-3139-422c-a7fb-37c09ddbfcb4 tempest-TestServerVolumeAttachmentScenario-1599287603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9ee1c4e-17fb-4069-96e5-19b351291e95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:47:00 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f5d45023-3139-422c-a7fb-37c09ddbfcb4 tempest-TestServerVolumeAttachmentScenario-1599287603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12fc6cb5-0fce-4def-97da-fbf2d785ca7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:47:00 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f5d45023-3139-422c-a7fb-37c09ddbfcb4 tempest-TestServerVolumeAttachmentScenario-1599287603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12fc6cb5-0fce-4def-97da-fbf2d785ca7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd701d17f-df37-428b-8573-cc1ef023bc2b', 'volume_name': 'volume-d701d17f-df37-428b-8573-cc1ef023bc2b', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:47:00 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f5d45023-3139-422c-a7fb-37c09ddbfcb4 tempest-TestServerVolumeAttachmentScenario-1599287603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18ac5bf6-c73a-4186-9065-65b8bc7398c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:47:00 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f5d45023-3139-422c-a7fb-37c09ddbfcb4 tempest-TestServerVolumeAttachmentScenario-1599287603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18ac5bf6-c73a-4186-9065-65b8bc7398c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:47:00 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f5d45023-3139-422c-a7fb-37c09ddbfcb4 tempest-TestServerVolumeAttachmentScenario-1599287603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (409549cb-60a2-497d-8db0-09b23b09b154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:47:00 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-f5d45023-3139-422c-a7fb-37c09ddbfcb4 tempest-TestServerVolumeAttachmentScenario-1599287603 None] Volume d701d17f-df37-428b-8573-cc1ef023bc2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d701d17f-df37-428b-8573-cc1ef023bc2b', 'volume_size': 1}
Jul 09 14:47:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f5d45023-3139-422c-a7fb-37c09ddbfcb4 tempest-TestServerVolumeAttachmentScenario-1599287603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:47:00 devstack sudo[102636]: pam_unix(sudo:session): session closed for user root
Jul 09 14:47:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-150df10e-08eb-428e-b02c-5ab2052c9c5f tempest-TestServerVolumeAttachmentScenario-1599287603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-db35f973-ace0-48e3-8726-54408208aedf 1073741824" returned: 0 in 1.051s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:47:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-150df10e-08eb-428e-b02c-5ab2052c9c5f tempest-TestServerVolumeAttachmentScenario-1599287603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-db35f973-ace0-48e3-8726-54408208aedf {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:47:01 devstack sudo[102643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-db35f973-ace0-48e3-8726-54408208aedf
Jul 09 14:47:01 devstack sudo[102643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:47:01 devstack sudo[102643]: pam_unix(sudo:session): session closed for user root
Jul 09 14:47:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-150df10e-08eb-428e-b02c-5ab2052c9c5f tempest-TestServerVolumeAttachmentScenario-1599287603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-db35f973-ace0-48e3-8726-54408208aedf" returned: 0 in 0.717s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:47:01 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-150df10e-08eb-428e-b02c-5ab2052c9c5f tempest-TestServerVolumeAttachmentScenario-1599287603 None] <== create_volume: return (1812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:47:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-150df10e-08eb-428e-b02c-5ab2052c9c5f tempest-TestServerVolumeAttachmentScenario-1599287603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.814s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:47:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f5d45023-3139-422c-a7fb-37c09ddbfcb4 tempest-TestServerVolumeAttachmentScenario-1599287603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.549s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:47:01 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f5d45023-3139-422c-a7fb-37c09ddbfcb4 tempest-TestServerVolumeAttachmentScenario-1599287603 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:47:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1442848633',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d701d17f-df37-428b-8573-cc1ef023bc2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b96bdc777c34f80935e561c833cb951',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:47:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:47:00Z,use_quota=True,user_id='182ba614ef51420096dc9c933558ef99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:47:01 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-f5d45023-3139-422c-a7fb-37c09ddbfcb4 tempest-TestServerVolumeAttachmentScenario-1599287603 None] Creating volume d701d17f-df37-428b-8573-cc1ef023bc2b {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:47:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f5d45023-3139-422c-a7fb-37c09ddbfcb4 tempest-TestServerVolumeAttachmentScenario-1599287603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:47:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f5d45023-3139-422c-a7fb-37c09ddbfcb4 tempest-TestServerVolumeAttachmentScenario-1599287603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:47:01 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f5d45023-3139-422c-a7fb-37c09ddbfcb4 tempest-TestServerVolumeAttachmentScenario-1599287603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:47:01 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f5d45023-3139-422c-a7fb-37c09ddbfcb4 tempest-TestServerVolumeAttachmentScenario-1599287603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:47:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f5d45023-3139-422c-a7fb-37c09ddbfcb4 tempest-TestServerVolumeAttachmentScenario-1599287603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:47:01 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f5d45023-3139-422c-a7fb-37c09ddbfcb4 tempest-TestServerVolumeAttachmentScenario-1599287603 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:47:01 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-f5d45023-3139-422c-a7fb-37c09ddbfcb4 tempest-TestServerVolumeAttachmentScenario-1599287603 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:47:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f5d45023-3139-422c-a7fb-37c09ddbfcb4 tempest-TestServerVolumeAttachmentScenario-1599287603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d701d17f-df37-428b-8573-cc1ef023bc2b 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:47:01 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-150df10e-08eb-428e-b02c-5ab2052c9c5f tempest-TestServerVolumeAttachmentScenario-1599287603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b26202f9-34d0-4744-bb8a-4d71c13e7b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db35f973-ace0-48e3-8726-54408208aedf', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:47:01 devstack sudo[102646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d701d17f-df37-428b-8573-cc1ef023bc2b 1073741824
Jul 09 14:47:01 devstack sudo[102646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:47:01 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-150df10e-08eb-428e-b02c-5ab2052c9c5f tempest-TestServerVolumeAttachmentScenario-1599287603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b719c81e-0ad0-4645-a7c8-451d91ed085f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:47:01 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-150df10e-08eb-428e-b02c-5ab2052c9c5f tempest-TestServerVolumeAttachmentScenario-1599287603 None] Volume volume-db35f973-ace0-48e3-8726-54408208aedf (db35f973-ace0-48e3-8726-54408208aedf): created successfully
Jul 09 14:47:01 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-150df10e-08eb-428e-b02c-5ab2052c9c5f tempest-TestServerVolumeAttachmentScenario-1599287603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b719c81e-0ad0-4645-a7c8-451d91ed085f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:47:01 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-150df10e-08eb-428e-b02c-5ab2052c9c5f tempest-TestServerVolumeAttachmentScenario-1599287603 None] Flow 'volume_create_manager' (8455cf33-b0fa-4f64-8cf0-088e133eceb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:47:01 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-150df10e-08eb-428e-b02c-5ab2052c9c5f tempest-TestServerVolumeAttachmentScenario-1599287603 None] Created volume successfully.
Jul 09 14:47:02 devstack sudo[102646]: pam_unix(sudo:session): session closed for user root
Jul 09 14:47:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f5d45023-3139-422c-a7fb-37c09ddbfcb4 tempest-TestServerVolumeAttachmentScenario-1599287603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d701d17f-df37-428b-8573-cc1ef023bc2b 1073741824" returned: 0 in 0.957s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:47:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f5d45023-3139-422c-a7fb-37c09ddbfcb4 tempest-TestServerVolumeAttachmentScenario-1599287603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d701d17f-df37-428b-8573-cc1ef023bc2b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:47:02 devstack sudo[102652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d701d17f-df37-428b-8573-cc1ef023bc2b
Jul 09 14:47:02 devstack sudo[102652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:47:03 devstack sudo[102652]: pam_unix(sudo:session): session closed for user root
Jul 09 14:47:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f5d45023-3139-422c-a7fb-37c09ddbfcb4 tempest-TestServerVolumeAttachmentScenario-1599287603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d701d17f-df37-428b-8573-cc1ef023bc2b" returned: 0 in 0.746s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:47:03 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f5d45023-3139-422c-a7fb-37c09ddbfcb4 tempest-TestServerVolumeAttachmentScenario-1599287603 None] <== create_volume: return (1755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:47:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f5d45023-3139-422c-a7fb-37c09ddbfcb4 tempest-TestServerVolumeAttachmentScenario-1599287603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.758s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:47:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f5d45023-3139-422c-a7fb-37c09ddbfcb4 tempest-TestServerVolumeAttachmentScenario-1599287603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (409549cb-60a2-497d-8db0-09b23b09b154) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d701d17f-df37-428b-8573-cc1ef023bc2b', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:47:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f5d45023-3139-422c-a7fb-37c09ddbfcb4 tempest-TestServerVolumeAttachmentScenario-1599287603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06ab80f3-678b-496f-8cec-721b51ec9c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:47:03 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-f5d45023-3139-422c-a7fb-37c09ddbfcb4 tempest-TestServerVolumeAttachmentScenario-1599287603 None] Volume volume-d701d17f-df37-428b-8573-cc1ef023bc2b (d701d17f-df37-428b-8573-cc1ef023bc2b): created successfully
Jul 09 14:47:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f5d45023-3139-422c-a7fb-37c09ddbfcb4 tempest-TestServerVolumeAttachmentScenario-1599287603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06ab80f3-678b-496f-8cec-721b51ec9c64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:47:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f5d45023-3139-422c-a7fb-37c09ddbfcb4 tempest-TestServerVolumeAttachmentScenario-1599287603 None] Flow 'volume_create_manager' (d2f61ccf-a003-4978-b100-20ee4ac26f23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:47:03 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-f5d45023-3139-422c-a7fb-37c09ddbfcb4 tempest-TestServerVolumeAttachmentScenario-1599287603 None] Created volume successfully.
Jul 09 14:47:13 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=19,cinder:UPDATE=26,cinder:INSERT=6,cinder:DELETE=2 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 14:47:13 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=17,cinder:UPDATE=30,cinder:INSERT=6,cinder:DELETE=4 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 14:47:20 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-e39f70a4-f651-48ac-895f-23463136cfa8 req-bd3c73ac-d438-4858-af95-63d70ff8e9b9 tempest-TestMinimumBasicScenario-277009565 None] Terminate volume connection completed successfully.
Jul 09 14:47:20 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-e39f70a4-f651-48ac-895f-23463136cfa8 req-bd3c73ac-d438-4858-af95-63d70ff8e9b9 tempest-TestMinimumBasicScenario-277009565 None] Deleting attachment 378ca67b-b864-4cc6-b252-eedc87181577. {{(pid=87230) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 09 14:47:22 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-db3318bb-6578-4684-bd66-6aae3a6ab482 tempest-TestMinimumBasicScenario-277009565 None] Acquiring lock "cinder-3d0220f5-d7e5-4378-90ee-aed36701908a-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:47:22 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-db3318bb-6578-4684-bd66-6aae3a6ab482 tempest-TestMinimumBasicScenario-277009565 None] Lock "cinder-3d0220f5-d7e5-4378-90ee-aed36701908a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:47:22 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-db3318bb-6578-4684-bd66-6aae3a6ab482 tempest-TestMinimumBasicScenario-277009565 None] Acquiring lock "cinder-quobyte-3d0220f5-d7e5-4378-90ee-aed36701908a" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:47:22 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-db3318bb-6578-4684-bd66-6aae3a6ab482 tempest-TestMinimumBasicScenario-277009565 None] Lock "cinder-quobyte-3d0220f5-d7e5-4378-90ee-aed36701908a" acquired by "delete_volume" :: waited 0.019s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:47:22 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f6918e-db58-4d4f-9ea1-28f3a2a5d2d3]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:47:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-db3318bb-6578-4684-bd66-6aae3a6ab482 tempest-TestMinimumBasicScenario-277009565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-3d0220f5-d7e5-4378-90ee-aed36701908a {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:47:22 devstack sudo[102774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-3d0220f5-d7e5-4378-90ee-aed36701908a
Jul 09 14:47:22 devstack sudo[102774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:47:23 devstack sudo[102774]: pam_unix(sudo:session): session closed for user root
Jul 09 14:47:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-db3318bb-6578-4684-bd66-6aae3a6ab482 tempest-TestMinimumBasicScenario-277009565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-3d0220f5-d7e5-4378-90ee-aed36701908a" returned: 0 in 0.784s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:47:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-db3318bb-6578-4684-bd66-6aae3a6ab482 tempest-TestMinimumBasicScenario-277009565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-3d0220f5-d7e5-4378-90ee-aed36701908a {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:47:23 devstack sudo[102779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-3d0220f5-d7e5-4378-90ee-aed36701908a
Jul 09 14:47:23 devstack sudo[102779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:47:24 devstack sudo[102779]: pam_unix(sudo:session): session closed for user root
Jul 09 14:47:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-db3318bb-6578-4684-bd66-6aae3a6ab482 tempest-TestMinimumBasicScenario-277009565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-3d0220f5-d7e5-4378-90ee-aed36701908a" returned: 0 in 0.667s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:47:24 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-db3318bb-6578-4684-bd66-6aae3a6ab482 tempest-TestMinimumBasicScenario-277009565 None] Lock "cinder-quobyte-3d0220f5-d7e5-4378-90ee-aed36701908a" released by "delete_volume" :: held 1.503s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:47:24 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-db3318bb-6578-4684-bd66-6aae3a6ab482 tempest-TestMinimumBasicScenario-277009565 None] Created reservations ['3a740922-31c3-4dd3-b29f-9a9a64bcef48', '33ee2660-61ea-42cf-ba87-40b03843d23b', 'c7de0de3-987d-4f7a-8a9f-c1bfdeab10dd', '8adab1d1-9071-47f3-9d88-e70a9f4b30cd'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:47:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-db3318bb-6578-4684-bd66-6aae3a6ab482 tempest-TestMinimumBasicScenario-277009565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:47:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-db3318bb-6578-4684-bd66-6aae3a6ab482 tempest-TestMinimumBasicScenario-277009565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:47:24 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-db3318bb-6578-4684-bd66-6aae3a6ab482 tempest-TestMinimumBasicScenario-277009565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:47:24 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-db3318bb-6578-4684-bd66-6aae3a6ab482 tempest-TestMinimumBasicScenario-277009565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:47:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-db3318bb-6578-4684-bd66-6aae3a6ab482 tempest-TestMinimumBasicScenario-277009565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:47:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-db3318bb-6578-4684-bd66-6aae3a6ab482 tempest-TestMinimumBasicScenario-277009565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:47:24 devstack sudo[102782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:47:24 devstack sudo[102782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:47:24 devstack sudo[102782]: pam_unix(sudo:session): session closed for user root
Jul 09 14:47:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-db3318bb-6578-4684-bd66-6aae3a6ab482 tempest-TestMinimumBasicScenario-277009565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.701s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:47:24 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-db3318bb-6578-4684-bd66-6aae3a6ab482 tempest-TestMinimumBasicScenario-277009565 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:47:24 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-db3318bb-6578-4684-bd66-6aae3a6ab482 tempest-TestMinimumBasicScenario-277009565 None] Deleted volume successfully.
Jul 09 14:47:24 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-db3318bb-6578-4684-bd66-6aae3a6ab482 tempest-TestMinimumBasicScenario-277009565 None] Lock "cinder-3d0220f5-d7e5-4378-90ee-aed36701908a-delete_volume" released by "delete_volume" :: held 2.421s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:47:34 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=9,cinder:INSERT=2,cinder:UPDATE=6 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 14:47:34 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:UPDATE=10,cinder:SELECT=3,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 14:47:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-570f4aa6-3d4e-48a2-b6d0-844a497d16b1 req-fb62088f-ef1f-49bb-aa4d-aa2774d884ab tempest-TestServerVolumeAttachmentScenario-1599287603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:47:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-570f4aa6-3d4e-48a2-b6d0-844a497d16b1 req-fb62088f-ef1f-49bb-aa4d-aa2774d884ab tempest-TestServerVolumeAttachmentScenario-1599287603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:47:42 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b66939-f453-4962-8364-17af593f5af4]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:47:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-570f4aa6-3d4e-48a2-b6d0-844a497d16b1 req-fb62088f-ef1f-49bb-aa4d-aa2774d884ab tempest-TestServerVolumeAttachmentScenario-1599287603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-db35f973-ace0-48e3-8726-54408208aedf {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:47:42 devstack sudo[102842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-db35f973-ace0-48e3-8726-54408208aedf
Jul 09 14:47:42 devstack sudo[102842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:47:42 devstack sudo[102842]: pam_unix(sudo:session): session closed for user root
Jul 09 14:47:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-570f4aa6-3d4e-48a2-b6d0-844a497d16b1 req-fb62088f-ef1f-49bb-aa4d-aa2774d884ab tempest-TestServerVolumeAttachmentScenario-1599287603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-db35f973-ace0-48e3-8726-54408208aedf" returned: 0 in 0.812s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:47:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-570f4aa6-3d4e-48a2-b6d0-844a497d16b1 req-fb62088f-ef1f-49bb-aa4d-aa2774d884ab tempest-TestServerVolumeAttachmentScenario-1599287603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.838s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:47:42 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-570f4aa6-3d4e-48a2-b6d0-844a497d16b1 req-fb62088f-ef1f-49bb-aa4d-aa2774d884ab tempest-TestServerVolumeAttachmentScenario-1599287603 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653', 'name': 'volume-db35f973-ace0-48e3-8726-54408208aedf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '36c6f629-d01c-4a9e-89ca-25cd69acc13f', 'enforce_multipath': True} {{(pid=87230) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 09 14:47:43 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-570f4aa6-3d4e-48a2-b6d0-844a497d16b1 req-fb62088f-ef1f-49bb-aa4d-aa2774d884ab tempest-TestServerVolumeAttachmentScenario-1599287603 None] attachment_update completed successfully.
Jul 09 14:47:52 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 14:47:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:47:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:47:52 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:47:52 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:47:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:47:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:47:52 devstack sudo[103271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:47:52 devstack sudo[103271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:47:53 devstack sudo[103271]: pam_unix(sudo:session): session closed for user root
Jul 09 14:47:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.758s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:47:53 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:47:53 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Running periodic task VolumeManager._thread_info {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 14:47:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] thread count: 28 {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 09 14:47:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] thread info: [<_MainThread(MainThread, started 125388812103808)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125388713797504)>, <Thread(Thread-3 (stat_writer), started daemon 125388699995392)>, <Thread(Rabbit-heartbeat, started daemon 125388700522560)>, <Thread(Thread-5 (_runner), started daemon 125388698545216)>, <Thread(Thread-7 (_runner), started daemon 125388698611264)>, <Thread(fd_logger, started daemon 125388703020672)>, <Thread(privsep_reader, started daemon 125388696441088)>, <Thread(tpool_thread_0, started daemon 125388687943360)>, <Thread(tpool_thread_1, started daemon 125388679550656)>, <Thread(tpool_thread_2, started daemon 125388671141568)>, <Thread(tpool_thread_3, started daemon 125388662732480)>, <Thread(tpool_thread_4, started daemon 125388654323392)>, <Thread(tpool_thread_5, started daemon 125388645914304)>, <Thread(tpool_thread_6, started daemon 125388637505216)>, <Thread(tpool_thread_7, started daemon 125388629096128)>, <Thread(tpool_thread_8, started daemon 125388620687040)>, <Thread(tpool_thread_9, started daemon 125388612277952)>, <Thread(tpool_thread_10, started daemon 125388603868864)>, <Thread(tpool_thread_11, started daemon 125388595459776)>, <Thread(tpool_thread_12, started daemon 125388587050688)>, <Thread(tpool_thread_13, started daemon 125388578641600)>, <Thread(tpool_thread_14, started daemon 125388570232512)>, <Thread(tpool_thread_15, started daemon 125388561823424)>, <Thread(tpool_thread_16, started daemon 125388553414336)>, <Thread(tpool_thread_17, started daemon 125388545005248)>, <Thread(tpool_thread_18, started daemon 125388536596160)>, <Thread(tpool_thread_19, started daemon 125388528187072)>] {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 09 14:47:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-58312981-f864-45e0-b7e5-1fb3bb0fafe8 req-d8e9346f-81b1-4509-9024-dbb02e805f4a tempest-TestServerVolumeAttachmentScenario-1599287603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:47:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-58312981-f864-45e0-b7e5-1fb3bb0fafe8 req-d8e9346f-81b1-4509-9024-dbb02e805f4a tempest-TestServerVolumeAttachmentScenario-1599287603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:47:53 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[191ee391-a4a6-4228-9217-6f0d036ce3bc]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:47:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-58312981-f864-45e0-b7e5-1fb3bb0fafe8 req-d8e9346f-81b1-4509-9024-dbb02e805f4a tempest-TestServerVolumeAttachmentScenario-1599287603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d701d17f-df37-428b-8573-cc1ef023bc2b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:47:53 devstack sudo[103282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d701d17f-df37-428b-8573-cc1ef023bc2b
Jul 09 14:47:53 devstack sudo[103282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:47:54 devstack sudo[103282]: pam_unix(sudo:session): session closed for user root
Jul 09 14:47:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-58312981-f864-45e0-b7e5-1fb3bb0fafe8 req-d8e9346f-81b1-4509-9024-dbb02e805f4a tempest-TestServerVolumeAttachmentScenario-1599287603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d701d17f-df37-428b-8573-cc1ef023bc2b" returned: 0 in 0.842s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:47:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-58312981-f864-45e0-b7e5-1fb3bb0fafe8 req-d8e9346f-81b1-4509-9024-dbb02e805f4a tempest-TestServerVolumeAttachmentScenario-1599287603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.859s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:47:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-58312981-f864-45e0-b7e5-1fb3bb0fafe8 req-d8e9346f-81b1-4509-9024-dbb02e805f4a tempest-TestServerVolumeAttachmentScenario-1599287603 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653', 'name': 'volume-d701d17f-df37-428b-8573-cc1ef023bc2b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '07b18c93-ba35-4bf2-8ec4-95035f169edb', 'enforce_multipath': True} {{(pid=87230) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 09 14:47:54 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-58312981-f864-45e0-b7e5-1fb3bb0fafe8 req-d8e9346f-81b1-4509-9024-dbb02e805f4a tempest-TestServerVolumeAttachmentScenario-1599287603 None] attachment_update completed successfully.
Jul 09 14:47:59 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-c37d079d-408a-4953-a570-45638595af8e req-c2338a72-00cf-483b-9756-51387ce68729 tempest-TestServerVolumeAttachmentScenario-1599287603 None] Terminate volume connection completed successfully.
Jul 09 14:47:59 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-c37d079d-408a-4953-a570-45638595af8e req-c2338a72-00cf-483b-9756-51387ce68729 tempest-TestServerVolumeAttachmentScenario-1599287603 None] Deleting attachment 07b18c93-ba35-4bf2-8ec4-95035f169edb. {{(pid=87230) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 09 14:48:03 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-ce7c9a07-7176-4c2c-ba9f-35e42872606b req-51164a72-9d13-425d-89ec-f45ef134a2a9 tempest-TestServerVolumeAttachmentScenario-1599287603 None] Terminate volume connection completed successfully.
Jul 09 14:48:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-ce7c9a07-7176-4c2c-ba9f-35e42872606b req-51164a72-9d13-425d-89ec-f45ef134a2a9 tempest-TestServerVolumeAttachmentScenario-1599287603 None] Deleting attachment 36c6f629-d01c-4a9e-89ca-25cd69acc13f. {{(pid=87230) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 09 14:48:09 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=14,cinder:UPDATE=4 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 14:48:13 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=13,cinder:UPDATE=3 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 14:48:14 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-89649126-f324-45b6-aae1-24825d49ee31 tempest-TestServerVolumeAttachmentScenario-1599287603 None] Acquiring lock "cinder-d701d17f-df37-428b-8573-cc1ef023bc2b-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:48:14 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-89649126-f324-45b6-aae1-24825d49ee31 tempest-TestServerVolumeAttachmentScenario-1599287603 None] Lock "cinder-d701d17f-df37-428b-8573-cc1ef023bc2b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:48:14 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-89649126-f324-45b6-aae1-24825d49ee31 tempest-TestServerVolumeAttachmentScenario-1599287603 None] Acquiring lock "cinder-quobyte-d701d17f-df37-428b-8573-cc1ef023bc2b" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:48:14 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-89649126-f324-45b6-aae1-24825d49ee31 tempest-TestServerVolumeAttachmentScenario-1599287603 None] Lock "cinder-quobyte-d701d17f-df37-428b-8573-cc1ef023bc2b" acquired by "delete_volume" :: waited 0.019s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:48:14 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[b942d894-0e28-463a-8255-4374dd40199b]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:48:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-89649126-f324-45b6-aae1-24825d49ee31 tempest-TestServerVolumeAttachmentScenario-1599287603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d701d17f-df37-428b-8573-cc1ef023bc2b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:48:14 devstack sudo[103432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d701d17f-df37-428b-8573-cc1ef023bc2b
Jul 09 14:48:14 devstack sudo[103432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:48:15 devstack sudo[103432]: pam_unix(sudo:session): session closed for user root
Jul 09 14:48:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-89649126-f324-45b6-aae1-24825d49ee31 tempest-TestServerVolumeAttachmentScenario-1599287603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d701d17f-df37-428b-8573-cc1ef023bc2b" returned: 0 in 0.797s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:48:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-89649126-f324-45b6-aae1-24825d49ee31 tempest-TestServerVolumeAttachmentScenario-1599287603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d701d17f-df37-428b-8573-cc1ef023bc2b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:48:15 devstack sudo[103456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d701d17f-df37-428b-8573-cc1ef023bc2b
Jul 09 14:48:15 devstack sudo[103456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:48:15 devstack sudo[103456]: pam_unix(sudo:session): session closed for user root
Jul 09 14:48:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-89649126-f324-45b6-aae1-24825d49ee31 tempest-TestServerVolumeAttachmentScenario-1599287603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d701d17f-df37-428b-8573-cc1ef023bc2b" returned: 0 in 0.657s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:48:15 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-89649126-f324-45b6-aae1-24825d49ee31 tempest-TestServerVolumeAttachmentScenario-1599287603 None] Lock "cinder-quobyte-d701d17f-df37-428b-8573-cc1ef023bc2b" released by "delete_volume" :: held 1.515s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:48:15 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-89649126-f324-45b6-aae1-24825d49ee31 tempest-TestServerVolumeAttachmentScenario-1599287603 None] Created reservations ['97aa3ab3-2e61-4748-be1a-981c7946b387', '6575f095-d4ba-427e-bc2d-a7c0ed65bd8f', '69d34610-301f-4cf5-b8d1-63756e36e508', '0568eb48-0b3d-435c-a057-fb33a410606d'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:48:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-89649126-f324-45b6-aae1-24825d49ee31 tempest-TestServerVolumeAttachmentScenario-1599287603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:48:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-89649126-f324-45b6-aae1-24825d49ee31 tempest-TestServerVolumeAttachmentScenario-1599287603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:48:16 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-89649126-f324-45b6-aae1-24825d49ee31 tempest-TestServerVolumeAttachmentScenario-1599287603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:48:16 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-89649126-f324-45b6-aae1-24825d49ee31 tempest-TestServerVolumeAttachmentScenario-1599287603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:48:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-89649126-f324-45b6-aae1-24825d49ee31 tempest-TestServerVolumeAttachmentScenario-1599287603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:48:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-89649126-f324-45b6-aae1-24825d49ee31 tempest-TestServerVolumeAttachmentScenario-1599287603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:48:16 devstack sudo[103461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:48:16 devstack sudo[103461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:48:16 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-074e0045-dffe-4131-b187-3b4419e5a54a tempest-TestServerVolumeAttachmentScenario-1599287603 None] Acquiring lock "cinder-db35f973-ace0-48e3-8726-54408208aedf-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:48:16 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-074e0045-dffe-4131-b187-3b4419e5a54a tempest-TestServerVolumeAttachmentScenario-1599287603 None] Lock "cinder-db35f973-ace0-48e3-8726-54408208aedf-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:48:16 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-074e0045-dffe-4131-b187-3b4419e5a54a tempest-TestServerVolumeAttachmentScenario-1599287603 None] Acquiring lock "cinder-quobyte-db35f973-ace0-48e3-8726-54408208aedf" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:48:16 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-074e0045-dffe-4131-b187-3b4419e5a54a tempest-TestServerVolumeAttachmentScenario-1599287603 None] Lock "cinder-quobyte-db35f973-ace0-48e3-8726-54408208aedf" acquired by "delete_volume" :: waited 0.024s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:48:16 devstack sudo[103461]: pam_unix(sudo:session): session closed for user root
Jul 09 14:48:16 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e7100a-0878-48a3-a38f-0ec2518151ef]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:48:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-074e0045-dffe-4131-b187-3b4419e5a54a tempest-TestServerVolumeAttachmentScenario-1599287603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-db35f973-ace0-48e3-8726-54408208aedf {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:48:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-89649126-f324-45b6-aae1-24825d49ee31 tempest-TestServerVolumeAttachmentScenario-1599287603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.772s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:48:16 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-89649126-f324-45b6-aae1-24825d49ee31 tempest-TestServerVolumeAttachmentScenario-1599287603 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:48:16 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-89649126-f324-45b6-aae1-24825d49ee31 tempest-TestServerVolumeAttachmentScenario-1599287603 None] Deleted volume successfully.
Jul 09 14:48:16 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-89649126-f324-45b6-aae1-24825d49ee31 tempest-TestServerVolumeAttachmentScenario-1599287603 None] Lock "cinder-d701d17f-df37-428b-8573-cc1ef023bc2b-delete_volume" released by "delete_volume" :: held 2.544s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:48:16 devstack sudo[103464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-db35f973-ace0-48e3-8726-54408208aedf
Jul 09 14:48:16 devstack sudo[103464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:48:17 devstack sudo[103464]: pam_unix(sudo:session): session closed for user root
Jul 09 14:48:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-074e0045-dffe-4131-b187-3b4419e5a54a tempest-TestServerVolumeAttachmentScenario-1599287603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-db35f973-ace0-48e3-8726-54408208aedf" returned: 0 in 0.811s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:48:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-074e0045-dffe-4131-b187-3b4419e5a54a tempest-TestServerVolumeAttachmentScenario-1599287603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-db35f973-ace0-48e3-8726-54408208aedf {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:48:17 devstack sudo[103469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-db35f973-ace0-48e3-8726-54408208aedf
Jul 09 14:48:17 devstack sudo[103469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:48:18 devstack sudo[103469]: pam_unix(sudo:session): session closed for user root
Jul 09 14:48:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-074e0045-dffe-4131-b187-3b4419e5a54a tempest-TestServerVolumeAttachmentScenario-1599287603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-db35f973-ace0-48e3-8726-54408208aedf" returned: 0 in 0.673s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:48:18 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-074e0045-dffe-4131-b187-3b4419e5a54a tempest-TestServerVolumeAttachmentScenario-1599287603 None] Lock "cinder-quobyte-db35f973-ace0-48e3-8726-54408208aedf" released by "delete_volume" :: held 1.545s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:48:18 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-074e0045-dffe-4131-b187-3b4419e5a54a tempest-TestServerVolumeAttachmentScenario-1599287603 None] Created reservations ['cfc92f76-b409-4a91-ac1d-5efd8668d0e1', 'ea50c93c-769b-42a3-83e7-b29552afec51', 'fe487527-ef1d-4eff-8f55-9bf6b512af22', '48eae24b-4342-4ce5-aae7-9eae96a0aa06'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:48:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-074e0045-dffe-4131-b187-3b4419e5a54a tempest-TestServerVolumeAttachmentScenario-1599287603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:48:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-074e0045-dffe-4131-b187-3b4419e5a54a tempest-TestServerVolumeAttachmentScenario-1599287603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:48:18 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-074e0045-dffe-4131-b187-3b4419e5a54a tempest-TestServerVolumeAttachmentScenario-1599287603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:48:18 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-074e0045-dffe-4131-b187-3b4419e5a54a tempest-TestServerVolumeAttachmentScenario-1599287603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:48:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-074e0045-dffe-4131-b187-3b4419e5a54a tempest-TestServerVolumeAttachmentScenario-1599287603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:48:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-074e0045-dffe-4131-b187-3b4419e5a54a tempest-TestServerVolumeAttachmentScenario-1599287603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:48:18 devstack sudo[103472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:48:18 devstack sudo[103472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:48:19 devstack sudo[103472]: pam_unix(sudo:session): session closed for user root
Jul 09 14:48:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-074e0045-dffe-4131-b187-3b4419e5a54a tempest-TestServerVolumeAttachmentScenario-1599287603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.796s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:48:19 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-074e0045-dffe-4131-b187-3b4419e5a54a tempest-TestServerVolumeAttachmentScenario-1599287603 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:48:19 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-074e0045-dffe-4131-b187-3b4419e5a54a tempest-TestServerVolumeAttachmentScenario-1599287603 None] Deleted volume successfully.
Jul 09 14:48:19 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-074e0045-dffe-4131-b187-3b4419e5a54a tempest-TestServerVolumeAttachmentScenario-1599287603 None] Lock "cinder-db35f973-ace0-48e3-8726-54408208aedf-delete_volume" released by "delete_volume" :: held 2.650s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:48:28 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=11,cinder:INSERT=6,cinder:UPDATE=14 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 14:48:29 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=9,cinder:UPDATE=18,cinder:INSERT=2,cinder:DELETE=2 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 14:48:40 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-c78a5d26-c5a5-4c66-ad5d-482ede6d49b0 tempest-TestServerVolumeAttachScenarioOldVersion-700157790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:48:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c78a5d26-c5a5-4c66-ad5d-482ede6d49b0 tempest-TestServerVolumeAttachScenarioOldVersion-700157790 None] Flow 'volume_create_manager' (a38097e9-f259-473b-a8ba-67bc443f5b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:48:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c78a5d26-c5a5-4c66-ad5d-482ede6d49b0 tempest-TestServerVolumeAttachScenarioOldVersion-700157790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1baca21b-3da3-4717-8952-7e315a67e035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:48:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c78a5d26-c5a5-4c66-ad5d-482ede6d49b0 tempest-TestServerVolumeAttachScenarioOldVersion-700157790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1baca21b-3da3-4717-8952-7e315a67e035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:48:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-957648624',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63ae767f-c4e7-4a6e-a750-40b316bd2be5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af6ec2ad76074033924270193cbd54e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:48:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:48:40Z,use_quota=True,user_id='dbc3b4eabdc140da8a186a742546340a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:48:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c78a5d26-c5a5-4c66-ad5d-482ede6d49b0 tempest-TestServerVolumeAttachScenarioOldVersion-700157790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (420e25c2-ddf0-44c6-8caa-80d3c4dd624d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:48:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c78a5d26-c5a5-4c66-ad5d-482ede6d49b0 tempest-TestServerVolumeAttachScenarioOldVersion-700157790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (420e25c2-ddf0-44c6-8caa-80d3c4dd624d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:48:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c78a5d26-c5a5-4c66-ad5d-482ede6d49b0 tempest-TestServerVolumeAttachScenarioOldVersion-700157790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52de5499-4846-4f8d-b44c-bf084ec32c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:48:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c78a5d26-c5a5-4c66-ad5d-482ede6d49b0 tempest-TestServerVolumeAttachScenarioOldVersion-700157790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52de5499-4846-4f8d-b44c-bf084ec32c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63ae767f-c4e7-4a6e-a750-40b316bd2be5', 'volume_name': 'volume-63ae767f-c4e7-4a6e-a750-40b316bd2be5', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:48:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c78a5d26-c5a5-4c66-ad5d-482ede6d49b0 tempest-TestServerVolumeAttachScenarioOldVersion-700157790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f096a5c-b79f-4fe5-a77f-2f24f9510af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:48:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c78a5d26-c5a5-4c66-ad5d-482ede6d49b0 tempest-TestServerVolumeAttachScenarioOldVersion-700157790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f096a5c-b79f-4fe5-a77f-2f24f9510af0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:48:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c78a5d26-c5a5-4c66-ad5d-482ede6d49b0 tempest-TestServerVolumeAttachScenarioOldVersion-700157790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e699dd3-e10f-4c49-9011-78c7cddf0e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:48:40 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-c78a5d26-c5a5-4c66-ad5d-482ede6d49b0 tempest-TestServerVolumeAttachScenarioOldVersion-700157790 None] Volume 63ae767f-c4e7-4a6e-a750-40b316bd2be5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63ae767f-c4e7-4a6e-a750-40b316bd2be5', 'volume_size': 1}
Jul 09 14:48:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c78a5d26-c5a5-4c66-ad5d-482ede6d49b0 tempest-TestServerVolumeAttachScenarioOldVersion-700157790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:48:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c78a5d26-c5a5-4c66-ad5d-482ede6d49b0 tempest-TestServerVolumeAttachScenarioOldVersion-700157790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:48:40 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-c78a5d26-c5a5-4c66-ad5d-482ede6d49b0 tempest-TestServerVolumeAttachScenarioOldVersion-700157790 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:48:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-957648624',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63ae767f-c4e7-4a6e-a750-40b316bd2be5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af6ec2ad76074033924270193cbd54e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:48:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:48:40Z,use_quota=True,user_id='dbc3b4eabdc140da8a186a742546340a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:48:40 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-c78a5d26-c5a5-4c66-ad5d-482ede6d49b0 tempest-TestServerVolumeAttachScenarioOldVersion-700157790 None] Creating volume 63ae767f-c4e7-4a6e-a750-40b316bd2be5 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:48:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c78a5d26-c5a5-4c66-ad5d-482ede6d49b0 tempest-TestServerVolumeAttachScenarioOldVersion-700157790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:48:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c78a5d26-c5a5-4c66-ad5d-482ede6d49b0 tempest-TestServerVolumeAttachScenarioOldVersion-700157790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:48:40 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-c78a5d26-c5a5-4c66-ad5d-482ede6d49b0 tempest-TestServerVolumeAttachScenarioOldVersion-700157790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:48:40 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-c78a5d26-c5a5-4c66-ad5d-482ede6d49b0 tempest-TestServerVolumeAttachScenarioOldVersion-700157790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:48:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c78a5d26-c5a5-4c66-ad5d-482ede6d49b0 tempest-TestServerVolumeAttachScenarioOldVersion-700157790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:48:40 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-c78a5d26-c5a5-4c66-ad5d-482ede6d49b0 tempest-TestServerVolumeAttachScenarioOldVersion-700157790 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:48:40 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-c78a5d26-c5a5-4c66-ad5d-482ede6d49b0 tempest-TestServerVolumeAttachScenarioOldVersion-700157790 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:48:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c78a5d26-c5a5-4c66-ad5d-482ede6d49b0 tempest-TestServerVolumeAttachScenarioOldVersion-700157790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-63ae767f-c4e7-4a6e-a750-40b316bd2be5 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:48:40 devstack sudo[103507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-63ae767f-c4e7-4a6e-a750-40b316bd2be5 1073741824
Jul 09 14:48:40 devstack sudo[103507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:48:41 devstack sudo[103507]: pam_unix(sudo:session): session closed for user root
Jul 09 14:48:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c78a5d26-c5a5-4c66-ad5d-482ede6d49b0 tempest-TestServerVolumeAttachScenarioOldVersion-700157790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-63ae767f-c4e7-4a6e-a750-40b316bd2be5 1073741824" returned: 0 in 0.900s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:48:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c78a5d26-c5a5-4c66-ad5d-482ede6d49b0 tempest-TestServerVolumeAttachScenarioOldVersion-700157790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-63ae767f-c4e7-4a6e-a750-40b316bd2be5 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:48:41 devstack sudo[103513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-63ae767f-c4e7-4a6e-a750-40b316bd2be5
Jul 09 14:48:41 devstack sudo[103513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:48:41 devstack sudo[103513]: pam_unix(sudo:session): session closed for user root
Jul 09 14:48:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c78a5d26-c5a5-4c66-ad5d-482ede6d49b0 tempest-TestServerVolumeAttachScenarioOldVersion-700157790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-63ae767f-c4e7-4a6e-a750-40b316bd2be5" returned: 0 in 0.664s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:48:41 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-c78a5d26-c5a5-4c66-ad5d-482ede6d49b0 tempest-TestServerVolumeAttachScenarioOldVersion-700157790 None] <== create_volume: return (1614ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:48:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c78a5d26-c5a5-4c66-ad5d-482ede6d49b0 tempest-TestServerVolumeAttachScenarioOldVersion-700157790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.616s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:48:41 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c78a5d26-c5a5-4c66-ad5d-482ede6d49b0 tempest-TestServerVolumeAttachScenarioOldVersion-700157790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e699dd3-e10f-4c49-9011-78c7cddf0e67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63ae767f-c4e7-4a6e-a750-40b316bd2be5', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:48:41 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c78a5d26-c5a5-4c66-ad5d-482ede6d49b0 tempest-TestServerVolumeAttachScenarioOldVersion-700157790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2d408f4-d5b9-4c44-9eab-faf82b04abe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:48:41 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-c78a5d26-c5a5-4c66-ad5d-482ede6d49b0 tempest-TestServerVolumeAttachScenarioOldVersion-700157790 None] Volume volume-63ae767f-c4e7-4a6e-a750-40b316bd2be5 (63ae767f-c4e7-4a6e-a750-40b316bd2be5): created successfully
Jul 09 14:48:41 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c78a5d26-c5a5-4c66-ad5d-482ede6d49b0 tempest-TestServerVolumeAttachScenarioOldVersion-700157790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2d408f4-d5b9-4c44-9eab-faf82b04abe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:48:41 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c78a5d26-c5a5-4c66-ad5d-482ede6d49b0 tempest-TestServerVolumeAttachScenarioOldVersion-700157790 None] Flow 'volume_create_manager' (a38097e9-f259-473b-a8ba-67bc443f5b88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:48:41 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-c78a5d26-c5a5-4c66-ad5d-482ede6d49b0 tempest-TestServerVolumeAttachScenarioOldVersion-700157790 None] Created volume successfully.
Jul 09 14:48:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-b4196313-dff9-465b-9579-e96da8f3a8f3 req-cfea13c9-76fa-46fc-8a4d-5fd83d61f16e tempest-TestServerVolumeAttachScenarioOldVersion-700157790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:48:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-b4196313-dff9-465b-9579-e96da8f3a8f3 req-cfea13c9-76fa-46fc-8a4d-5fd83d61f16e tempest-TestServerVolumeAttachScenarioOldVersion-700157790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:48:45 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c5e4ab-111a-4081-8445-5caff185cee8]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:48:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-b4196313-dff9-465b-9579-e96da8f3a8f3 req-cfea13c9-76fa-46fc-8a4d-5fd83d61f16e tempest-TestServerVolumeAttachScenarioOldVersion-700157790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-63ae767f-c4e7-4a6e-a750-40b316bd2be5 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:48:45 devstack sudo[103563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-63ae767f-c4e7-4a6e-a750-40b316bd2be5
Jul 09 14:48:45 devstack sudo[103563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:48:46 devstack sudo[103563]: pam_unix(sudo:session): session closed for user root
Jul 09 14:48:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-b4196313-dff9-465b-9579-e96da8f3a8f3 req-cfea13c9-76fa-46fc-8a4d-5fd83d61f16e tempest-TestServerVolumeAttachScenarioOldVersion-700157790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-63ae767f-c4e7-4a6e-a750-40b316bd2be5" returned: 0 in 0.867s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:48:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-b4196313-dff9-465b-9579-e96da8f3a8f3 req-cfea13c9-76fa-46fc-8a4d-5fd83d61f16e tempest-TestServerVolumeAttachScenarioOldVersion-700157790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.906s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:48:46 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-b4196313-dff9-465b-9579-e96da8f3a8f3 req-cfea13c9-76fa-46fc-8a4d-5fd83d61f16e tempest-TestServerVolumeAttachScenarioOldVersion-700157790 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653', 'name': 'volume-63ae767f-c4e7-4a6e-a750-40b316bd2be5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ecf1e2d9-1986-44c8-9aa0-f65699ddc39d', 'enforce_multipath': True} {{(pid=87230) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 09 14:48:46 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-b4196313-dff9-465b-9579-e96da8f3a8f3 req-cfea13c9-76fa-46fc-8a4d-5fd83d61f16e tempest-TestServerVolumeAttachScenarioOldVersion-700157790 None] attachment_update completed successfully.
Jul 09 14:48:51 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-40adda16-8786-4e3a-b733-af983b7dd99f tempest-TestStampPattern-1052481563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:48:51 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-40adda16-8786-4e3a-b733-af983b7dd99f tempest-TestStampPattern-1052481563 None] Flow 'volume_create_manager' (4aab8d77-8fdd-40fd-9336-a11303069a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:48:51 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-40adda16-8786-4e3a-b733-af983b7dd99f tempest-TestStampPattern-1052481563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ce0716d-605e-4943-9a4e-1a4acbeb6a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:48:51 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-40adda16-8786-4e3a-b733-af983b7dd99f tempest-TestStampPattern-1052481563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ce0716d-605e-4943-9a4e-1a4acbeb6a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:48:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-812711132',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e99cbc0-ed4d-4afc-98e9-f3d7fc32b506,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1b1ce49e17d4ad49dc23185dd1559dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:48:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:48:51Z,use_quota=True,user_id='763f1c41ac1e46ad814ff793f61b66fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:48:51 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-40adda16-8786-4e3a-b733-af983b7dd99f tempest-TestStampPattern-1052481563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cae394dc-a27c-4179-b7e7-7739d39a5804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:48:51 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-40adda16-8786-4e3a-b733-af983b7dd99f tempest-TestStampPattern-1052481563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cae394dc-a27c-4179-b7e7-7739d39a5804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:48:51 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-40adda16-8786-4e3a-b733-af983b7dd99f tempest-TestStampPattern-1052481563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ba20d43-ef01-49eb-b6eb-805d2b224b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:48:51 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-40adda16-8786-4e3a-b733-af983b7dd99f tempest-TestStampPattern-1052481563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ba20d43-ef01-49eb-b6eb-805d2b224b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e99cbc0-ed4d-4afc-98e9-f3d7fc32b506', 'volume_name': 'volume-1e99cbc0-ed4d-4afc-98e9-f3d7fc32b506', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:48:51 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-40adda16-8786-4e3a-b733-af983b7dd99f tempest-TestStampPattern-1052481563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (740bf975-1011-4d1a-bb04-93d35c52b55e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:48:51 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-40adda16-8786-4e3a-b733-af983b7dd99f tempest-TestStampPattern-1052481563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (740bf975-1011-4d1a-bb04-93d35c52b55e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:48:51 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-40adda16-8786-4e3a-b733-af983b7dd99f tempest-TestStampPattern-1052481563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c9b72da-a871-4f55-90f8-02ab927087e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:48:51 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-40adda16-8786-4e3a-b733-af983b7dd99f tempest-TestStampPattern-1052481563 None] Volume 1e99cbc0-ed4d-4afc-98e9-f3d7fc32b506: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e99cbc0-ed4d-4afc-98e9-f3d7fc32b506', 'volume_size': 1}
Jul 09 14:48:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-40adda16-8786-4e3a-b733-af983b7dd99f tempest-TestStampPattern-1052481563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:48:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-40adda16-8786-4e3a-b733-af983b7dd99f tempest-TestStampPattern-1052481563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:48:51 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-40adda16-8786-4e3a-b733-af983b7dd99f tempest-TestStampPattern-1052481563 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:48:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-812711132',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e99cbc0-ed4d-4afc-98e9-f3d7fc32b506,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1b1ce49e17d4ad49dc23185dd1559dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:48:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:48:51Z,use_quota=True,user_id='763f1c41ac1e46ad814ff793f61b66fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:48:51 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-40adda16-8786-4e3a-b733-af983b7dd99f tempest-TestStampPattern-1052481563 None] Creating volume 1e99cbc0-ed4d-4afc-98e9-f3d7fc32b506 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:48:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-40adda16-8786-4e3a-b733-af983b7dd99f tempest-TestStampPattern-1052481563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:48:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-40adda16-8786-4e3a-b733-af983b7dd99f tempest-TestStampPattern-1052481563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:48:51 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-40adda16-8786-4e3a-b733-af983b7dd99f tempest-TestStampPattern-1052481563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:48:51 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-40adda16-8786-4e3a-b733-af983b7dd99f tempest-TestStampPattern-1052481563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:48:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-40adda16-8786-4e3a-b733-af983b7dd99f tempest-TestStampPattern-1052481563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:48:51 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-40adda16-8786-4e3a-b733-af983b7dd99f tempest-TestStampPattern-1052481563 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:48:51 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-40adda16-8786-4e3a-b733-af983b7dd99f tempest-TestStampPattern-1052481563 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:48:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-40adda16-8786-4e3a-b733-af983b7dd99f tempest-TestStampPattern-1052481563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1e99cbc0-ed4d-4afc-98e9-f3d7fc32b506 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:48:51 devstack sudo[103951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1e99cbc0-ed4d-4afc-98e9-f3d7fc32b506 1073741824
Jul 09 14:48:51 devstack sudo[103951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:48:52 devstack sudo[103951]: pam_unix(sudo:session): session closed for user root
Jul 09 14:48:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-40adda16-8786-4e3a-b733-af983b7dd99f tempest-TestStampPattern-1052481563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1e99cbc0-ed4d-4afc-98e9-f3d7fc32b506 1073741824" returned: 0 in 1.000s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:48:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-40adda16-8786-4e3a-b733-af983b7dd99f tempest-TestStampPattern-1052481563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1e99cbc0-ed4d-4afc-98e9-f3d7fc32b506 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:48:52 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 14:48:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:48:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:48:52 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:48:52 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:48:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:48:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:48:52 devstack sudo[103960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1e99cbc0-ed4d-4afc-98e9-f3d7fc32b506
Jul 09 14:48:52 devstack sudo[103960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:48:52 devstack sudo[103962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:48:52 devstack sudo[103962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:48:53 devstack sudo[103960]: pam_unix(sudo:session): session closed for user root
Jul 09 14:48:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-40adda16-8786-4e3a-b733-af983b7dd99f tempest-TestStampPattern-1052481563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1e99cbc0-ed4d-4afc-98e9-f3d7fc32b506" returned: 0 in 0.686s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:48:53 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-40adda16-8786-4e3a-b733-af983b7dd99f tempest-TestStampPattern-1052481563 None] <== create_volume: return (1736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:48:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-40adda16-8786-4e3a-b733-af983b7dd99f tempest-TestStampPattern-1052481563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.738s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:48:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-40adda16-8786-4e3a-b733-af983b7dd99f tempest-TestStampPattern-1052481563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c9b72da-a871-4f55-90f8-02ab927087e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e99cbc0-ed4d-4afc-98e9-f3d7fc32b506', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:48:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-40adda16-8786-4e3a-b733-af983b7dd99f tempest-TestStampPattern-1052481563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9d27175-5055-4f12-843a-eafbdf36569c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:48:53 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-40adda16-8786-4e3a-b733-af983b7dd99f tempest-TestStampPattern-1052481563 None] Volume volume-1e99cbc0-ed4d-4afc-98e9-f3d7fc32b506 (1e99cbc0-ed4d-4afc-98e9-f3d7fc32b506): created successfully
Jul 09 14:48:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-40adda16-8786-4e3a-b733-af983b7dd99f tempest-TestStampPattern-1052481563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9d27175-5055-4f12-843a-eafbdf36569c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:48:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-40adda16-8786-4e3a-b733-af983b7dd99f tempest-TestStampPattern-1052481563 None] Flow 'volume_create_manager' (4aab8d77-8fdd-40fd-9336-a11303069a3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:48:53 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-40adda16-8786-4e3a-b733-af983b7dd99f tempest-TestStampPattern-1052481563 None] Created volume successfully.
Jul 09 14:48:53 devstack sudo[103962]: pam_unix(sudo:session): session closed for user root
Jul 09 14:48:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.781s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:48:53 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:48:53 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Running periodic task VolumeManager._thread_info {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 14:48:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] thread count: 28 {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 09 14:48:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] thread info: [<_MainThread(MainThread, started 125388812103808)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125388713797504)>, <Thread(Thread-3 (stat_writer), started daemon 125388699995392)>, <Thread(Rabbit-heartbeat, started daemon 125388700522560)>, <Thread(Thread-5 (_runner), started daemon 125388698545216)>, <Thread(Thread-7 (_runner), started daemon 125388698611264)>, <Thread(fd_logger, started daemon 125388703020672)>, <Thread(privsep_reader, started daemon 125388696441088)>, <Thread(tpool_thread_0, started daemon 125388687943360)>, <Thread(tpool_thread_1, started daemon 125388679550656)>, <Thread(tpool_thread_2, started daemon 125388671141568)>, <Thread(tpool_thread_3, started daemon 125388662732480)>, <Thread(tpool_thread_4, started daemon 125388654323392)>, <Thread(tpool_thread_5, started daemon 125388645914304)>, <Thread(tpool_thread_6, started daemon 125388637505216)>, <Thread(tpool_thread_7, started daemon 125388629096128)>, <Thread(tpool_thread_8, started daemon 125388620687040)>, <Thread(tpool_thread_9, started daemon 125388612277952)>, <Thread(tpool_thread_10, started daemon 125388603868864)>, <Thread(tpool_thread_11, started daemon 125388595459776)>, <Thread(tpool_thread_12, started daemon 125388587050688)>, <Thread(tpool_thread_13, started daemon 125388578641600)>, <Thread(tpool_thread_14, started daemon 125388570232512)>, <Thread(tpool_thread_15, started daemon 125388561823424)>, <Thread(tpool_thread_16, started daemon 125388553414336)>, <Thread(tpool_thread_17, started daemon 125388545005248)>, <Thread(tpool_thread_18, started daemon 125388536596160)>, <Thread(tpool_thread_19, started daemon 125388528187072)>] {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 09 14:48:53 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-e87407e3-e567-4717-afc9-971e2be8fe73 req-7e317009-38a1-49ba-b2b7-e4f00a372058 tempest-TestServerVolumeAttachScenarioOldVersion-700157790 None] Terminate volume connection completed successfully.
Jul 09 14:48:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-e87407e3-e567-4717-afc9-971e2be8fe73 req-7e317009-38a1-49ba-b2b7-e4f00a372058 tempest-TestServerVolumeAttachScenarioOldVersion-700157790 None] Deleting attachment ecf1e2d9-1986-44c8-9aa0-f65699ddc39d. {{(pid=87230) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 09 14:48:55 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-53456184-d296-4f06-81af-bef41e47ece3 tempest-TestServerVolumeAttachScenarioOldVersion-700157790 None] Acquiring lock "cinder-63ae767f-c4e7-4a6e-a750-40b316bd2be5-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:48:55 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-53456184-d296-4f06-81af-bef41e47ece3 tempest-TestServerVolumeAttachScenarioOldVersion-700157790 None] Lock "cinder-63ae767f-c4e7-4a6e-a750-40b316bd2be5-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:48:55 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-53456184-d296-4f06-81af-bef41e47ece3 tempest-TestServerVolumeAttachScenarioOldVersion-700157790 None] Acquiring lock "cinder-quobyte-63ae767f-c4e7-4a6e-a750-40b316bd2be5" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:48:55 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-53456184-d296-4f06-81af-bef41e47ece3 tempest-TestServerVolumeAttachScenarioOldVersion-700157790 None] Lock "cinder-quobyte-63ae767f-c4e7-4a6e-a750-40b316bd2be5" acquired by "delete_volume" :: waited 0.027s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:48:55 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee0bfc84-d402-4bb4-a783-9b295a7d1327]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:48:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-53456184-d296-4f06-81af-bef41e47ece3 tempest-TestServerVolumeAttachScenarioOldVersion-700157790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-63ae767f-c4e7-4a6e-a750-40b316bd2be5 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:48:56 devstack sudo[103999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-63ae767f-c4e7-4a6e-a750-40b316bd2be5
Jul 09 14:48:56 devstack sudo[103999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:48:56 devstack sudo[103999]: pam_unix(sudo:session): session closed for user root
Jul 09 14:48:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-53456184-d296-4f06-81af-bef41e47ece3 tempest-TestServerVolumeAttachScenarioOldVersion-700157790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-63ae767f-c4e7-4a6e-a750-40b316bd2be5" returned: 0 in 0.760s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:48:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-53456184-d296-4f06-81af-bef41e47ece3 tempest-TestServerVolumeAttachScenarioOldVersion-700157790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-63ae767f-c4e7-4a6e-a750-40b316bd2be5 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:48:56 devstack sudo[104005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-63ae767f-c4e7-4a6e-a750-40b316bd2be5
Jul 09 14:48:56 devstack sudo[104005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:48:57 devstack sudo[104005]: pam_unix(sudo:session): session closed for user root
Jul 09 14:48:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-53456184-d296-4f06-81af-bef41e47ece3 tempest-TestServerVolumeAttachScenarioOldVersion-700157790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-63ae767f-c4e7-4a6e-a750-40b316bd2be5" returned: 0 in 0.740s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:48:57 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-53456184-d296-4f06-81af-bef41e47ece3 tempest-TestServerVolumeAttachScenarioOldVersion-700157790 None] Lock "cinder-quobyte-63ae767f-c4e7-4a6e-a750-40b316bd2be5" released by "delete_volume" :: held 1.556s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:48:57 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-53456184-d296-4f06-81af-bef41e47ece3 tempest-TestServerVolumeAttachScenarioOldVersion-700157790 None] Created reservations ['9048e1aa-fe3b-467e-a6b5-1b3f2db8bbd8', '53587047-2a06-41c3-93eb-e5ac26a44603', 'd7c32f1f-476a-454a-80dd-260d300c2a80', 'f8f7b14b-9abc-4752-91b3-232345b49341'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:48:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-53456184-d296-4f06-81af-bef41e47ece3 tempest-TestServerVolumeAttachScenarioOldVersion-700157790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:48:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-53456184-d296-4f06-81af-bef41e47ece3 tempest-TestServerVolumeAttachScenarioOldVersion-700157790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:48:57 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-53456184-d296-4f06-81af-bef41e47ece3 tempest-TestServerVolumeAttachScenarioOldVersion-700157790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:48:57 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-53456184-d296-4f06-81af-bef41e47ece3 tempest-TestServerVolumeAttachScenarioOldVersion-700157790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:48:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-53456184-d296-4f06-81af-bef41e47ece3 tempest-TestServerVolumeAttachScenarioOldVersion-700157790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:48:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-53456184-d296-4f06-81af-bef41e47ece3 tempest-TestServerVolumeAttachScenarioOldVersion-700157790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:48:57 devstack sudo[104008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:48:57 devstack sudo[104008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:48:58 devstack sudo[104008]: pam_unix(sudo:session): session closed for user root
Jul 09 14:48:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-53456184-d296-4f06-81af-bef41e47ece3 tempest-TestServerVolumeAttachScenarioOldVersion-700157790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.696s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:48:58 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-53456184-d296-4f06-81af-bef41e47ece3 tempest-TestServerVolumeAttachScenarioOldVersion-700157790 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:48:58 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-53456184-d296-4f06-81af-bef41e47ece3 tempest-TestServerVolumeAttachScenarioOldVersion-700157790 None] Deleted volume successfully.
Jul 09 14:48:58 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-53456184-d296-4f06-81af-bef41e47ece3 tempest-TestServerVolumeAttachScenarioOldVersion-700157790 None] Lock "cinder-63ae767f-c4e7-4a6e-a750-40b316bd2be5-delete_volume" released by "delete_volume" :: held 2.517s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:49:07 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=13,cinder:UPDATE=19,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 14:49:08 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=18,cinder:UPDATE=12,cinder:DELETE=2,cinder:INSERT=2 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 14:49:20 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6f023c5-e494-4e88-b51b-ae6437968713 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:49:20 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a6f023c5-e494-4e88-b51b-ae6437968713 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] Flow 'volume_create_manager' (4dba9f95-9664-46d1-bd57-e04d2a05b518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:49:20 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a6f023c5-e494-4e88-b51b-ae6437968713 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9426243d-e5e0-49a3-9ec2-cb0023a0b67e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:49:20 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a6f023c5-e494-4e88-b51b-ae6437968713 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9426243d-e5e0-49a3-9ec2-cb0023a0b67e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:49:20Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0432031b-fbc5-48cc-a3ce-113abb20e665,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca03e603b3ad4e96bf998718ee521f84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:49:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:49:20Z,use_quota=True,user_id='5862094f248c45059ba77558a4999379',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52f1a8fa-145c-468f-aa64-0f34cf6b3afb),volume_type_id=52f1a8fa-145c-468f-aa64-0f34cf6b3afb)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:49:20 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a6f023c5-e494-4e88-b51b-ae6437968713 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c3f9ab2-8f8e-43ea-9bc5-77f7f93e5dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:49:20 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a6f023c5-e494-4e88-b51b-ae6437968713 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c3f9ab2-8f8e-43ea-9bc5-77f7f93e5dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:49:20 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a6f023c5-e494-4e88-b51b-ae6437968713 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (087f1c3e-3dcf-4541-91c3-1111323b65c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:49:20 devstack cinder-volume[87230]: DEBUG cinder.image.glance [None req-a6f023c5-e494-4e88-b51b-ae6437968713 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] Creating Keystone auth plugin from conf {{(pid=87230) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 09 14:49:20 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a6f023c5-e494-4e88-b51b-ae6437968713 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (087f1c3e-3dcf-4541-91c3-1111323b65c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0432031b-fbc5-48cc-a3ce-113abb20e665', 'volume_name': 'volume-0432031b-fbc5-48cc-a3ce-113abb20e665', 'volume_size': 1, 'image_id': '8193cae1-bf7e-4096-b950-d2f2404d1a21', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8193cae1-bf7e-4096-b950-d2f2404d1a21', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b89b537d09743efc2625d2ea7f5390e2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ca03e603b3ad4e96bf998718ee521f84', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f2c3f59adc36741480eb169a0910c74061f9c37accaf56c241b3ef7c9c0156050ab778041d4dd6b793928ae4156ae6d447f4834ac21dcea6b2445c944bd4dfe9', 'id': '8193cae1-bf7e-4096-b950-d2f2404d1a21', 'created_at': datetime.datetime(2026, 7, 9, 12, 49, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 12, 49, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8193cae1-bf7e-4096-b950-d2f2404d1a21/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x720a5462ae40>}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:49:20 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a6f023c5-e494-4e88-b51b-ae6437968713 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0885edc4-4341-447e-94ca-f3073a7a4aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:49:20 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a6f023c5-e494-4e88-b51b-ae6437968713 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0885edc4-4341-447e-94ca-f3073a7a4aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:49:20 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a6f023c5-e494-4e88-b51b-ae6437968713 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6b6920c-dc0e-42a5-9be2-8e62e34276f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:49:20 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-a6f023c5-e494-4e88-b51b-ae6437968713 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] Volume 0432031b-fbc5-48cc-a3ce-113abb20e665: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0432031b-fbc5-48cc-a3ce-113abb20e665', 'volume_size': 1, 'image_id': '8193cae1-bf7e-4096-b950-d2f2404d1a21', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8193cae1-bf7e-4096-b950-d2f2404d1a21', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b89b537d09743efc2625d2ea7f5390e2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ca03e603b3ad4e96bf998718ee521f84', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f2c3f59adc36741480eb169a0910c74061f9c37accaf56c241b3ef7c9c0156050ab778041d4dd6b793928ae4156ae6d447f4834ac21dcea6b2445c944bd4dfe9', 'id': '8193cae1-bf7e-4096-b950-d2f2404d1a21', 'created_at': datetime.datetime(2026, 7, 9, 12, 49, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 12, 49, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8193cae1-bf7e-4096-b950-d2f2404d1a21/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x720a5462ae40>}
Jul 09 14:49:20 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6f023c5-e494-4e88-b51b-ae6437968713 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] Trying to clone 0432031b-fbc5-48cc-a3ce-113abb20e665 from image 8193cae1-bf7e-4096-b950-d2f2404d1a21 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8193cae1-bf7e-4096-b950-d2f2404d1a21', 'metadata': {}}]). {{(pid=87230) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 09 14:49:20 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-a6f023c5-e494-4e88-b51b-ae6437968713 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8193cae1-bf7e-4096-b950-d2f2404d1a21_b8opuibzdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87230) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 09 14:49:20 devstack cinder-volume[87230]: INFO cinder.image.image_utils [None req-a6f023c5-e494-4e88-b51b-ae6437968713 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] Image download 0.00 MB at 0.00 MB/s
Jul 09 14:49:20 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c6b25f9-7c39-4d6f-b547-dc04e2b55516]: (4, 'raw') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:49:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a6f023c5-e494-4e88-b51b-ae6437968713 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8193cae1-bf7e-4096-b950-d2f2404d1a21_b8opuibzdevstack@QuobyteHD {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:49:20 devstack sudo[104146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8193cae1-bf7e-4096-b950-d2f2404d1a21_b8opuibzdevstack@QuobyteHD
Jul 09 14:49:20 devstack sudo[104146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:49:21 devstack sudo[104146]: pam_unix(sudo:session): session closed for user root
Jul 09 14:49:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a6f023c5-e494-4e88-b51b-ae6437968713 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8193cae1-bf7e-4096-b950-d2f2404d1a21_b8opuibzdevstack@QuobyteHD" returned: 0 in 0.736s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:49:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a6f023c5-e494-4e88-b51b-ae6437968713 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8193cae1-bf7e-4096-b950-d2f2404d1a21_b8opuibzdevstack@QuobyteHD {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:49:21 devstack sudo[104152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8193cae1-bf7e-4096-b950-d2f2404d1a21_b8opuibzdevstack@QuobyteHD
Jul 09 14:49:21 devstack sudo[104152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:49:22 devstack sudo[104152]: pam_unix(sudo:session): session closed for user root
Jul 09 14:49:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a6f023c5-e494-4e88-b51b-ae6437968713 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8193cae1-bf7e-4096-b950-d2f2404d1a21_b8opuibzdevstack@QuobyteHD" returned: 1 in 0.693s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:49:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a6f023c5-e494-4e88-b51b-ae6437968713 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8193cae1-bf7e-4096-b950-d2f2404d1a21_b8opuibzdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 09 14:49:22 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-a6f023c5-e494-4e88-b51b-ae6437968713 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] Temporary image 8193cae1-bf7e-4096-b950-d2f2404d1a21 is fetched for user 5862094f248c45059ba77558a4999379. {{(pid=87230) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 09 14:49:22 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb3b653-7125-442e-8fcb-7a7e7a537b81]: (4, 'raw') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:49:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a6f023c5-e494-4e88-b51b-ae6437968713 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8193cae1-bf7e-4096-b950-d2f2404d1a21_b8opuibzdevstack@QuobyteHD {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:49:22 devstack sudo[104157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8193cae1-bf7e-4096-b950-d2f2404d1a21_b8opuibzdevstack@QuobyteHD
Jul 09 14:49:22 devstack sudo[104157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:49:23 devstack sudo[104157]: pam_unix(sudo:session): session closed for user root
Jul 09 14:49:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a6f023c5-e494-4e88-b51b-ae6437968713 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8193cae1-bf7e-4096-b950-d2f2404d1a21_b8opuibzdevstack@QuobyteHD" returned: 0 in 0.695s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:49:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a6f023c5-e494-4e88-b51b-ae6437968713 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8193cae1-bf7e-4096-b950-d2f2404d1a21_b8opuibzdevstack@QuobyteHD {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:49:23 devstack sudo[104161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8193cae1-bf7e-4096-b950-d2f2404d1a21_b8opuibzdevstack@QuobyteHD
Jul 09 14:49:23 devstack sudo[104161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:49:23 devstack sudo[104161]: pam_unix(sudo:session): session closed for user root
Jul 09 14:49:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a6f023c5-e494-4e88-b51b-ae6437968713 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8193cae1-bf7e-4096-b950-d2f2404d1a21_b8opuibzdevstack@QuobyteHD" returned: 1 in 0.713s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:49:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a6f023c5-e494-4e88-b51b-ae6437968713 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8193cae1-bf7e-4096-b950-d2f2404d1a21_b8opuibzdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 09 14:49:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a6f023c5-e494-4e88-b51b-ae6437968713 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:49:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a6f023c5-e494-4e88-b51b-ae6437968713 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:49:23 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a6f023c5-e494-4e88-b51b-ae6437968713 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:49:20Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0432031b-fbc5-48cc-a3ce-113abb20e665,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca03e603b3ad4e96bf998718ee521f84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:49:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:49:20Z,use_quota=True,user_id='5862094f248c45059ba77558a4999379',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52f1a8fa-145c-468f-aa64-0f34cf6b3afb),volume_type_id=52f1a8fa-145c-468f-aa64-0f34cf6b3afb)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:49:23 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-a6f023c5-e494-4e88-b51b-ae6437968713 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] Creating volume 0432031b-fbc5-48cc-a3ce-113abb20e665 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:49:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a6f023c5-e494-4e88-b51b-ae6437968713 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:49:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a6f023c5-e494-4e88-b51b-ae6437968713 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:49:23 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a6f023c5-e494-4e88-b51b-ae6437968713 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:49:23 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a6f023c5-e494-4e88-b51b-ae6437968713 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:49:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a6f023c5-e494-4e88-b51b-ae6437968713 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:49:23 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a6f023c5-e494-4e88-b51b-ae6437968713 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:49:23 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-a6f023c5-e494-4e88-b51b-ae6437968713 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:49:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a6f023c5-e494-4e88-b51b-ae6437968713 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0432031b-fbc5-48cc-a3ce-113abb20e665 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:49:23 devstack sudo[104167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0432031b-fbc5-48cc-a3ce-113abb20e665 1073741824
Jul 09 14:49:23 devstack sudo[104167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:49:24 devstack sudo[104167]: pam_unix(sudo:session): session closed for user root
Jul 09 14:49:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a6f023c5-e494-4e88-b51b-ae6437968713 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0432031b-fbc5-48cc-a3ce-113abb20e665 1073741824" returned: 0 in 0.873s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:49:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a6f023c5-e494-4e88-b51b-ae6437968713 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0432031b-fbc5-48cc-a3ce-113abb20e665 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:49:24 devstack sudo[104173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0432031b-fbc5-48cc-a3ce-113abb20e665
Jul 09 14:49:24 devstack sudo[104173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:49:25 devstack sudo[104173]: pam_unix(sudo:session): session closed for user root
Jul 09 14:49:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a6f023c5-e494-4e88-b51b-ae6437968713 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0432031b-fbc5-48cc-a3ce-113abb20e665" returned: 0 in 0.693s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:49:25 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a6f023c5-e494-4e88-b51b-ae6437968713 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] <== create_volume: return (1615ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:49:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a6f023c5-e494-4e88-b51b-ae6437968713 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.618s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:49:25 devstack cinder-volume[87230]: DEBUG cinder.volume.volume_utils [None req-a6f023c5-e494-4e88-b51b-ae6437968713 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] Attempting download of 8193cae1-bf7e-4096-b950-d2f2404d1a21 ((None, [{'url': 'file:///opt/stack/data/glance/images/8193cae1-bf7e-4096-b950-d2f2404d1a21', 'metadata': {}}])) to volume 0432031b-fbc5-48cc-a3ce-113abb20e665. {{(pid=87230) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 09 14:49:25 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[212d53a9-d7f9-40bb-b2a6-364c627a81f8]: (4, 'raw') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:49:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a6f023c5-e494-4e88-b51b-ae6437968713 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8193cae1-bf7e-4096-b950-d2f2404d1a21_kz71y_16 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:49:25 devstack sudo[104176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8193cae1-bf7e-4096-b950-d2f2404d1a21_kz71y_16
Jul 09 14:49:25 devstack sudo[104176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:49:26 devstack sudo[104176]: pam_unix(sudo:session): session closed for user root
Jul 09 14:49:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a6f023c5-e494-4e88-b51b-ae6437968713 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8193cae1-bf7e-4096-b950-d2f2404d1a21_kz71y_16" returned: 0 in 0.778s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:49:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a6f023c5-e494-4e88-b51b-ae6437968713 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8193cae1-bf7e-4096-b950-d2f2404d1a21_kz71y_16 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:49:26 devstack sudo[104180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8193cae1-bf7e-4096-b950-d2f2404d1a21_kz71y_16
Jul 09 14:49:26 devstack sudo[104180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:49:27 devstack sudo[104180]: pam_unix(sudo:session): session closed for user root
Jul 09 14:49:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a6f023c5-e494-4e88-b51b-ae6437968713 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8193cae1-bf7e-4096-b950-d2f2404d1a21_kz71y_16" returned: 1 in 0.776s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:49:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a6f023c5-e494-4e88-b51b-ae6437968713 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8193cae1-bf7e-4096-b950-d2f2404d1a21_kz71y_16' failed. Not Retrying. {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 09 14:49:27 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff77734-4333-4ac6-b7b4-365a2049836f]: (4, 'raw') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:49:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a6f023c5-e494-4e88-b51b-ae6437968713 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8193cae1-bf7e-4096-b950-d2f2404d1a21_b8opuibzdevstack@QuobyteHD {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:49:27 devstack sudo[104184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8193cae1-bf7e-4096-b950-d2f2404d1a21_b8opuibzdevstack@QuobyteHD
Jul 09 14:49:27 devstack sudo[104184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:49:27 devstack sudo[104184]: pam_unix(sudo:session): session closed for user root
Jul 09 14:49:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a6f023c5-e494-4e88-b51b-ae6437968713 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8193cae1-bf7e-4096-b950-d2f2404d1a21_b8opuibzdevstack@QuobyteHD" returned: 0 in 0.765s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:49:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a6f023c5-e494-4e88-b51b-ae6437968713 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8193cae1-bf7e-4096-b950-d2f2404d1a21_b8opuibzdevstack@QuobyteHD {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:49:27 devstack sudo[104188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8193cae1-bf7e-4096-b950-d2f2404d1a21_b8opuibzdevstack@QuobyteHD
Jul 09 14:49:27 devstack sudo[104188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:49:28 devstack sudo[104188]: pam_unix(sudo:session): session closed for user root
Jul 09 14:49:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a6f023c5-e494-4e88-b51b-ae6437968713 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8193cae1-bf7e-4096-b950-d2f2404d1a21_b8opuibzdevstack@QuobyteHD" returned: 1 in 0.751s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:49:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a6f023c5-e494-4e88-b51b-ae6437968713 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8193cae1-bf7e-4096-b950-d2f2404d1a21_b8opuibzdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 09 14:49:28 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-a6f023c5-e494-4e88-b51b-ae6437968713 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] 8193cae1-bf7e-4096-b950-d2f2404d1a21 was raw, converting to raw {{(pid=87230) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 09 14:49:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a6f023c5-e494-4e88-b51b-ae6437968713 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_8193cae1-bf7e-4096-b950-d2f2404d1a21_b8opuibzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0432031b-fbc5-48cc-a3ce-113abb20e665 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:49:28 devstack sudo[104193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_8193cae1-bf7e-4096-b950-d2f2404d1a21_b8opuibzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0432031b-fbc5-48cc-a3ce-113abb20e665
Jul 09 14:49:28 devstack sudo[104193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:49:29 devstack sudo[104193]: pam_unix(sudo:session): session closed for user root
Jul 09 14:49:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a6f023c5-e494-4e88-b51b-ae6437968713 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_8193cae1-bf7e-4096-b950-d2f2404d1a21_b8opuibzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0432031b-fbc5-48cc-a3ce-113abb20e665" returned: 0 in 0.802s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:49:29 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-a6f023c5-e494-4e88-b51b-ae6437968713 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8193cae1-bf7e-4096-b950-d2f2404d1a21_b8opuibzdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0432031b-fbc5-48cc-a3ce-113abb20e665 {{(pid=87230) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 09 14:49:29 devstack cinder-volume[87230]: INFO cinder.image.image_utils [None req-a6f023c5-e494-4e88-b51b-ae6437968713 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] Converted 0.00 MB image at 0.00 MB/s
Jul 09 14:49:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a6f023c5-e494-4e88-b51b-ae6437968713 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0432031b-fbc5-48cc-a3ce-113abb20e665 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:49:29 devstack sudo[104200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0432031b-fbc5-48cc-a3ce-113abb20e665 1G
Jul 09 14:49:29 devstack sudo[104200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:49:30 devstack sudo[104200]: pam_unix(sudo:session): session closed for user root
Jul 09 14:49:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a6f023c5-e494-4e88-b51b-ae6437968713 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0432031b-fbc5-48cc-a3ce-113abb20e665 1G" returned: 0 in 0.737s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:49:30 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cde800d-9af6-44d4-ae69-4a55e302be6b]: (4, 'raw') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:49:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a6f023c5-e494-4e88-b51b-ae6437968713 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0432031b-fbc5-48cc-a3ce-113abb20e665 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:49:30 devstack sudo[104210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0432031b-fbc5-48cc-a3ce-113abb20e665
Jul 09 14:49:30 devstack sudo[104210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:49:30 devstack sudo[104210]: pam_unix(sudo:session): session closed for user root
Jul 09 14:49:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a6f023c5-e494-4e88-b51b-ae6437968713 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0432031b-fbc5-48cc-a3ce-113abb20e665" returned: 0 in 0.765s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:49:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a6f023c5-e494-4e88-b51b-ae6437968713 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0432031b-fbc5-48cc-a3ce-113abb20e665 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:49:30 devstack sudo[104215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0432031b-fbc5-48cc-a3ce-113abb20e665
Jul 09 14:49:30 devstack sudo[104215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:49:31 devstack sudo[104215]: pam_unix(sudo:session): session closed for user root
Jul 09 14:49:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a6f023c5-e494-4e88-b51b-ae6437968713 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0432031b-fbc5-48cc-a3ce-113abb20e665" returned: 1 in 0.718s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:49:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a6f023c5-e494-4e88-b51b-ae6437968713 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0432031b-fbc5-48cc-a3ce-113abb20e665' failed. Not Retrying. {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 09 14:49:31 devstack cinder-volume[87230]: DEBUG cinder.volume.volume_utils [None req-a6f023c5-e494-4e88-b51b-ae6437968713 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] Downloaded image 8193cae1-bf7e-4096-b950-d2f2404d1a21 ((None, [{'url': 'file:///opt/stack/data/glance/images/8193cae1-bf7e-4096-b950-d2f2404d1a21', 'metadata': {}}])) to volume 0432031b-fbc5-48cc-a3ce-113abb20e665 successfully. {{(pid=87230) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 09 14:49:31 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-a6f023c5-e494-4e88-b51b-ae6437968713 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] Temporary image 8193cae1-bf7e-4096-b950-d2f2404d1a21 for user 5862094f248c45059ba77558a4999379 is deleted. {{(pid=87230) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 09 14:49:31 devstack cinder-volume[87230]: DEBUG cinder.volume.volume_utils [None req-a6f023c5-e494-4e88-b51b-ae6437968713 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] Marking volume 0432031b-fbc5-48cc-a3ce-113abb20e665 as bootable. {{(pid=87230) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 09 14:49:31 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6f023c5-e494-4e88-b51b-ae6437968713 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] Copying metadata from image 8193cae1-bf7e-4096-b950-d2f2404d1a21 to 0432031b-fbc5-48cc-a3ce-113abb20e665. {{(pid=87230) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 09 14:49:31 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6f023c5-e494-4e88-b51b-ae6437968713 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] Creating volume glance metadata for volume 0432031b-fbc5-48cc-a3ce-113abb20e665 backed by image 8193cae1-bf7e-4096-b950-d2f2404d1a21 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '8193cae1-bf7e-4096-b950-d2f2404d1a21', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'b89b537d09743efc2625d2ea7f5390e2', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87230) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 09 14:49:31 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a6f023c5-e494-4e88-b51b-ae6437968713 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6b6920c-dc0e-42a5-9be2-8e62e34276f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0432031b-fbc5-48cc-a3ce-113abb20e665', 'volume_size': 1, 'image_id': '8193cae1-bf7e-4096-b950-d2f2404d1a21', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8193cae1-bf7e-4096-b950-d2f2404d1a21', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b89b537d09743efc2625d2ea7f5390e2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ca03e603b3ad4e96bf998718ee521f84', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f2c3f59adc36741480eb169a0910c74061f9c37accaf56c241b3ef7c9c0156050ab778041d4dd6b793928ae4156ae6d447f4834ac21dcea6b2445c944bd4dfe9', 'id': '8193cae1-bf7e-4096-b950-d2f2404d1a21', 'created_at': datetime.datetime(2026, 7, 9, 12, 49, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 12, 49, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8193cae1-bf7e-4096-b950-d2f2404d1a21/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x720a5462ae40>}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:49:31 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a6f023c5-e494-4e88-b51b-ae6437968713 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c6f5d0c-f5b3-4f49-b1bf-6250353a2c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:49:31 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-a6f023c5-e494-4e88-b51b-ae6437968713 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] Volume volume-0432031b-fbc5-48cc-a3ce-113abb20e665 (0432031b-fbc5-48cc-a3ce-113abb20e665): created successfully
Jul 09 14:49:31 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a6f023c5-e494-4e88-b51b-ae6437968713 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c6f5d0c-f5b3-4f49-b1bf-6250353a2c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:49:31 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a6f023c5-e494-4e88-b51b-ae6437968713 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] Flow 'volume_create_manager' (4dba9f95-9664-46d1-bd57-e04d2a05b518) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:49:31 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-a6f023c5-e494-4e88-b51b-ae6437968713 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] Created volume successfully.
Jul 09 14:49:32 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-438ac4d2-8c13-4c71-bee8-92deb232c816 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] Acquiring lock "cinder-0432031b-fbc5-48cc-a3ce-113abb20e665-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:49:32 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-438ac4d2-8c13-4c71-bee8-92deb232c816 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] Lock "cinder-0432031b-fbc5-48cc-a3ce-113abb20e665-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:49:32 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-438ac4d2-8c13-4c71-bee8-92deb232c816 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] Acquiring lock "cinder-quobyte-0432031b-fbc5-48cc-a3ce-113abb20e665" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:49:32 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-438ac4d2-8c13-4c71-bee8-92deb232c816 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] Lock "cinder-quobyte-0432031b-fbc5-48cc-a3ce-113abb20e665" acquired by "delete_volume" :: waited 0.018s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:49:32 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfec8445-ba50-4ce2-8cab-8d530cf3e1df]: (4, 'raw') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:49:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-438ac4d2-8c13-4c71-bee8-92deb232c816 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0432031b-fbc5-48cc-a3ce-113abb20e665 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:49:32 devstack sudo[104220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0432031b-fbc5-48cc-a3ce-113abb20e665
Jul 09 14:49:32 devstack sudo[104220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:49:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-e25d9ded-20d6-44c1-bf58-594be9ceaee9 req-4448e7e4-af13-424c-b32b-16aa022f184c tempest-TestStampPattern-1052481563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:49:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-e25d9ded-20d6-44c1-bf58-594be9ceaee9 req-4448e7e4-af13-424c-b32b-16aa022f184c tempest-TestStampPattern-1052481563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:49:32 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a1f66cc-3b71-4c67-9fb3-d0ae7d84e696]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:49:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-e25d9ded-20d6-44c1-bf58-594be9ceaee9 req-4448e7e4-af13-424c-b32b-16aa022f184c tempest-TestStampPattern-1052481563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1e99cbc0-ed4d-4afc-98e9-f3d7fc32b506 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:49:32 devstack sudo[104230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1e99cbc0-ed4d-4afc-98e9-f3d7fc32b506
Jul 09 14:49:32 devstack sudo[104230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:49:32 devstack sudo[104220]: pam_unix(sudo:session): session closed for user root
Jul 09 14:49:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-438ac4d2-8c13-4c71-bee8-92deb232c816 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0432031b-fbc5-48cc-a3ce-113abb20e665" returned: 0 in 0.759s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:49:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-438ac4d2-8c13-4c71-bee8-92deb232c816 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0432031b-fbc5-48cc-a3ce-113abb20e665 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:49:33 devstack sudo[104234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0432031b-fbc5-48cc-a3ce-113abb20e665
Jul 09 14:49:33 devstack sudo[104234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:49:33 devstack sudo[104230]: pam_unix(sudo:session): session closed for user root
Jul 09 14:49:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-e25d9ded-20d6-44c1-bf58-594be9ceaee9 req-4448e7e4-af13-424c-b32b-16aa022f184c tempest-TestStampPattern-1052481563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1e99cbc0-ed4d-4afc-98e9-f3d7fc32b506" returned: 0 in 0.800s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:49:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-e25d9ded-20d6-44c1-bf58-594be9ceaee9 req-4448e7e4-af13-424c-b32b-16aa022f184c tempest-TestStampPattern-1052481563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.818s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:49:33 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-e25d9ded-20d6-44c1-bf58-594be9ceaee9 req-4448e7e4-af13-424c-b32b-16aa022f184c tempest-TestStampPattern-1052481563 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653', 'name': 'volume-1e99cbc0-ed4d-4afc-98e9-f3d7fc32b506', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8064141c-cc79-437d-9c4a-f7699ce4f44a', 'enforce_multipath': True} {{(pid=87230) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 09 14:49:33 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-e25d9ded-20d6-44c1-bf58-594be9ceaee9 req-4448e7e4-af13-424c-b32b-16aa022f184c tempest-TestStampPattern-1052481563 None] attachment_update completed successfully.
Jul 09 14:49:33 devstack sudo[104234]: pam_unix(sudo:session): session closed for user root
Jul 09 14:49:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-438ac4d2-8c13-4c71-bee8-92deb232c816 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0432031b-fbc5-48cc-a3ce-113abb20e665" returned: 1 in 0.793s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:49:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-438ac4d2-8c13-4c71-bee8-92deb232c816 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0432031b-fbc5-48cc-a3ce-113abb20e665' failed. Not Retrying. {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 09 14:49:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-438ac4d2-8c13-4c71-bee8-92deb232c816 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0432031b-fbc5-48cc-a3ce-113abb20e665 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:49:33 devstack sudo[104243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0432031b-fbc5-48cc-a3ce-113abb20e665
Jul 09 14:49:33 devstack sudo[104243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:49:34 devstack sudo[104243]: pam_unix(sudo:session): session closed for user root
Jul 09 14:49:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-438ac4d2-8c13-4c71-bee8-92deb232c816 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0432031b-fbc5-48cc-a3ce-113abb20e665" returned: 0 in 0.658s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:49:34 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-438ac4d2-8c13-4c71-bee8-92deb232c816 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] Lock "cinder-quobyte-0432031b-fbc5-48cc-a3ce-113abb20e665" released by "delete_volume" :: held 2.263s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:49:34 devstack cinder-volume[87230]: WARNING cinder.quota [None req-438ac4d2-8c13-4c71-bee8-92deb232c816 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Jul 09 14:49:34 devstack cinder-volume[87230]: WARNING cinder.quota [None req-438ac4d2-8c13-4c71-bee8-92deb232c816 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Jul 09 14:49:34 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-438ac4d2-8c13-4c71-bee8-92deb232c816 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] Created reservations ['f0a04763-c4b7-4b84-877c-fb3c1ada3150', '3ee4b376-0fe5-4514-8487-192cc2c24eb2', '92cb4413-4275-4cf6-ba67-c3269b24a506', '934581ea-ee7d-4ab9-9717-26d62ccf6a3b'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:49:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-438ac4d2-8c13-4c71-bee8-92deb232c816 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:49:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-438ac4d2-8c13-4c71-bee8-92deb232c816 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:49:34 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-438ac4d2-8c13-4c71-bee8-92deb232c816 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:49:34 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-438ac4d2-8c13-4c71-bee8-92deb232c816 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:49:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-438ac4d2-8c13-4c71-bee8-92deb232c816 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:49:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-438ac4d2-8c13-4c71-bee8-92deb232c816 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:49:34 devstack sudo[104627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:49:34 devstack sudo[104627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:49:35 devstack sudo[104627]: pam_unix(sudo:session): session closed for user root
Jul 09 14:49:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-438ac4d2-8c13-4c71-bee8-92deb232c816 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.656s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:49:35 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-438ac4d2-8c13-4c71-bee8-92deb232c816 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:49:35 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-438ac4d2-8c13-4c71-bee8-92deb232c816 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] Deleted volume successfully.
Jul 09 14:49:35 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-438ac4d2-8c13-4c71-bee8-92deb232c816 tempest-VolumeAndVolumeTypeFromImageTest-878160797 None] Lock "cinder-0432031b-fbc5-48cc-a3ce-113abb20e665-delete_volume" released by "delete_volume" :: held 3.187s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:49:39 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8dece87-35a9-4629-88a2-0a670b565d91 tempest-CreateVolumesFromImageTest-975962895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:49:39 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c8dece87-35a9-4629-88a2-0a670b565d91 tempest-CreateVolumesFromImageTest-975962895 None] Flow 'volume_create_manager' (6c6a3891-87e9-44b7-982e-87f1f4b05575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:49:39 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c8dece87-35a9-4629-88a2-0a670b565d91 tempest-CreateVolumesFromImageTest-975962895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7995ce95-c960-4b8e-94ec-cf5847002dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:49:39 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c8dece87-35a9-4629-88a2-0a670b565d91 tempest-CreateVolumesFromImageTest-975962895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7995ce95-c960-4b8e-94ec-cf5847002dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:49:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1796146850',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43385a77-8231-4b41-9e5e-eb34f0e14e9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0607908269346fd8714d1358dd571d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:49:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:49:39Z,use_quota=True,user_id='721995264b1b4c60913b71c4452a9529',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:49:39 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c8dece87-35a9-4629-88a2-0a670b565d91 tempest-CreateVolumesFromImageTest-975962895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f9e1bde-82ae-4348-847d-ac063c944e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:49:39 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c8dece87-35a9-4629-88a2-0a670b565d91 tempest-CreateVolumesFromImageTest-975962895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f9e1bde-82ae-4348-847d-ac063c944e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:49:39 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c8dece87-35a9-4629-88a2-0a670b565d91 tempest-CreateVolumesFromImageTest-975962895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6005781d-788c-4dde-96fe-e21a86f480cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:49:39 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c8dece87-35a9-4629-88a2-0a670b565d91 tempest-CreateVolumesFromImageTest-975962895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6005781d-788c-4dde-96fe-e21a86f480cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43385a77-8231-4b41-9e5e-eb34f0e14e9b', 'volume_name': 'volume-43385a77-8231-4b41-9e5e-eb34f0e14e9b', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:49:39 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c8dece87-35a9-4629-88a2-0a670b565d91 tempest-CreateVolumesFromImageTest-975962895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b81b7a20-ce1e-4f55-8028-8cd518c83461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:49:39 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c8dece87-35a9-4629-88a2-0a670b565d91 tempest-CreateVolumesFromImageTest-975962895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b81b7a20-ce1e-4f55-8028-8cd518c83461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:49:39 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c8dece87-35a9-4629-88a2-0a670b565d91 tempest-CreateVolumesFromImageTest-975962895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72cf4e6c-86cd-4be1-a97d-a7c4ceaf3f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:49:39 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-c8dece87-35a9-4629-88a2-0a670b565d91 tempest-CreateVolumesFromImageTest-975962895 None] Volume 43385a77-8231-4b41-9e5e-eb34f0e14e9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43385a77-8231-4b41-9e5e-eb34f0e14e9b', 'volume_size': 1}
Jul 09 14:49:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c8dece87-35a9-4629-88a2-0a670b565d91 tempest-CreateVolumesFromImageTest-975962895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:49:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c8dece87-35a9-4629-88a2-0a670b565d91 tempest-CreateVolumesFromImageTest-975962895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:49:39 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-c8dece87-35a9-4629-88a2-0a670b565d91 tempest-CreateVolumesFromImageTest-975962895 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:49:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1796146850',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43385a77-8231-4b41-9e5e-eb34f0e14e9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0607908269346fd8714d1358dd571d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:49:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:49:39Z,use_quota=True,user_id='721995264b1b4c60913b71c4452a9529',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:49:39 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-c8dece87-35a9-4629-88a2-0a670b565d91 tempest-CreateVolumesFromImageTest-975962895 None] Creating volume 43385a77-8231-4b41-9e5e-eb34f0e14e9b {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:49:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c8dece87-35a9-4629-88a2-0a670b565d91 tempest-CreateVolumesFromImageTest-975962895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:49:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c8dece87-35a9-4629-88a2-0a670b565d91 tempest-CreateVolumesFromImageTest-975962895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:49:39 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-c8dece87-35a9-4629-88a2-0a670b565d91 tempest-CreateVolumesFromImageTest-975962895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:49:39 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-c8dece87-35a9-4629-88a2-0a670b565d91 tempest-CreateVolumesFromImageTest-975962895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:49:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c8dece87-35a9-4629-88a2-0a670b565d91 tempest-CreateVolumesFromImageTest-975962895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:49:39 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-c8dece87-35a9-4629-88a2-0a670b565d91 tempest-CreateVolumesFromImageTest-975962895 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:49:39 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-c8dece87-35a9-4629-88a2-0a670b565d91 tempest-CreateVolumesFromImageTest-975962895 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:49:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c8dece87-35a9-4629-88a2-0a670b565d91 tempest-CreateVolumesFromImageTest-975962895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-43385a77-8231-4b41-9e5e-eb34f0e14e9b 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:49:39 devstack sudo[104640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-43385a77-8231-4b41-9e5e-eb34f0e14e9b 1073741824
Jul 09 14:49:39 devstack sudo[104640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:49:39 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ed0a995-d3d2-42b3-9016-efbdf62e63ef tempest-CreateVolumesFromImageTest-975962895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:49:39 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2ed0a995-d3d2-42b3-9016-efbdf62e63ef tempest-CreateVolumesFromImageTest-975962895 None] Flow 'volume_create_manager' (c42a84bd-50e3-4bb3-837a-cb17a23e52dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:49:39 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2ed0a995-d3d2-42b3-9016-efbdf62e63ef tempest-CreateVolumesFromImageTest-975962895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6d09732-1df0-40c0-bdef-3ba4170dfa43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:49:39 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2ed0a995-d3d2-42b3-9016-efbdf62e63ef tempest-CreateVolumesFromImageTest-975962895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6d09732-1df0-40c0-bdef-3ba4170dfa43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:49:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1467622445',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae754e9c-f7cb-427d-90b8-8748ece6595f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0607908269346fd8714d1358dd571d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:49:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:49:40Z,use_quota=True,user_id='721995264b1b4c60913b71c4452a9529',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:49:39 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2ed0a995-d3d2-42b3-9016-efbdf62e63ef tempest-CreateVolumesFromImageTest-975962895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6634a04d-a7b2-42c2-8e33-d75cb8d07fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:49:39 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2ed0a995-d3d2-42b3-9016-efbdf62e63ef tempest-CreateVolumesFromImageTest-975962895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6634a04d-a7b2-42c2-8e33-d75cb8d07fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:49:39 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2ed0a995-d3d2-42b3-9016-efbdf62e63ef tempest-CreateVolumesFromImageTest-975962895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f4633ff-a932-461c-a22e-d5e3874ab1f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:49:39 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2ed0a995-d3d2-42b3-9016-efbdf62e63ef tempest-CreateVolumesFromImageTest-975962895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f4633ff-a932-461c-a22e-d5e3874ab1f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae754e9c-f7cb-427d-90b8-8748ece6595f', 'volume_name': 'volume-ae754e9c-f7cb-427d-90b8-8748ece6595f', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:49:39 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2ed0a995-d3d2-42b3-9016-efbdf62e63ef tempest-CreateVolumesFromImageTest-975962895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68a01cac-1c94-4ad2-a874-a5d98a81712a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:49:39 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2ed0a995-d3d2-42b3-9016-efbdf62e63ef tempest-CreateVolumesFromImageTest-975962895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68a01cac-1c94-4ad2-a874-a5d98a81712a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:49:39 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2ed0a995-d3d2-42b3-9016-efbdf62e63ef tempest-CreateVolumesFromImageTest-975962895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (416e332f-1543-4e9a-ac53-942363ad6422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:49:39 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-2ed0a995-d3d2-42b3-9016-efbdf62e63ef tempest-CreateVolumesFromImageTest-975962895 None] Volume ae754e9c-f7cb-427d-90b8-8748ece6595f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae754e9c-f7cb-427d-90b8-8748ece6595f', 'volume_size': 1}
Jul 09 14:49:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-2ed0a995-d3d2-42b3-9016-efbdf62e63ef tempest-CreateVolumesFromImageTest-975962895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:49:40 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-98b972d4-d41a-49a9-abaa-fae82f4c0db1 tempest-CreateVolumesFromImageTest-975962895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:49:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-98b972d4-d41a-49a9-abaa-fae82f4c0db1 tempest-CreateVolumesFromImageTest-975962895 None] Flow 'volume_create_manager' (d454ef10-e0d0-4135-a36e-aab7c38dc87d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:49:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-98b972d4-d41a-49a9-abaa-fae82f4c0db1 tempest-CreateVolumesFromImageTest-975962895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6a94d47-763b-4d00-a015-021ca8821d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:49:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-98b972d4-d41a-49a9-abaa-fae82f4c0db1 tempest-CreateVolumesFromImageTest-975962895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6a94d47-763b-4d00-a015-021ca8821d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:49:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-283332342',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9279a4d-fd06-4f63-9a80-00b5ec761b3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0607908269346fd8714d1358dd571d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:49:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:49:40Z,use_quota=True,user_id='721995264b1b4c60913b71c4452a9529',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:49:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-98b972d4-d41a-49a9-abaa-fae82f4c0db1 tempest-CreateVolumesFromImageTest-975962895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b40abaa2-e67f-4e87-b69d-1cf905ba92de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:49:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-98b972d4-d41a-49a9-abaa-fae82f4c0db1 tempest-CreateVolumesFromImageTest-975962895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b40abaa2-e67f-4e87-b69d-1cf905ba92de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:49:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-98b972d4-d41a-49a9-abaa-fae82f4c0db1 tempest-CreateVolumesFromImageTest-975962895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2312968-b05d-4268-ae6a-c3d736d2ab56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:49:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-98b972d4-d41a-49a9-abaa-fae82f4c0db1 tempest-CreateVolumesFromImageTest-975962895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2312968-b05d-4268-ae6a-c3d736d2ab56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9279a4d-fd06-4f63-9a80-00b5ec761b3d', 'volume_name': 'volume-e9279a4d-fd06-4f63-9a80-00b5ec761b3d', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:49:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-98b972d4-d41a-49a9-abaa-fae82f4c0db1 tempest-CreateVolumesFromImageTest-975962895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62b93411-a5db-4142-8fa8-d31cba2244e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:49:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-98b972d4-d41a-49a9-abaa-fae82f4c0db1 tempest-CreateVolumesFromImageTest-975962895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62b93411-a5db-4142-8fa8-d31cba2244e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:49:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-98b972d4-d41a-49a9-abaa-fae82f4c0db1 tempest-CreateVolumesFromImageTest-975962895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4203fd4-fd98-4a47-bc0e-23ac2f3f5499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:49:40 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-98b972d4-d41a-49a9-abaa-fae82f4c0db1 tempest-CreateVolumesFromImageTest-975962895 None] Volume e9279a4d-fd06-4f63-9a80-00b5ec761b3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9279a4d-fd06-4f63-9a80-00b5ec761b3d', 'volume_size': 1}
Jul 09 14:49:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-98b972d4-d41a-49a9-abaa-fae82f4c0db1 tempest-CreateVolumesFromImageTest-975962895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:49:40 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-e612d7ce-06bb-4643-8b2e-85f48410ec2e tempest-CreateVolumesFromImageTest-975962895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:49:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e612d7ce-06bb-4643-8b2e-85f48410ec2e tempest-CreateVolumesFromImageTest-975962895 None] Flow 'volume_create_manager' (cfc91c7b-448e-4951-980d-5c32b386d0e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:49:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e612d7ce-06bb-4643-8b2e-85f48410ec2e tempest-CreateVolumesFromImageTest-975962895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8059d54f-496d-437d-938a-a62f41ed4efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:49:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e612d7ce-06bb-4643-8b2e-85f48410ec2e tempest-CreateVolumesFromImageTest-975962895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8059d54f-496d-437d-938a-a62f41ed4efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:49:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1250716586',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88e09a22-eb55-4c7d-9ec3-c9033bfa0a92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0607908269346fd8714d1358dd571d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:49:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:49:41Z,use_quota=True,user_id='721995264b1b4c60913b71c4452a9529',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:49:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e612d7ce-06bb-4643-8b2e-85f48410ec2e tempest-CreateVolumesFromImageTest-975962895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4db6696-c0d1-48f4-8649-9f6c5bbb7e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:49:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e612d7ce-06bb-4643-8b2e-85f48410ec2e tempest-CreateVolumesFromImageTest-975962895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4db6696-c0d1-48f4-8649-9f6c5bbb7e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:49:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e612d7ce-06bb-4643-8b2e-85f48410ec2e tempest-CreateVolumesFromImageTest-975962895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (027f0fb3-9025-4676-9483-14e287506444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:49:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e612d7ce-06bb-4643-8b2e-85f48410ec2e tempest-CreateVolumesFromImageTest-975962895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (027f0fb3-9025-4676-9483-14e287506444) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88e09a22-eb55-4c7d-9ec3-c9033bfa0a92', 'volume_name': 'volume-88e09a22-eb55-4c7d-9ec3-c9033bfa0a92', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:49:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e612d7ce-06bb-4643-8b2e-85f48410ec2e tempest-CreateVolumesFromImageTest-975962895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2eaa9ed-58fd-4edf-8636-b45654003656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:49:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e612d7ce-06bb-4643-8b2e-85f48410ec2e tempest-CreateVolumesFromImageTest-975962895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2eaa9ed-58fd-4edf-8636-b45654003656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:49:40 devstack sudo[104640]: pam_unix(sudo:session): session closed for user root
Jul 09 14:49:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e612d7ce-06bb-4643-8b2e-85f48410ec2e tempest-CreateVolumesFromImageTest-975962895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85f7e183-9c18-48d4-a4cd-23324215245c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:49:40 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-e612d7ce-06bb-4643-8b2e-85f48410ec2e tempest-CreateVolumesFromImageTest-975962895 None] Volume 88e09a22-eb55-4c7d-9ec3-c9033bfa0a92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88e09a22-eb55-4c7d-9ec3-c9033bfa0a92', 'volume_size': 1}
Jul 09 14:49:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e612d7ce-06bb-4643-8b2e-85f48410ec2e tempest-CreateVolumesFromImageTest-975962895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:49:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c8dece87-35a9-4629-88a2-0a670b565d91 tempest-CreateVolumesFromImageTest-975962895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-43385a77-8231-4b41-9e5e-eb34f0e14e9b 1073741824" returned: 0 in 1.185s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:49:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c8dece87-35a9-4629-88a2-0a670b565d91 tempest-CreateVolumesFromImageTest-975962895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-43385a77-8231-4b41-9e5e-eb34f0e14e9b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:49:40 devstack sudo[104659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-43385a77-8231-4b41-9e5e-eb34f0e14e9b
Jul 09 14:49:40 devstack sudo[104659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:49:41 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-203c6bea-db59-44cd-a573-c2a4f7d1adc2 tempest-CreateVolumesFromImageTest-975962895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:49:41 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-203c6bea-db59-44cd-a573-c2a4f7d1adc2 tempest-CreateVolumesFromImageTest-975962895 None] Flow 'volume_create_manager' (d377f17a-4082-40b9-acf6-ce1d2225bc23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:49:41 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-203c6bea-db59-44cd-a573-c2a4f7d1adc2 tempest-CreateVolumesFromImageTest-975962895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7a7f561-496c-498f-9ebc-7cd7a1d1a8a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:49:41 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-203c6bea-db59-44cd-a573-c2a4f7d1adc2 tempest-CreateVolumesFromImageTest-975962895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7a7f561-496c-498f-9ebc-7cd7a1d1a8a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:49:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1945369064',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e034b4f4-4395-4ff5-be91-89134d9343b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0607908269346fd8714d1358dd571d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:49:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:49:41Z,use_quota=True,user_id='721995264b1b4c60913b71c4452a9529',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:49:41 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-203c6bea-db59-44cd-a573-c2a4f7d1adc2 tempest-CreateVolumesFromImageTest-975962895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87e8e8e1-45a6-4465-a7fd-b96a3406c4b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:49:41 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-203c6bea-db59-44cd-a573-c2a4f7d1adc2 tempest-CreateVolumesFromImageTest-975962895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87e8e8e1-45a6-4465-a7fd-b96a3406c4b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:49:41 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-203c6bea-db59-44cd-a573-c2a4f7d1adc2 tempest-CreateVolumesFromImageTest-975962895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c003ffb-1f77-4912-ad34-36cd4d70fec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:49:41 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-203c6bea-db59-44cd-a573-c2a4f7d1adc2 tempest-CreateVolumesFromImageTest-975962895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c003ffb-1f77-4912-ad34-36cd4d70fec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e034b4f4-4395-4ff5-be91-89134d9343b1', 'volume_name': 'volume-e034b4f4-4395-4ff5-be91-89134d9343b1', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:49:41 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-203c6bea-db59-44cd-a573-c2a4f7d1adc2 tempest-CreateVolumesFromImageTest-975962895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2ef7800-19bb-4a5d-ad73-b4e999a1716b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:49:41 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-203c6bea-db59-44cd-a573-c2a4f7d1adc2 tempest-CreateVolumesFromImageTest-975962895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2ef7800-19bb-4a5d-ad73-b4e999a1716b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:49:41 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-203c6bea-db59-44cd-a573-c2a4f7d1adc2 tempest-CreateVolumesFromImageTest-975962895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85b8d15f-e451-44fd-b210-d1aecfde6918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:49:41 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-203c6bea-db59-44cd-a573-c2a4f7d1adc2 tempest-CreateVolumesFromImageTest-975962895 None] Volume e034b4f4-4395-4ff5-be91-89134d9343b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e034b4f4-4395-4ff5-be91-89134d9343b1', 'volume_size': 1}
Jul 09 14:49:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-203c6bea-db59-44cd-a573-c2a4f7d1adc2 tempest-CreateVolumesFromImageTest-975962895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:49:41 devstack sudo[104659]: pam_unix(sudo:session): session closed for user root
Jul 09 14:49:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c8dece87-35a9-4629-88a2-0a670b565d91 tempest-CreateVolumesFromImageTest-975962895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-43385a77-8231-4b41-9e5e-eb34f0e14e9b" returned: 0 in 0.686s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:49:41 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-c8dece87-35a9-4629-88a2-0a670b565d91 tempest-CreateVolumesFromImageTest-975962895 None] <== create_volume: return (1920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:49:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c8dece87-35a9-4629-88a2-0a670b565d91 tempest-CreateVolumesFromImageTest-975962895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.923s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:49:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-2ed0a995-d3d2-42b3-9016-efbdf62e63ef tempest-CreateVolumesFromImageTest-975962895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.591s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:49:41 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-2ed0a995-d3d2-42b3-9016-efbdf62e63ef tempest-CreateVolumesFromImageTest-975962895 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:49:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1467622445',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae754e9c-f7cb-427d-90b8-8748ece6595f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0607908269346fd8714d1358dd571d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:49:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:49:40Z,use_quota=True,user_id='721995264b1b4c60913b71c4452a9529',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:49:41 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-2ed0a995-d3d2-42b3-9016-efbdf62e63ef tempest-CreateVolumesFromImageTest-975962895 None] Creating volume ae754e9c-f7cb-427d-90b8-8748ece6595f {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:49:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-2ed0a995-d3d2-42b3-9016-efbdf62e63ef tempest-CreateVolumesFromImageTest-975962895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:49:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-2ed0a995-d3d2-42b3-9016-efbdf62e63ef tempest-CreateVolumesFromImageTest-975962895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:49:41 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-2ed0a995-d3d2-42b3-9016-efbdf62e63ef tempest-CreateVolumesFromImageTest-975962895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:49:41 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-2ed0a995-d3d2-42b3-9016-efbdf62e63ef tempest-CreateVolumesFromImageTest-975962895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:49:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-2ed0a995-d3d2-42b3-9016-efbdf62e63ef tempest-CreateVolumesFromImageTest-975962895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:49:41 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-2ed0a995-d3d2-42b3-9016-efbdf62e63ef tempest-CreateVolumesFromImageTest-975962895 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:49:41 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-2ed0a995-d3d2-42b3-9016-efbdf62e63ef tempest-CreateVolumesFromImageTest-975962895 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:49:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2ed0a995-d3d2-42b3-9016-efbdf62e63ef tempest-CreateVolumesFromImageTest-975962895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ae754e9c-f7cb-427d-90b8-8748ece6595f 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:49:41 devstack sudo[104662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ae754e9c-f7cb-427d-90b8-8748ece6595f 1073741824
Jul 09 14:49:41 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c8dece87-35a9-4629-88a2-0a670b565d91 tempest-CreateVolumesFromImageTest-975962895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72cf4e6c-86cd-4be1-a97d-a7c4ceaf3f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43385a77-8231-4b41-9e5e-eb34f0e14e9b', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:49:41 devstack sudo[104662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:49:41 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c8dece87-35a9-4629-88a2-0a670b565d91 tempest-CreateVolumesFromImageTest-975962895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dad41af-3e98-4ad3-b592-4b441a5ccb05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:49:41 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-c8dece87-35a9-4629-88a2-0a670b565d91 tempest-CreateVolumesFromImageTest-975962895 None] Volume volume-43385a77-8231-4b41-9e5e-eb34f0e14e9b (43385a77-8231-4b41-9e5e-eb34f0e14e9b): created successfully
Jul 09 14:49:41 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c8dece87-35a9-4629-88a2-0a670b565d91 tempest-CreateVolumesFromImageTest-975962895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dad41af-3e98-4ad3-b592-4b441a5ccb05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:49:41 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c8dece87-35a9-4629-88a2-0a670b565d91 tempest-CreateVolumesFromImageTest-975962895 None] Flow 'volume_create_manager' (6c6a3891-87e9-44b7-982e-87f1f4b05575) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:49:41 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-c8dece87-35a9-4629-88a2-0a670b565d91 tempest-CreateVolumesFromImageTest-975962895 None] Created volume successfully.
Jul 09 14:49:42 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-ba948696-0fc2-4752-9209-6d59f373b6f4 req-6928423a-460b-4c7b-bfa0-286044f0f298 tempest-TestStampPattern-1052481563 None] Terminate volume connection completed successfully.
Jul 09 14:49:42 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-ba948696-0fc2-4752-9209-6d59f373b6f4 req-6928423a-460b-4c7b-bfa0-286044f0f298 tempest-TestStampPattern-1052481563 None] Deleting attachment 8064141c-cc79-437d-9c4a-f7699ce4f44a. {{(pid=87230) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 09 14:49:42 devstack sudo[104662]: pam_unix(sudo:session): session closed for user root
Jul 09 14:49:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2ed0a995-d3d2-42b3-9016-efbdf62e63ef tempest-CreateVolumesFromImageTest-975962895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ae754e9c-f7cb-427d-90b8-8748ece6595f 1073741824" returned: 0 in 0.873s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:49:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2ed0a995-d3d2-42b3-9016-efbdf62e63ef tempest-CreateVolumesFromImageTest-975962895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ae754e9c-f7cb-427d-90b8-8748ece6595f {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:49:42 devstack sudo[104696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ae754e9c-f7cb-427d-90b8-8748ece6595f
Jul 09 14:49:42 devstack sudo[104696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:49:43 devstack sudo[104696]: pam_unix(sudo:session): session closed for user root
Jul 09 14:49:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2ed0a995-d3d2-42b3-9016-efbdf62e63ef tempest-CreateVolumesFromImageTest-975962895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ae754e9c-f7cb-427d-90b8-8748ece6595f" returned: 0 in 0.634s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:49:43 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-2ed0a995-d3d2-42b3-9016-efbdf62e63ef tempest-CreateVolumesFromImageTest-975962895 None] <== create_volume: return (1569ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:49:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-2ed0a995-d3d2-42b3-9016-efbdf62e63ef tempest-CreateVolumesFromImageTest-975962895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.572s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:49:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-98b972d4-d41a-49a9-abaa-fae82f4c0db1 tempest-CreateVolumesFromImageTest-975962895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.762s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:49:43 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-98b972d4-d41a-49a9-abaa-fae82f4c0db1 tempest-CreateVolumesFromImageTest-975962895 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:49:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-283332342',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9279a4d-fd06-4f63-9a80-00b5ec761b3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0607908269346fd8714d1358dd571d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:49:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:49:40Z,use_quota=True,user_id='721995264b1b4c60913b71c4452a9529',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:49:43 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-98b972d4-d41a-49a9-abaa-fae82f4c0db1 tempest-CreateVolumesFromImageTest-975962895 None] Creating volume e9279a4d-fd06-4f63-9a80-00b5ec761b3d {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:49:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-98b972d4-d41a-49a9-abaa-fae82f4c0db1 tempest-CreateVolumesFromImageTest-975962895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:49:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-98b972d4-d41a-49a9-abaa-fae82f4c0db1 tempest-CreateVolumesFromImageTest-975962895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:49:43 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-98b972d4-d41a-49a9-abaa-fae82f4c0db1 tempest-CreateVolumesFromImageTest-975962895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:49:43 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-98b972d4-d41a-49a9-abaa-fae82f4c0db1 tempest-CreateVolumesFromImageTest-975962895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:49:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-98b972d4-d41a-49a9-abaa-fae82f4c0db1 tempest-CreateVolumesFromImageTest-975962895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:49:43 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-98b972d4-d41a-49a9-abaa-fae82f4c0db1 tempest-CreateVolumesFromImageTest-975962895 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:49:43 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-98b972d4-d41a-49a9-abaa-fae82f4c0db1 tempest-CreateVolumesFromImageTest-975962895 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:49:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-98b972d4-d41a-49a9-abaa-fae82f4c0db1 tempest-CreateVolumesFromImageTest-975962895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e9279a4d-fd06-4f63-9a80-00b5ec761b3d 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:49:43 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2ed0a995-d3d2-42b3-9016-efbdf62e63ef tempest-CreateVolumesFromImageTest-975962895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (416e332f-1543-4e9a-ac53-942363ad6422) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae754e9c-f7cb-427d-90b8-8748ece6595f', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:49:43 devstack sudo[104699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e9279a4d-fd06-4f63-9a80-00b5ec761b3d 1073741824
Jul 09 14:49:43 devstack sudo[104699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:49:43 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2ed0a995-d3d2-42b3-9016-efbdf62e63ef tempest-CreateVolumesFromImageTest-975962895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5495756c-6882-4d9a-b642-8595ba77fce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:49:43 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-2ed0a995-d3d2-42b3-9016-efbdf62e63ef tempest-CreateVolumesFromImageTest-975962895 None] Volume volume-ae754e9c-f7cb-427d-90b8-8748ece6595f (ae754e9c-f7cb-427d-90b8-8748ece6595f): created successfully
Jul 09 14:49:43 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2ed0a995-d3d2-42b3-9016-efbdf62e63ef tempest-CreateVolumesFromImageTest-975962895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5495756c-6882-4d9a-b642-8595ba77fce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:49:43 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2ed0a995-d3d2-42b3-9016-efbdf62e63ef tempest-CreateVolumesFromImageTest-975962895 None] Flow 'volume_create_manager' (c42a84bd-50e3-4bb3-837a-cb17a23e52dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:49:43 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-2ed0a995-d3d2-42b3-9016-efbdf62e63ef tempest-CreateVolumesFromImageTest-975962895 None] Created volume successfully.
Jul 09 14:49:43 devstack sudo[104699]: pam_unix(sudo:session): session closed for user root
Jul 09 14:49:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-98b972d4-d41a-49a9-abaa-fae82f4c0db1 tempest-CreateVolumesFromImageTest-975962895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e9279a4d-fd06-4f63-9a80-00b5ec761b3d 1073741824" returned: 0 in 0.798s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:49:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-98b972d4-d41a-49a9-abaa-fae82f4c0db1 tempest-CreateVolumesFromImageTest-975962895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e9279a4d-fd06-4f63-9a80-00b5ec761b3d {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:49:43 devstack sudo[104705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e9279a4d-fd06-4f63-9a80-00b5ec761b3d
Jul 09 14:49:43 devstack sudo[104705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:49:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d58110c6-d448-4306-88a5-ffada001b1de tempest-TestStampPattern-1052481563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:49:44 devstack sudo[104705]: pam_unix(sudo:session): session closed for user root
Jul 09 14:49:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-98b972d4-d41a-49a9-abaa-fae82f4c0db1 tempest-CreateVolumesFromImageTest-975962895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e9279a4d-fd06-4f63-9a80-00b5ec761b3d" returned: 0 in 0.629s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:49:44 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-98b972d4-d41a-49a9-abaa-fae82f4c0db1 tempest-CreateVolumesFromImageTest-975962895 None] <== create_volume: return (1463ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:49:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-98b972d4-d41a-49a9-abaa-fae82f4c0db1 tempest-CreateVolumesFromImageTest-975962895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.465s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:49:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e612d7ce-06bb-4643-8b2e-85f48410ec2e tempest-CreateVolumesFromImageTest-975962895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.770s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:49:44 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-e612d7ce-06bb-4643-8b2e-85f48410ec2e tempest-CreateVolumesFromImageTest-975962895 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:49:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1250716586',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88e09a22-eb55-4c7d-9ec3-c9033bfa0a92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0607908269346fd8714d1358dd571d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:49:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:49:41Z,use_quota=True,user_id='721995264b1b4c60913b71c4452a9529',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:49:44 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-e612d7ce-06bb-4643-8b2e-85f48410ec2e tempest-CreateVolumesFromImageTest-975962895 None] Creating volume 88e09a22-eb55-4c7d-9ec3-c9033bfa0a92 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:49:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e612d7ce-06bb-4643-8b2e-85f48410ec2e tempest-CreateVolumesFromImageTest-975962895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:49:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e612d7ce-06bb-4643-8b2e-85f48410ec2e tempest-CreateVolumesFromImageTest-975962895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:49:44 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-e612d7ce-06bb-4643-8b2e-85f48410ec2e tempest-CreateVolumesFromImageTest-975962895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:49:44 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-e612d7ce-06bb-4643-8b2e-85f48410ec2e tempest-CreateVolumesFromImageTest-975962895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:49:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e612d7ce-06bb-4643-8b2e-85f48410ec2e tempest-CreateVolumesFromImageTest-975962895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:49:44 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-e612d7ce-06bb-4643-8b2e-85f48410ec2e tempest-CreateVolumesFromImageTest-975962895 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:49:44 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-e612d7ce-06bb-4643-8b2e-85f48410ec2e tempest-CreateVolumesFromImageTest-975962895 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:49:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e612d7ce-06bb-4643-8b2e-85f48410ec2e tempest-CreateVolumesFromImageTest-975962895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-88e09a22-eb55-4c7d-9ec3-c9033bfa0a92 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:49:44 devstack sudo[104708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-88e09a22-eb55-4c7d-9ec3-c9033bfa0a92 1073741824
Jul 09 14:49:44 devstack sudo[104708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:49:44 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-98b972d4-d41a-49a9-abaa-fae82f4c0db1 tempest-CreateVolumesFromImageTest-975962895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4203fd4-fd98-4a47-bc0e-23ac2f3f5499) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9279a4d-fd06-4f63-9a80-00b5ec761b3d', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:49:44 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-98b972d4-d41a-49a9-abaa-fae82f4c0db1 tempest-CreateVolumesFromImageTest-975962895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea4808b5-8ea0-41c9-b195-c28b7a9b41b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:49:44 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-98b972d4-d41a-49a9-abaa-fae82f4c0db1 tempest-CreateVolumesFromImageTest-975962895 None] Volume volume-e9279a4d-fd06-4f63-9a80-00b5ec761b3d (e9279a4d-fd06-4f63-9a80-00b5ec761b3d): created successfully
Jul 09 14:49:44 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-98b972d4-d41a-49a9-abaa-fae82f4c0db1 tempest-CreateVolumesFromImageTest-975962895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea4808b5-8ea0-41c9-b195-c28b7a9b41b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:49:44 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-98b972d4-d41a-49a9-abaa-fae82f4c0db1 tempest-CreateVolumesFromImageTest-975962895 None] Flow 'volume_create_manager' (d454ef10-e0d0-4135-a36e-aab7c38dc87d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:49:44 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-98b972d4-d41a-49a9-abaa-fae82f4c0db1 tempest-CreateVolumesFromImageTest-975962895 None] Created volume successfully.
Jul 09 14:49:45 devstack sudo[104708]: pam_unix(sudo:session): session closed for user root
Jul 09 14:49:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e612d7ce-06bb-4643-8b2e-85f48410ec2e tempest-CreateVolumesFromImageTest-975962895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-88e09a22-eb55-4c7d-9ec3-c9033bfa0a92 1073741824" returned: 0 in 0.783s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:49:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e612d7ce-06bb-4643-8b2e-85f48410ec2e tempest-CreateVolumesFromImageTest-975962895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-88e09a22-eb55-4c7d-9ec3-c9033bfa0a92 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:49:45 devstack sudo[104713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-88e09a22-eb55-4c7d-9ec3-c9033bfa0a92
Jul 09 14:49:45 devstack sudo[104713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:49:46 devstack sudo[104713]: pam_unix(sudo:session): session closed for user root
Jul 09 14:49:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e612d7ce-06bb-4643-8b2e-85f48410ec2e tempest-CreateVolumesFromImageTest-975962895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-88e09a22-eb55-4c7d-9ec3-c9033bfa0a92" returned: 0 in 0.633s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:49:46 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-e612d7ce-06bb-4643-8b2e-85f48410ec2e tempest-CreateVolumesFromImageTest-975962895 None] <== create_volume: return (1458ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:49:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e612d7ce-06bb-4643-8b2e-85f48410ec2e tempest-CreateVolumesFromImageTest-975962895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.460s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:49:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-203c6bea-db59-44cd-a573-c2a4f7d1adc2 tempest-CreateVolumesFromImageTest-975962895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.796s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:49:46 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-203c6bea-db59-44cd-a573-c2a4f7d1adc2 tempest-CreateVolumesFromImageTest-975962895 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:49:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1945369064',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e034b4f4-4395-4ff5-be91-89134d9343b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0607908269346fd8714d1358dd571d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:49:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:49:41Z,use_quota=True,user_id='721995264b1b4c60913b71c4452a9529',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:49:46 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-203c6bea-db59-44cd-a573-c2a4f7d1adc2 tempest-CreateVolumesFromImageTest-975962895 None] Creating volume e034b4f4-4395-4ff5-be91-89134d9343b1 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:49:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-203c6bea-db59-44cd-a573-c2a4f7d1adc2 tempest-CreateVolumesFromImageTest-975962895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:49:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-203c6bea-db59-44cd-a573-c2a4f7d1adc2 tempest-CreateVolumesFromImageTest-975962895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:49:46 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-203c6bea-db59-44cd-a573-c2a4f7d1adc2 tempest-CreateVolumesFromImageTest-975962895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:49:46 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-203c6bea-db59-44cd-a573-c2a4f7d1adc2 tempest-CreateVolumesFromImageTest-975962895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:49:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-203c6bea-db59-44cd-a573-c2a4f7d1adc2 tempest-CreateVolumesFromImageTest-975962895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:49:46 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-203c6bea-db59-44cd-a573-c2a4f7d1adc2 tempest-CreateVolumesFromImageTest-975962895 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:49:46 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-203c6bea-db59-44cd-a573-c2a4f7d1adc2 tempest-CreateVolumesFromImageTest-975962895 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:49:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-203c6bea-db59-44cd-a573-c2a4f7d1adc2 tempest-CreateVolumesFromImageTest-975962895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e034b4f4-4395-4ff5-be91-89134d9343b1 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:49:46 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e612d7ce-06bb-4643-8b2e-85f48410ec2e tempest-CreateVolumesFromImageTest-975962895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85f7e183-9c18-48d4-a4cd-23324215245c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88e09a22-eb55-4c7d-9ec3-c9033bfa0a92', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:49:46 devstack sudo[104752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e034b4f4-4395-4ff5-be91-89134d9343b1 1073741824
Jul 09 14:49:46 devstack sudo[104752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:49:46 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e612d7ce-06bb-4643-8b2e-85f48410ec2e tempest-CreateVolumesFromImageTest-975962895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7744b652-3912-4f6b-9ce2-a7ea1ce83df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:49:46 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-e612d7ce-06bb-4643-8b2e-85f48410ec2e tempest-CreateVolumesFromImageTest-975962895 None] Volume volume-88e09a22-eb55-4c7d-9ec3-c9033bfa0a92 (88e09a22-eb55-4c7d-9ec3-c9033bfa0a92): created successfully
Jul 09 14:49:46 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e612d7ce-06bb-4643-8b2e-85f48410ec2e tempest-CreateVolumesFromImageTest-975962895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7744b652-3912-4f6b-9ce2-a7ea1ce83df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:49:46 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e612d7ce-06bb-4643-8b2e-85f48410ec2e tempest-CreateVolumesFromImageTest-975962895 None] Flow 'volume_create_manager' (cfc91c7b-448e-4951-980d-5c32b386d0e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:49:46 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-e612d7ce-06bb-4643-8b2e-85f48410ec2e tempest-CreateVolumesFromImageTest-975962895 None] Created volume successfully.
Jul 09 14:49:46 devstack sudo[104752]: pam_unix(sudo:session): session closed for user root
Jul 09 14:49:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-203c6bea-db59-44cd-a573-c2a4f7d1adc2 tempest-CreateVolumesFromImageTest-975962895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e034b4f4-4395-4ff5-be91-89134d9343b1 1073741824" returned: 0 in 0.826s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:49:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-203c6bea-db59-44cd-a573-c2a4f7d1adc2 tempest-CreateVolumesFromImageTest-975962895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e034b4f4-4395-4ff5-be91-89134d9343b1 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:49:46 devstack sudo[104757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e034b4f4-4395-4ff5-be91-89134d9343b1
Jul 09 14:49:46 devstack sudo[104757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:49:47 devstack sudo[104757]: pam_unix(sudo:session): session closed for user root
Jul 09 14:49:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-203c6bea-db59-44cd-a573-c2a4f7d1adc2 tempest-CreateVolumesFromImageTest-975962895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e034b4f4-4395-4ff5-be91-89134d9343b1" returned: 0 in 0.616s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:49:47 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-203c6bea-db59-44cd-a573-c2a4f7d1adc2 tempest-CreateVolumesFromImageTest-975962895 None] <== create_volume: return (1481ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:49:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-203c6bea-db59-44cd-a573-c2a4f7d1adc2 tempest-CreateVolumesFromImageTest-975962895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.484s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:49:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d58110c6-d448-4306-88a5-ffada001b1de tempest-TestStampPattern-1052481563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.083s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:49:47 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-203c6bea-db59-44cd-a573-c2a4f7d1adc2 tempest-CreateVolumesFromImageTest-975962895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85b8d15f-e451-44fd-b210-d1aecfde6918) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e034b4f4-4395-4ff5-be91-89134d9343b1', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:49:47 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-203c6bea-db59-44cd-a573-c2a4f7d1adc2 tempest-CreateVolumesFromImageTest-975962895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f119223-3df2-4c90-9367-c9d3669e9258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:49:47 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-d58110c6-d448-4306-88a5-ffada001b1de tempest-TestStampPattern-1052481563 None] Creating offline snapshot e85c4487-5a3b-4664-a99a-21cbe97e94f8 of volume 1e99cbc0-ed4d-4afc-98e9-f3d7fc32b506 {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 14:49:47 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-203c6bea-db59-44cd-a573-c2a4f7d1adc2 tempest-CreateVolumesFromImageTest-975962895 None] Volume volume-e034b4f4-4395-4ff5-be91-89134d9343b1 (e034b4f4-4395-4ff5-be91-89134d9343b1): created successfully
Jul 09 14:49:47 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-203c6bea-db59-44cd-a573-c2a4f7d1adc2 tempest-CreateVolumesFromImageTest-975962895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f119223-3df2-4c90-9367-c9d3669e9258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:49:47 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-203c6bea-db59-44cd-a573-c2a4f7d1adc2 tempest-CreateVolumesFromImageTest-975962895 None] Flow 'volume_create_manager' (d377f17a-4082-40b9-acf6-ce1d2225bc23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:49:47 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e0b67e-a720-4dc1-a920-43ed7a63332f]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:49:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d58110c6-d448-4306-88a5-ffada001b1de tempest-TestStampPattern-1052481563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1e99cbc0-ed4d-4afc-98e9-f3d7fc32b506 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:49:47 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-203c6bea-db59-44cd-a573-c2a4f7d1adc2 tempest-CreateVolumesFromImageTest-975962895 None] Created volume successfully.
Jul 09 14:49:47 devstack sudo[104760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1e99cbc0-ed4d-4afc-98e9-f3d7fc32b506
Jul 09 14:49:47 devstack sudo[104760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:49:47 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-ccaeec68-827e-4848-b2d8-252dbdf3bf53 tempest-CreateVolumesFromImageTest-975962895 None] Acquiring lock "cinder-e034b4f4-4395-4ff5-be91-89134d9343b1-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:49:47 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-ccaeec68-827e-4848-b2d8-252dbdf3bf53 tempest-CreateVolumesFromImageTest-975962895 None] Lock "cinder-e034b4f4-4395-4ff5-be91-89134d9343b1-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:49:47 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-ccaeec68-827e-4848-b2d8-252dbdf3bf53 tempest-CreateVolumesFromImageTest-975962895 None] Acquiring lock "cinder-quobyte-e034b4f4-4395-4ff5-be91-89134d9343b1" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:49:47 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-ccaeec68-827e-4848-b2d8-252dbdf3bf53 tempest-CreateVolumesFromImageTest-975962895 None] Lock "cinder-quobyte-e034b4f4-4395-4ff5-be91-89134d9343b1" acquired by "delete_volume" :: waited 0.015s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:49:47 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a6cf5d5-dd9c-43eb-bd3e-50473a64533b]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:49:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ccaeec68-827e-4848-b2d8-252dbdf3bf53 tempest-CreateVolumesFromImageTest-975962895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e034b4f4-4395-4ff5-be91-89134d9343b1 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:49:47 devstack sudo[104762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e034b4f4-4395-4ff5-be91-89134d9343b1
Jul 09 14:49:47 devstack sudo[104762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:49:48 devstack sudo[104760]: pam_unix(sudo:session): session closed for user root
Jul 09 14:49:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d58110c6-d448-4306-88a5-ffada001b1de tempest-TestStampPattern-1052481563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1e99cbc0-ed4d-4afc-98e9-f3d7fc32b506" returned: 0 in 0.751s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:49:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d58110c6-d448-4306-88a5-ffada001b1de tempest-TestStampPattern-1052481563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1e99cbc0-ed4d-4afc-98e9-f3d7fc32b506,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1e99cbc0-ed4d-4afc-98e9-f3d7fc32b506.e85c4487-5a3b-4664-a99a-21cbe97e94f8 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:49:48 devstack sudo[104767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1e99cbc0-ed4d-4afc-98e9-f3d7fc32b506,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1e99cbc0-ed4d-4afc-98e9-f3d7fc32b506.e85c4487-5a3b-4664-a99a-21cbe97e94f8 1G
Jul 09 14:49:48 devstack sudo[104767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:49:48 devstack sudo[104762]: pam_unix(sudo:session): session closed for user root
Jul 09 14:49:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ccaeec68-827e-4848-b2d8-252dbdf3bf53 tempest-CreateVolumesFromImageTest-975962895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e034b4f4-4395-4ff5-be91-89134d9343b1" returned: 0 in 0.782s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:49:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ccaeec68-827e-4848-b2d8-252dbdf3bf53 tempest-CreateVolumesFromImageTest-975962895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e034b4f4-4395-4ff5-be91-89134d9343b1 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:49:48 devstack sudo[104772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e034b4f4-4395-4ff5-be91-89134d9343b1
Jul 09 14:49:48 devstack sudo[104772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:49:49 devstack sudo[104767]: pam_unix(sudo:session): session closed for user root
Jul 09 14:49:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d58110c6-d448-4306-88a5-ffada001b1de tempest-TestStampPattern-1052481563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1e99cbc0-ed4d-4afc-98e9-f3d7fc32b506,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1e99cbc0-ed4d-4afc-98e9-f3d7fc32b506.e85c4487-5a3b-4664-a99a-21cbe97e94f8 1G" returned: 0 in 0.819s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:49:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d58110c6-d448-4306-88a5-ffada001b1de tempest-TestStampPattern-1052481563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e99cbc0-ed4d-4afc-98e9-f3d7fc32b506 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1e99cbc0-ed4d-4afc-98e9-f3d7fc32b506.e85c4487-5a3b-4664-a99a-21cbe97e94f8 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:49:49 devstack sudo[104778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e99cbc0-ed4d-4afc-98e9-f3d7fc32b506 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1e99cbc0-ed4d-4afc-98e9-f3d7fc32b506.e85c4487-5a3b-4664-a99a-21cbe97e94f8
Jul 09 14:49:49 devstack sudo[104778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:49:49 devstack sudo[104772]: pam_unix(sudo:session): session closed for user root
Jul 09 14:49:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ccaeec68-827e-4848-b2d8-252dbdf3bf53 tempest-CreateVolumesFromImageTest-975962895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e034b4f4-4395-4ff5-be91-89134d9343b1" returned: 0 in 0.683s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:49:49 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-ccaeec68-827e-4848-b2d8-252dbdf3bf53 tempest-CreateVolumesFromImageTest-975962895 None] Lock "cinder-quobyte-e034b4f4-4395-4ff5-be91-89134d9343b1" released by "delete_volume" :: held 1.502s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:49:49 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-ccaeec68-827e-4848-b2d8-252dbdf3bf53 tempest-CreateVolumesFromImageTest-975962895 None] Created reservations ['4e2e25e5-d36a-4559-9385-ae403d598fbe', '644398a0-e626-4b9d-824b-61818ebe1262', '635e89c6-5b0d-493e-95ce-3f346aa6a221', '2e77d619-d323-4004-98b7-190508712cbf'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:49:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-ccaeec68-827e-4848-b2d8-252dbdf3bf53 tempest-CreateVolumesFromImageTest-975962895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:49:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-ccaeec68-827e-4848-b2d8-252dbdf3bf53 tempest-CreateVolumesFromImageTest-975962895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:49:49 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-ccaeec68-827e-4848-b2d8-252dbdf3bf53 tempest-CreateVolumesFromImageTest-975962895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:49:49 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-ccaeec68-827e-4848-b2d8-252dbdf3bf53 tempest-CreateVolumesFromImageTest-975962895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:49:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-ccaeec68-827e-4848-b2d8-252dbdf3bf53 tempest-CreateVolumesFromImageTest-975962895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:49:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ccaeec68-827e-4848-b2d8-252dbdf3bf53 tempest-CreateVolumesFromImageTest-975962895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:49:49 devstack sudo[104781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:49:49 devstack sudo[104781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:49:49 devstack sudo[104778]: pam_unix(sudo:session): session closed for user root
Jul 09 14:49:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d58110c6-d448-4306-88a5-ffada001b1de tempest-TestStampPattern-1052481563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e99cbc0-ed4d-4afc-98e9-f3d7fc32b506 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1e99cbc0-ed4d-4afc-98e9-f3d7fc32b506.e85c4487-5a3b-4664-a99a-21cbe97e94f8" returned: 0 in 0.713s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:49:49 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-d58110c6-d448-4306-88a5-ffada001b1de tempest-TestStampPattern-1052481563 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1e99cbc0-ed4d-4afc-98e9-f3d7fc32b506.e85c4487-5a3b-4664-a99a-21cbe97e94f8 is being set with open permissions: ugo+rw
Jul 09 14:49:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d58110c6-d448-4306-88a5-ffada001b1de tempest-TestStampPattern-1052481563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1e99cbc0-ed4d-4afc-98e9-f3d7fc32b506.e85c4487-5a3b-4664-a99a-21cbe97e94f8 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:49:49 devstack sudo[104786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1e99cbc0-ed4d-4afc-98e9-f3d7fc32b506.e85c4487-5a3b-4664-a99a-21cbe97e94f8
Jul 09 14:49:49 devstack sudo[104786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:49:49 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-ac692ea2-b411-4951-a936-98c2fc58e5b2 tempest-CreateVolumesFromImageTest-975962895 None] Acquiring lock "cinder-88e09a22-eb55-4c7d-9ec3-c9033bfa0a92-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:49:49 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-ac692ea2-b411-4951-a936-98c2fc58e5b2 tempest-CreateVolumesFromImageTest-975962895 None] Lock "cinder-88e09a22-eb55-4c7d-9ec3-c9033bfa0a92-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:49:50 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-ac692ea2-b411-4951-a936-98c2fc58e5b2 tempest-CreateVolumesFromImageTest-975962895 None] Acquiring lock "cinder-quobyte-88e09a22-eb55-4c7d-9ec3-c9033bfa0a92" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:49:50 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-ac692ea2-b411-4951-a936-98c2fc58e5b2 tempest-CreateVolumesFromImageTest-975962895 None] Lock "cinder-quobyte-88e09a22-eb55-4c7d-9ec3-c9033bfa0a92" acquired by "delete_volume" :: waited 0.018s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:49:50 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae141a6-57cb-4fcb-b7b1-f963de949e9d]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:49:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ac692ea2-b411-4951-a936-98c2fc58e5b2 tempest-CreateVolumesFromImageTest-975962895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-88e09a22-eb55-4c7d-9ec3-c9033bfa0a92 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:49:50 devstack sudo[104781]: pam_unix(sudo:session): session closed for user root
Jul 09 14:49:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ccaeec68-827e-4848-b2d8-252dbdf3bf53 tempest-CreateVolumesFromImageTest-975962895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.693s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:49:50 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-ccaeec68-827e-4848-b2d8-252dbdf3bf53 tempest-CreateVolumesFromImageTest-975962895 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:49:50 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-ccaeec68-827e-4848-b2d8-252dbdf3bf53 tempest-CreateVolumesFromImageTest-975962895 None] Deleted volume successfully.
Jul 09 14:49:50 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-ccaeec68-827e-4848-b2d8-252dbdf3bf53 tempest-CreateVolumesFromImageTest-975962895 None] Lock "cinder-e034b4f4-4395-4ff5-be91-89134d9343b1-delete_volume" released by "delete_volume" :: held 2.423s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:49:50 devstack sudo[104789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-88e09a22-eb55-4c7d-9ec3-c9033bfa0a92
Jul 09 14:49:50 devstack sudo[104789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:49:50 devstack sudo[104786]: pam_unix(sudo:session): session closed for user root
Jul 09 14:49:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d58110c6-d448-4306-88a5-ffada001b1de tempest-TestStampPattern-1052481563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1e99cbc0-ed4d-4afc-98e9-f3d7fc32b506.e85c4487-5a3b-4664-a99a-21cbe97e94f8" returned: 0 in 0.672s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:49:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d58110c6-d448-4306-88a5-ffada001b1de tempest-TestStampPattern-1052481563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1e99cbc0-ed4d-4afc-98e9-f3d7fc32b506.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:49:50 devstack sudo[104792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1e99cbc0-ed4d-4afc-98e9-f3d7fc32b506.info
Jul 09 14:49:50 devstack sudo[104792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:49:50 devstack sudo[104789]: pam_unix(sudo:session): session closed for user root
Jul 09 14:49:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ac692ea2-b411-4951-a936-98c2fc58e5b2 tempest-CreateVolumesFromImageTest-975962895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-88e09a22-eb55-4c7d-9ec3-c9033bfa0a92" returned: 0 in 0.793s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:49:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ac692ea2-b411-4951-a936-98c2fc58e5b2 tempest-CreateVolumesFromImageTest-975962895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-88e09a22-eb55-4c7d-9ec3-c9033bfa0a92 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:49:50 devstack sudo[104798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-88e09a22-eb55-4c7d-9ec3-c9033bfa0a92
Jul 09 14:49:50 devstack sudo[104798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:49:51 devstack sudo[104792]: pam_unix(sudo:session): session closed for user root
Jul 09 14:49:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d58110c6-d448-4306-88a5-ffada001b1de tempest-TestStampPattern-1052481563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1e99cbc0-ed4d-4afc-98e9-f3d7fc32b506.info" returned: 0 in 0.676s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:49:51 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-d58110c6-d448-4306-88a5-ffada001b1de tempest-TestStampPattern-1052481563 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1e99cbc0-ed4d-4afc-98e9-f3d7fc32b506.info is being set with open permissions: ugo+rw
Jul 09 14:49:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d58110c6-d448-4306-88a5-ffada001b1de tempest-TestStampPattern-1052481563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1e99cbc0-ed4d-4afc-98e9-f3d7fc32b506.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:49:51 devstack sudo[104801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1e99cbc0-ed4d-4afc-98e9-f3d7fc32b506.info
Jul 09 14:49:51 devstack sudo[104801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:49:51 devstack sudo[104798]: pam_unix(sudo:session): session closed for user root
Jul 09 14:49:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ac692ea2-b411-4951-a936-98c2fc58e5b2 tempest-CreateVolumesFromImageTest-975962895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-88e09a22-eb55-4c7d-9ec3-c9033bfa0a92" returned: 0 in 0.666s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:49:51 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-ac692ea2-b411-4951-a936-98c2fc58e5b2 tempest-CreateVolumesFromImageTest-975962895 None] Lock "cinder-quobyte-88e09a22-eb55-4c7d-9ec3-c9033bfa0a92" released by "delete_volume" :: held 1.502s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:49:51 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-ac692ea2-b411-4951-a936-98c2fc58e5b2 tempest-CreateVolumesFromImageTest-975962895 None] Created reservations ['198abd37-39e6-4e87-8841-999fa77fe2f1', 'dc05840b-5289-4981-9fdc-13ccac7c53c4', '868d75d1-0cd3-4d14-984c-79c081e38bb8', 'f597b2f2-9602-4792-bcb7-5893ddd57731'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:49:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-ac692ea2-b411-4951-a936-98c2fc58e5b2 tempest-CreateVolumesFromImageTest-975962895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:49:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-ac692ea2-b411-4951-a936-98c2fc58e5b2 tempest-CreateVolumesFromImageTest-975962895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:49:51 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-ac692ea2-b411-4951-a936-98c2fc58e5b2 tempest-CreateVolumesFromImageTest-975962895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:49:51 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-ac692ea2-b411-4951-a936-98c2fc58e5b2 tempest-CreateVolumesFromImageTest-975962895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:49:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-ac692ea2-b411-4951-a936-98c2fc58e5b2 tempest-CreateVolumesFromImageTest-975962895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:49:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ac692ea2-b411-4951-a936-98c2fc58e5b2 tempest-CreateVolumesFromImageTest-975962895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:49:51 devstack sudo[104804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:49:51 devstack sudo[104804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:49:51 devstack sudo[104801]: pam_unix(sudo:session): session closed for user root
Jul 09 14:49:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d58110c6-d448-4306-88a5-ffada001b1de tempest-TestStampPattern-1052481563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1e99cbc0-ed4d-4afc-98e9-f3d7fc32b506.info" returned: 0 in 0.668s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:49:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d58110c6-d448-4306-88a5-ffada001b1de tempest-TestStampPattern-1052481563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.445s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:49:51 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-d58110c6-d448-4306-88a5-ffada001b1de tempest-TestStampPattern-1052481563 None] Create snapshot completed successfully
Jul 09 14:49:52 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-44efbd97-8613-4253-bfc3-ba90c23ae9c0 tempest-CreateVolumesFromImageTest-975962895 None] Acquiring lock "cinder-e9279a4d-fd06-4f63-9a80-00b5ec761b3d-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:49:52 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-44efbd97-8613-4253-bfc3-ba90c23ae9c0 tempest-CreateVolumesFromImageTest-975962895 None] Lock "cinder-e9279a4d-fd06-4f63-9a80-00b5ec761b3d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:49:52 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-44efbd97-8613-4253-bfc3-ba90c23ae9c0 tempest-CreateVolumesFromImageTest-975962895 None] Acquiring lock "cinder-quobyte-e9279a4d-fd06-4f63-9a80-00b5ec761b3d" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:49:52 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-44efbd97-8613-4253-bfc3-ba90c23ae9c0 tempest-CreateVolumesFromImageTest-975962895 None] Lock "cinder-quobyte-e9279a4d-fd06-4f63-9a80-00b5ec761b3d" acquired by "delete_volume" :: waited 0.023s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:49:52 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[d25caa8b-9024-47be-9ac4-c46d84af6157]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:49:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-44efbd97-8613-4253-bfc3-ba90c23ae9c0 tempest-CreateVolumesFromImageTest-975962895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e9279a4d-fd06-4f63-9a80-00b5ec761b3d {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:49:52 devstack sudo[104804]: pam_unix(sudo:session): session closed for user root
Jul 09 14:49:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ac692ea2-b411-4951-a936-98c2fc58e5b2 tempest-CreateVolumesFromImageTest-975962895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.667s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:49:52 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-ac692ea2-b411-4951-a936-98c2fc58e5b2 tempest-CreateVolumesFromImageTest-975962895 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:49:52 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-ac692ea2-b411-4951-a936-98c2fc58e5b2 tempest-CreateVolumesFromImageTest-975962895 None] Deleted volume successfully.
Jul 09 14:49:52 devstack sudo[104808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e9279a4d-fd06-4f63-9a80-00b5ec761b3d
Jul 09 14:49:52 devstack sudo[104808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:49:52 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-ac692ea2-b411-4951-a936-98c2fc58e5b2 tempest-CreateVolumesFromImageTest-975962895 None] Lock "cinder-88e09a22-eb55-4c7d-9ec3-c9033bfa0a92-delete_volume" released by "delete_volume" :: held 2.398s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:49:52 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 14:49:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:49:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:49:52 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:49:52 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:49:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:49:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:49:52 devstack sudo[104810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:49:52 devstack sudo[104810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:49:53 devstack sudo[104808]: pam_unix(sudo:session): session closed for user root
Jul 09 14:49:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-44efbd97-8613-4253-bfc3-ba90c23ae9c0 tempest-CreateVolumesFromImageTest-975962895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e9279a4d-fd06-4f63-9a80-00b5ec761b3d" returned: 0 in 0.794s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:49:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-44efbd97-8613-4253-bfc3-ba90c23ae9c0 tempest-CreateVolumesFromImageTest-975962895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e9279a4d-fd06-4f63-9a80-00b5ec761b3d {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:49:53 devstack sudo[104810]: pam_unix(sudo:session): session closed for user root
Jul 09 14:49:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.675s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:49:53 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:49:53 devstack sudo[104816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e9279a4d-fd06-4f63-9a80-00b5ec761b3d
Jul 09 14:49:53 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Running periodic task VolumeManager._thread_info {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 14:49:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] thread count: 28 {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 09 14:49:53 devstack sudo[104816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:49:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] thread info: [<_MainThread(MainThread, started 125388812103808)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125388713797504)>, <Thread(Thread-3 (stat_writer), started daemon 125388699995392)>, <Thread(Rabbit-heartbeat, started daemon 125388700522560)>, <Thread(Thread-5 (_runner), started daemon 125388698545216)>, <Thread(Thread-7 (_runner), started daemon 125388698611264)>, <Thread(fd_logger, started daemon 125388703020672)>, <Thread(privsep_reader, started daemon 125388696441088)>, <Thread(tpool_thread_0, started daemon 125388687943360)>, <Thread(tpool_thread_1, started daemon 125388679550656)>, <Thread(tpool_thread_2, started daemon 125388671141568)>, <Thread(tpool_thread_3, started daemon 125388662732480)>, <Thread(tpool_thread_4, started daemon 125388654323392)>, <Thread(tpool_thread_5, started daemon 125388645914304)>, <Thread(tpool_thread_6, started daemon 125388637505216)>, <Thread(tpool_thread_7, started daemon 125388629096128)>, <Thread(tpool_thread_8, started daemon 125388620687040)>, <Thread(tpool_thread_9, started daemon 125388612277952)>, <Thread(tpool_thread_10, started daemon 125388603868864)>, <Thread(tpool_thread_11, started daemon 125388595459776)>, <Thread(tpool_thread_12, started daemon 125388587050688)>, <Thread(tpool_thread_13, started daemon 125388578641600)>, <Thread(tpool_thread_14, started daemon 125388570232512)>, <Thread(tpool_thread_15, started daemon 125388561823424)>, <Thread(tpool_thread_16, started daemon 125388553414336)>, <Thread(tpool_thread_17, started daemon 125388545005248)>, <Thread(tpool_thread_18, started daemon 125388536596160)>, <Thread(tpool_thread_19, started daemon 125388528187072)>] {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 09 14:49:53 devstack sudo[104816]: pam_unix(sudo:session): session closed for user root
Jul 09 14:49:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-44efbd97-8613-4253-bfc3-ba90c23ae9c0 tempest-CreateVolumesFromImageTest-975962895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e9279a4d-fd06-4f63-9a80-00b5ec761b3d" returned: 0 in 0.682s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:49:53 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-44efbd97-8613-4253-bfc3-ba90c23ae9c0 tempest-CreateVolumesFromImageTest-975962895 None] Lock "cinder-quobyte-e9279a4d-fd06-4f63-9a80-00b5ec761b3d" released by "delete_volume" :: held 1.514s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:49:53 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-44efbd97-8613-4253-bfc3-ba90c23ae9c0 tempest-CreateVolumesFromImageTest-975962895 None] Created reservations ['9b876170-936e-4a1d-9d94-de38383ec0ab', '6faa82ac-aa15-4da1-856a-ee9207233524', 'e0718392-97c0-4cde-98c8-5390f7673ef0', '2545df28-e169-49e0-8008-6d0f4d153a40'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:49:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-44efbd97-8613-4253-bfc3-ba90c23ae9c0 tempest-CreateVolumesFromImageTest-975962895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:49:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-44efbd97-8613-4253-bfc3-ba90c23ae9c0 tempest-CreateVolumesFromImageTest-975962895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:49:53 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-44efbd97-8613-4253-bfc3-ba90c23ae9c0 tempest-CreateVolumesFromImageTest-975962895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:49:53 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-44efbd97-8613-4253-bfc3-ba90c23ae9c0 tempest-CreateVolumesFromImageTest-975962895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:49:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-44efbd97-8613-4253-bfc3-ba90c23ae9c0 tempest-CreateVolumesFromImageTest-975962895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:49:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-44efbd97-8613-4253-bfc3-ba90c23ae9c0 tempest-CreateVolumesFromImageTest-975962895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:49:53 devstack sudo[104819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:49:53 devstack sudo[104819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:49:54 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-fa1659d1-6460-418a-a985-17a0c8010e13 tempest-CreateVolumesFromImageTest-975962895 None] Acquiring lock "cinder-ae754e9c-f7cb-427d-90b8-8748ece6595f-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:49:54 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-fa1659d1-6460-418a-a985-17a0c8010e13 tempest-CreateVolumesFromImageTest-975962895 None] Lock "cinder-ae754e9c-f7cb-427d-90b8-8748ece6595f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:49:54 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-fa1659d1-6460-418a-a985-17a0c8010e13 tempest-CreateVolumesFromImageTest-975962895 None] Acquiring lock "cinder-quobyte-ae754e9c-f7cb-427d-90b8-8748ece6595f" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:49:54 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-fa1659d1-6460-418a-a985-17a0c8010e13 tempest-CreateVolumesFromImageTest-975962895 None] Lock "cinder-quobyte-ae754e9c-f7cb-427d-90b8-8748ece6595f" acquired by "delete_volume" :: waited 0.019s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:49:54 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca0fadd-a778-417f-886c-b3d85349bef4]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:49:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fa1659d1-6460-418a-a985-17a0c8010e13 tempest-CreateVolumesFromImageTest-975962895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ae754e9c-f7cb-427d-90b8-8748ece6595f {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:49:54 devstack sudo[104819]: pam_unix(sudo:session): session closed for user root
Jul 09 14:49:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-44efbd97-8613-4253-bfc3-ba90c23ae9c0 tempest-CreateVolumesFromImageTest-975962895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.656s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:49:54 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-44efbd97-8613-4253-bfc3-ba90c23ae9c0 tempest-CreateVolumesFromImageTest-975962895 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:49:54 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-44efbd97-8613-4253-bfc3-ba90c23ae9c0 tempest-CreateVolumesFromImageTest-975962895 None] Deleted volume successfully.
Jul 09 14:49:54 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-44efbd97-8613-4253-bfc3-ba90c23ae9c0 tempest-CreateVolumesFromImageTest-975962895 None] Lock "cinder-e9279a4d-fd06-4f63-9a80-00b5ec761b3d-delete_volume" released by "delete_volume" :: held 2.373s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:49:54 devstack sudo[104822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ae754e9c-f7cb-427d-90b8-8748ece6595f
Jul 09 14:49:54 devstack sudo[104822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:49:55 devstack sudo[104822]: pam_unix(sudo:session): session closed for user root
Jul 09 14:49:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fa1659d1-6460-418a-a985-17a0c8010e13 tempest-CreateVolumesFromImageTest-975962895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ae754e9c-f7cb-427d-90b8-8748ece6595f" returned: 0 in 0.773s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:49:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fa1659d1-6460-418a-a985-17a0c8010e13 tempest-CreateVolumesFromImageTest-975962895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ae754e9c-f7cb-427d-90b8-8748ece6595f {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:49:55 devstack sudo[104827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ae754e9c-f7cb-427d-90b8-8748ece6595f
Jul 09 14:49:55 devstack sudo[104827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:49:55 devstack sudo[104827]: pam_unix(sudo:session): session closed for user root
Jul 09 14:49:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fa1659d1-6460-418a-a985-17a0c8010e13 tempest-CreateVolumesFromImageTest-975962895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ae754e9c-f7cb-427d-90b8-8748ece6595f" returned: 0 in 0.657s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:49:55 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-fa1659d1-6460-418a-a985-17a0c8010e13 tempest-CreateVolumesFromImageTest-975962895 None] Lock "cinder-quobyte-ae754e9c-f7cb-427d-90b8-8748ece6595f" released by "delete_volume" :: held 1.472s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:49:56 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-fa1659d1-6460-418a-a985-17a0c8010e13 tempest-CreateVolumesFromImageTest-975962895 None] Created reservations ['1d7c0b4b-9083-49e0-9a17-ea5c06d1d179', '9d1b882f-0180-4f8b-8789-dbffee32298d', '2f751bf7-bb89-43d7-aeaa-c4d691869ac3', '49cfbe74-b5e6-490e-8fb4-daefab0e0e70'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:49:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-fa1659d1-6460-418a-a985-17a0c8010e13 tempest-CreateVolumesFromImageTest-975962895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:49:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-fa1659d1-6460-418a-a985-17a0c8010e13 tempest-CreateVolumesFromImageTest-975962895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:49:56 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-fa1659d1-6460-418a-a985-17a0c8010e13 tempest-CreateVolumesFromImageTest-975962895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:49:56 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-fa1659d1-6460-418a-a985-17a0c8010e13 tempest-CreateVolumesFromImageTest-975962895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:49:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-fa1659d1-6460-418a-a985-17a0c8010e13 tempest-CreateVolumesFromImageTest-975962895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:49:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fa1659d1-6460-418a-a985-17a0c8010e13 tempest-CreateVolumesFromImageTest-975962895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:49:56 devstack sudo[104836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:49:56 devstack sudo[104836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:49:56 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f9079a4f-d666-4fd0-9d2c-2af29310332f tempest-CreateVolumesFromImageTest-975962895 None] Acquiring lock "cinder-43385a77-8231-4b41-9e5e-eb34f0e14e9b-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:49:56 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f9079a4f-d666-4fd0-9d2c-2af29310332f tempest-CreateVolumesFromImageTest-975962895 None] Lock "cinder-43385a77-8231-4b41-9e5e-eb34f0e14e9b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:49:56 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f9079a4f-d666-4fd0-9d2c-2af29310332f tempest-CreateVolumesFromImageTest-975962895 None] Acquiring lock "cinder-quobyte-43385a77-8231-4b41-9e5e-eb34f0e14e9b" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:49:56 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f9079a4f-d666-4fd0-9d2c-2af29310332f tempest-CreateVolumesFromImageTest-975962895 None] Lock "cinder-quobyte-43385a77-8231-4b41-9e5e-eb34f0e14e9b" acquired by "delete_volume" :: waited 0.019s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:49:56 devstack sudo[104836]: pam_unix(sudo:session): session closed for user root
Jul 09 14:49:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fa1659d1-6460-418a-a985-17a0c8010e13 tempest-CreateVolumesFromImageTest-975962895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.672s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:49:56 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-fa1659d1-6460-418a-a985-17a0c8010e13 tempest-CreateVolumesFromImageTest-975962895 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:49:56 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-fa1659d1-6460-418a-a985-17a0c8010e13 tempest-CreateVolumesFromImageTest-975962895 None] Deleted volume successfully.
Jul 09 14:49:56 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d575a4-7a2d-416b-90e0-95c1da86419c]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:49:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f9079a4f-d666-4fd0-9d2c-2af29310332f tempest-CreateVolumesFromImageTest-975962895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-43385a77-8231-4b41-9e5e-eb34f0e14e9b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:49:56 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-fa1659d1-6460-418a-a985-17a0c8010e13 tempest-CreateVolumesFromImageTest-975962895 None] Lock "cinder-ae754e9c-f7cb-427d-90b8-8748ece6595f-delete_volume" released by "delete_volume" :: held 2.357s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:49:56 devstack sudo[104840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-43385a77-8231-4b41-9e5e-eb34f0e14e9b
Jul 09 14:49:56 devstack sudo[104840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:49:57 devstack sudo[104840]: pam_unix(sudo:session): session closed for user root
Jul 09 14:49:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f9079a4f-d666-4fd0-9d2c-2af29310332f tempest-CreateVolumesFromImageTest-975962895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-43385a77-8231-4b41-9e5e-eb34f0e14e9b" returned: 0 in 0.801s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:49:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f9079a4f-d666-4fd0-9d2c-2af29310332f tempest-CreateVolumesFromImageTest-975962895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-43385a77-8231-4b41-9e5e-eb34f0e14e9b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:49:57 devstack sudo[104869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-43385a77-8231-4b41-9e5e-eb34f0e14e9b
Jul 09 14:49:57 devstack sudo[104869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:49:58 devstack sudo[104869]: pam_unix(sudo:session): session closed for user root
Jul 09 14:49:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f9079a4f-d666-4fd0-9d2c-2af29310332f tempest-CreateVolumesFromImageTest-975962895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-43385a77-8231-4b41-9e5e-eb34f0e14e9b" returned: 0 in 0.659s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:49:58 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f9079a4f-d666-4fd0-9d2c-2af29310332f tempest-CreateVolumesFromImageTest-975962895 None] Lock "cinder-quobyte-43385a77-8231-4b41-9e5e-eb34f0e14e9b" released by "delete_volume" :: held 1.509s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:49:58 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-f9079a4f-d666-4fd0-9d2c-2af29310332f tempest-CreateVolumesFromImageTest-975962895 None] Created reservations ['faf8f01d-f88b-4024-8c86-8e1954a2223b', 'fcce449b-d218-4a1b-86e5-396adcf2747f', '4e729c10-c3ef-4c54-a049-7d9000bca3dd', '2715c409-7acd-4920-bc05-b1e010a72e02'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:49:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f9079a4f-d666-4fd0-9d2c-2af29310332f tempest-CreateVolumesFromImageTest-975962895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:49:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f9079a4f-d666-4fd0-9d2c-2af29310332f tempest-CreateVolumesFromImageTest-975962895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:49:58 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f9079a4f-d666-4fd0-9d2c-2af29310332f tempest-CreateVolumesFromImageTest-975962895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:49:58 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f9079a4f-d666-4fd0-9d2c-2af29310332f tempest-CreateVolumesFromImageTest-975962895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:49:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f9079a4f-d666-4fd0-9d2c-2af29310332f tempest-CreateVolumesFromImageTest-975962895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:49:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f9079a4f-d666-4fd0-9d2c-2af29310332f tempest-CreateVolumesFromImageTest-975962895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:49:58 devstack sudo[104882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:49:58 devstack sudo[104882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:49:59 devstack sudo[104882]: pam_unix(sudo:session): session closed for user root
Jul 09 14:49:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f9079a4f-d666-4fd0-9d2c-2af29310332f tempest-CreateVolumesFromImageTest-975962895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.646s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:49:59 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-f9079a4f-d666-4fd0-9d2c-2af29310332f tempest-CreateVolumesFromImageTest-975962895 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:49:59 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-f9079a4f-d666-4fd0-9d2c-2af29310332f tempest-CreateVolumesFromImageTest-975962895 None] Deleted volume successfully.
Jul 09 14:49:59 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f9079a4f-d666-4fd0-9d2c-2af29310332f tempest-CreateVolumesFromImageTest-975962895 None] Lock "cinder-43385a77-8231-4b41-9e5e-eb34f0e14e9b-delete_volume" released by "delete_volume" :: held 2.370s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:50:02 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-79476bab-0596-45ad-874d-669dd3986197 tempest-CinderUnicodeTest-1565738034 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:50:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-79476bab-0596-45ad-874d-669dd3986197 tempest-CinderUnicodeTest-1565738034 None] Flow 'volume_create_manager' (18252422-c8d7-4ece-a971-b84fe176d434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:50:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-79476bab-0596-45ad-874d-669dd3986197 tempest-CinderUnicodeTest-1565738034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3145f0c6-9c15-4631-a7e8-9e9b5174c5fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:50:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-79476bab-0596-45ad-874d-669dd3986197 tempest-CinderUnicodeTest-1565738034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3145f0c6-9c15-4631-a7e8-9e9b5174c5fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:50:02Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7ee3e02-32b7-4687-a5e0-394d1209b691,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2259130c12845f48c9c4f0ad2377415',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:50:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:50:02Z,use_quota=True,user_id='105ac68036af4cc8ab9935856d21cc92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:50:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-79476bab-0596-45ad-874d-669dd3986197 tempest-CinderUnicodeTest-1565738034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d3949d9-14fa-4f06-8930-f25a6fd80103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:50:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-79476bab-0596-45ad-874d-669dd3986197 tempest-CinderUnicodeTest-1565738034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d3949d9-14fa-4f06-8930-f25a6fd80103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:50:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-79476bab-0596-45ad-874d-669dd3986197 tempest-CinderUnicodeTest-1565738034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f997c6ca-64e1-4058-a546-e0fde1a8450c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:50:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-79476bab-0596-45ad-874d-669dd3986197 tempest-CinderUnicodeTest-1565738034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f997c6ca-64e1-4058-a546-e0fde1a8450c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7ee3e02-32b7-4687-a5e0-394d1209b691', 'volume_name': 'volume-f7ee3e02-32b7-4687-a5e0-394d1209b691', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:50:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-79476bab-0596-45ad-874d-669dd3986197 tempest-CinderUnicodeTest-1565738034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70956d4d-0635-4cac-ba14-c11b4bcba239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:50:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-79476bab-0596-45ad-874d-669dd3986197 tempest-CinderUnicodeTest-1565738034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70956d4d-0635-4cac-ba14-c11b4bcba239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:50:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-79476bab-0596-45ad-874d-669dd3986197 tempest-CinderUnicodeTest-1565738034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f7c2788-7590-452d-aa92-b5489f86ed65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:50:02 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-79476bab-0596-45ad-874d-669dd3986197 tempest-CinderUnicodeTest-1565738034 None] Volume f7ee3e02-32b7-4687-a5e0-394d1209b691: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7ee3e02-32b7-4687-a5e0-394d1209b691', 'volume_size': 1}
Jul 09 14:50:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-79476bab-0596-45ad-874d-669dd3986197 tempest-CinderUnicodeTest-1565738034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:50:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-79476bab-0596-45ad-874d-669dd3986197 tempest-CinderUnicodeTest-1565738034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:50:02 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-79476bab-0596-45ad-874d-669dd3986197 tempest-CinderUnicodeTest-1565738034 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:50:02Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7ee3e02-32b7-4687-a5e0-394d1209b691,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2259130c12845f48c9c4f0ad2377415',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:50:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:50:02Z,use_quota=True,user_id='105ac68036af4cc8ab9935856d21cc92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:50:02 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-79476bab-0596-45ad-874d-669dd3986197 tempest-CinderUnicodeTest-1565738034 None] Creating volume f7ee3e02-32b7-4687-a5e0-394d1209b691 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:50:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-79476bab-0596-45ad-874d-669dd3986197 tempest-CinderUnicodeTest-1565738034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:50:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-79476bab-0596-45ad-874d-669dd3986197 tempest-CinderUnicodeTest-1565738034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:50:02 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-79476bab-0596-45ad-874d-669dd3986197 tempest-CinderUnicodeTest-1565738034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:50:02 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-79476bab-0596-45ad-874d-669dd3986197 tempest-CinderUnicodeTest-1565738034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:50:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-79476bab-0596-45ad-874d-669dd3986197 tempest-CinderUnicodeTest-1565738034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:50:02 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-79476bab-0596-45ad-874d-669dd3986197 tempest-CinderUnicodeTest-1565738034 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:50:02 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-79476bab-0596-45ad-874d-669dd3986197 tempest-CinderUnicodeTest-1565738034 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:50:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-79476bab-0596-45ad-874d-669dd3986197 tempest-CinderUnicodeTest-1565738034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-f7ee3e02-32b7-4687-a5e0-394d1209b691 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:50:02 devstack sudo[104886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-f7ee3e02-32b7-4687-a5e0-394d1209b691 1073741824
Jul 09 14:50:02 devstack sudo[104886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:50:02 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-8171442e-2eec-4a45-8617-57e5f4211cc6 tempest-TestStampPattern-1052481563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:50:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8171442e-2eec-4a45-8617-57e5f4211cc6 tempest-TestStampPattern-1052481563 None] Flow 'volume_create_manager' (f24f0409-e65f-46e1-812a-60d19c3cf9b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:50:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8171442e-2eec-4a45-8617-57e5f4211cc6 tempest-TestStampPattern-1052481563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c96fe4a-22c1-434c-bd49-bd15a18ab6c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:50:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8171442e-2eec-4a45-8617-57e5f4211cc6 tempest-TestStampPattern-1052481563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c96fe4a-22c1-434c-bd49-bd15a18ab6c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:50:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-904464452',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22de57c3-3178-42ec-a08b-9ee7793a2890,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1b1ce49e17d4ad49dc23185dd1559dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:50:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e85c4487-5a3b-4664-a99a-21cbe97e94f8,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:50:03Z,use_quota=True,user_id='763f1c41ac1e46ad814ff793f61b66fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:50:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8171442e-2eec-4a45-8617-57e5f4211cc6 tempest-TestStampPattern-1052481563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f073b68-6129-48d6-9945-33831fe05504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:50:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8171442e-2eec-4a45-8617-57e5f4211cc6 tempest-TestStampPattern-1052481563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f073b68-6129-48d6-9945-33831fe05504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:50:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8171442e-2eec-4a45-8617-57e5f4211cc6 tempest-TestStampPattern-1052481563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8a1590c-c908-4c07-b9c4-a4818385c670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:50:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8171442e-2eec-4a45-8617-57e5f4211cc6 tempest-TestStampPattern-1052481563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8a1590c-c908-4c07-b9c4-a4818385c670) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '22de57c3-3178-42ec-a08b-9ee7793a2890', 'volume_name': 'volume-22de57c3-3178-42ec-a08b-9ee7793a2890', 'volume_size': 1, 'snapshot_id': 'e85c4487-5a3b-4664-a99a-21cbe97e94f8'}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:50:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8171442e-2eec-4a45-8617-57e5f4211cc6 tempest-TestStampPattern-1052481563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5151d690-f03b-4514-9523-051bfd688072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:50:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8171442e-2eec-4a45-8617-57e5f4211cc6 tempest-TestStampPattern-1052481563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5151d690-f03b-4514-9523-051bfd688072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:50:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8171442e-2eec-4a45-8617-57e5f4211cc6 tempest-TestStampPattern-1052481563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20d0cb66-5681-4c2c-8aa6-4164e6ebb40f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:50:02 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-8171442e-2eec-4a45-8617-57e5f4211cc6 tempest-TestStampPattern-1052481563 None] Volume 22de57c3-3178-42ec-a08b-9ee7793a2890: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-22de57c3-3178-42ec-a08b-9ee7793a2890', 'volume_size': 1, 'snapshot_id': 'e85c4487-5a3b-4664-a99a-21cbe97e94f8'}
Jul 09 14:50:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8171442e-2eec-4a45-8617-57e5f4211cc6 tempest-TestStampPattern-1052481563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:50:03 devstack sudo[104886]: pam_unix(sudo:session): session closed for user root
Jul 09 14:50:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-79476bab-0596-45ad-874d-669dd3986197 tempest-CinderUnicodeTest-1565738034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-f7ee3e02-32b7-4687-a5e0-394d1209b691 1073741824" returned: 0 in 0.942s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:50:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-79476bab-0596-45ad-874d-669dd3986197 tempest-CinderUnicodeTest-1565738034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-f7ee3e02-32b7-4687-a5e0-394d1209b691 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:50:03 devstack sudo[104901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-f7ee3e02-32b7-4687-a5e0-394d1209b691
Jul 09 14:50:03 devstack sudo[104901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:50:03 devstack sudo[104901]: pam_unix(sudo:session): session closed for user root
Jul 09 14:50:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-79476bab-0596-45ad-874d-669dd3986197 tempest-CinderUnicodeTest-1565738034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-f7ee3e02-32b7-4687-a5e0-394d1209b691" returned: 0 in 0.696s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:50:03 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-79476bab-0596-45ad-874d-669dd3986197 tempest-CinderUnicodeTest-1565738034 None] <== create_volume: return (1676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:50:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-79476bab-0596-45ad-874d-669dd3986197 tempest-CinderUnicodeTest-1565738034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.680s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:50:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8171442e-2eec-4a45-8617-57e5f4211cc6 tempest-TestStampPattern-1052481563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.032s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:50:03 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8171442e-2eec-4a45-8617-57e5f4211cc6 tempest-TestStampPattern-1052481563 None] Acquiring lock "cinder-quobyte-e85c4487-5a3b-4664-a99a-21cbe97e94f8-22de57c3-3178-42ec-a08b-9ee7793a2890" by "_create_volume_from_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:50:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-79476bab-0596-45ad-874d-669dd3986197 tempest-CinderUnicodeTest-1565738034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f7c2788-7590-452d-aa92-b5489f86ed65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7ee3e02-32b7-4687-a5e0-394d1209b691', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:50:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-79476bab-0596-45ad-874d-669dd3986197 tempest-CinderUnicodeTest-1565738034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f8c9475-b123-4766-99d1-411d8ff27e9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:50:03 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8171442e-2eec-4a45-8617-57e5f4211cc6 tempest-TestStampPattern-1052481563 None] Lock "cinder-quobyte-e85c4487-5a3b-4664-a99a-21cbe97e94f8-22de57c3-3178-42ec-a08b-9ee7793a2890" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:50:03 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-8171442e-2eec-4a45-8617-57e5f4211cc6 tempest-TestStampPattern-1052481563 None] Creating volume 22de57c3-3178-42ec-a08b-9ee7793a2890 from snapshot e85c4487-5a3b-4664-a99a-21cbe97e94f8 {{(pid=87230) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 09 14:50:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8171442e-2eec-4a45-8617-57e5f4211cc6 tempest-TestStampPattern-1052481563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:50:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8171442e-2eec-4a45-8617-57e5f4211cc6 tempest-TestStampPattern-1052481563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:50:03 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-8171442e-2eec-4a45-8617-57e5f4211cc6 tempest-TestStampPattern-1052481563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:50:03 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-8171442e-2eec-4a45-8617-57e5f4211cc6 tempest-TestStampPattern-1052481563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:50:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8171442e-2eec-4a45-8617-57e5f4211cc6 tempest-TestStampPattern-1052481563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:50:03 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-8171442e-2eec-4a45-8617-57e5f4211cc6 tempest-TestStampPattern-1052481563 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:50:03 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8171442e-2eec-4a45-8617-57e5f4211cc6 tempest-TestStampPattern-1052481563 None] Acquiring lock "cinder-quobyte-22de57c3-3178-42ec-a08b-9ee7793a2890" by "_copy_volume_from_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:50:03 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-79476bab-0596-45ad-874d-669dd3986197 tempest-CinderUnicodeTest-1565738034 None] Volume volume-f7ee3e02-32b7-4687-a5e0-394d1209b691 (f7ee3e02-32b7-4687-a5e0-394d1209b691): created successfully
Jul 09 14:50:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-79476bab-0596-45ad-874d-669dd3986197 tempest-CinderUnicodeTest-1565738034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f8c9475-b123-4766-99d1-411d8ff27e9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:50:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-79476bab-0596-45ad-874d-669dd3986197 tempest-CinderUnicodeTest-1565738034 None] Flow 'volume_create_manager' (18252422-c8d7-4ece-a971-b84fe176d434) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:50:03 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8171442e-2eec-4a45-8617-57e5f4211cc6 tempest-TestStampPattern-1052481563 None] Lock "cinder-quobyte-22de57c3-3178-42ec-a08b-9ee7793a2890" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:50:03 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-8171442e-2eec-4a45-8617-57e5f4211cc6 tempest-TestStampPattern-1052481563 None] snapshot: e85c4487-5a3b-4664-a99a-21cbe97e94f8, volume: 22de57c3-3178-42ec-a08b-9ee7793a2890,  {{(pid=87230) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 09 14:50:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8171442e-2eec-4a45-8617-57e5f4211cc6 tempest-TestStampPattern-1052481563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:50:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8171442e-2eec-4a45-8617-57e5f4211cc6 tempest-TestStampPattern-1052481563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:50:03 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-8171442e-2eec-4a45-8617-57e5f4211cc6 tempest-TestStampPattern-1052481563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:50:03 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-8171442e-2eec-4a45-8617-57e5f4211cc6 tempest-TestStampPattern-1052481563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:50:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8171442e-2eec-4a45-8617-57e5f4211cc6 tempest-TestStampPattern-1052481563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:50:03 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-79476bab-0596-45ad-874d-669dd3986197 tempest-CinderUnicodeTest-1565738034 None] Created volume successfully.
Jul 09 14:50:03 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[af89bb7b-e07d-43d3-8a9a-4a86131c6228]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:50:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8171442e-2eec-4a45-8617-57e5f4211cc6 tempest-TestStampPattern-1052481563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1e99cbc0-ed4d-4afc-98e9-f3d7fc32b506.e85c4487-5a3b-4664-a99a-21cbe97e94f8 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:50:04 devstack sudo[104907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1e99cbc0-ed4d-4afc-98e9-f3d7fc32b506.e85c4487-5a3b-4664-a99a-21cbe97e94f8
Jul 09 14:50:04 devstack sudo[104907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:50:04 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c7ceb86-f5fc-4bc8-b775-31329fc29280 tempest-CinderUnicodeTest-1565738034 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:50:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0c7ceb86-f5fc-4bc8-b775-31329fc29280 tempest-CinderUnicodeTest-1565738034 None] Flow 'volume_create_manager' (d70f9ae2-61b8-4b0c-b0be-37b93fdc2f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:50:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0c7ceb86-f5fc-4bc8-b775-31329fc29280 tempest-CinderUnicodeTest-1565738034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11fee3d3-9979-416f-a1a4-4b9690b00829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:50:04 devstack sudo[104907]: pam_unix(sudo:session): session closed for user root
Jul 09 14:50:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8171442e-2eec-4a45-8617-57e5f4211cc6 tempest-TestStampPattern-1052481563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1e99cbc0-ed4d-4afc-98e9-f3d7fc32b506.e85c4487-5a3b-4664-a99a-21cbe97e94f8" returned: 0 in 0.888s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:50:04 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-8171442e-2eec-4a45-8617-57e5f4211cc6 tempest-TestStampPattern-1052481563 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e99cbc0-ed4d-4afc-98e9-f3d7fc32b506(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 14:50:04 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-8171442e-2eec-4a45-8617-57e5f4211cc6 tempest-TestStampPattern-1052481563 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1e99cbc0-ed4d-4afc-98e9-f3d7fc32b506 {{(pid=87230) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 09 14:50:04 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-8171442e-2eec-4a45-8617-57e5f4211cc6 tempest-TestStampPattern-1052481563 None] Creating direct copy from snapshot {{(pid=87230) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 09 14:50:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0c7ceb86-f5fc-4bc8-b775-31329fc29280 tempest-CinderUnicodeTest-1565738034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11fee3d3-9979-416f-a1a4-4b9690b00829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:50:04Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1927652336',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75e2798f-f3c7-498d-af97-b6923f18e247,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2259130c12845f48c9c4f0ad2377415',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:50:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:50:05Z,use_quota=True,user_id='105ac68036af4cc8ab9935856d21cc92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:50:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0c7ceb86-f5fc-4bc8-b775-31329fc29280 tempest-CinderUnicodeTest-1565738034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee54bb31-abd9-47f2-a051-4d9ea137574f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:50:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0c7ceb86-f5fc-4bc8-b775-31329fc29280 tempest-CinderUnicodeTest-1565738034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee54bb31-abd9-47f2-a051-4d9ea137574f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:50:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0c7ceb86-f5fc-4bc8-b775-31329fc29280 tempest-CinderUnicodeTest-1565738034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fc8efff-55e0-4465-98f3-c2efe8cbb88d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:50:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0c7ceb86-f5fc-4bc8-b775-31329fc29280 tempest-CinderUnicodeTest-1565738034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fc8efff-55e0-4465-98f3-c2efe8cbb88d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75e2798f-f3c7-498d-af97-b6923f18e247', 'volume_name': 'volume-75e2798f-f3c7-498d-af97-b6923f18e247', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:50:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0c7ceb86-f5fc-4bc8-b775-31329fc29280 tempest-CinderUnicodeTest-1565738034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af81481a-d6fc-4988-a6c5-b437cce5c1fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:50:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0c7ceb86-f5fc-4bc8-b775-31329fc29280 tempest-CinderUnicodeTest-1565738034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af81481a-d6fc-4988-a6c5-b437cce5c1fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:50:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0c7ceb86-f5fc-4bc8-b775-31329fc29280 tempest-CinderUnicodeTest-1565738034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcde1584-0135-4eb8-9430-1b19e5d70ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:50:04 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-0c7ceb86-f5fc-4bc8-b775-31329fc29280 tempest-CinderUnicodeTest-1565738034 None] Volume 75e2798f-f3c7-498d-af97-b6923f18e247: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75e2798f-f3c7-498d-af97-b6923f18e247', 'volume_size': 1}
Jul 09 14:50:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0c7ceb86-f5fc-4bc8-b775-31329fc29280 tempest-CinderUnicodeTest-1565738034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:50:04 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab682ea4-3cf0-4486-9f6b-8c672a722e3e]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:50:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8171442e-2eec-4a45-8617-57e5f4211cc6 tempest-TestStampPattern-1052481563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1e99cbc0-ed4d-4afc-98e9-f3d7fc32b506 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:50:05 devstack sudo[104916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1e99cbc0-ed4d-4afc-98e9-f3d7fc32b506
Jul 09 14:50:05 devstack sudo[104916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:50:05 devstack sudo[104916]: pam_unix(sudo:session): session closed for user root
Jul 09 14:50:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8171442e-2eec-4a45-8617-57e5f4211cc6 tempest-TestStampPattern-1052481563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1e99cbc0-ed4d-4afc-98e9-f3d7fc32b506" returned: 0 in 0.746s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:50:05 devstack cinder-volume[87230]: DEBUG cinder.utils [None req-8171442e-2eec-4a45-8617-57e5f4211cc6 tempest-TestStampPattern-1052481563 None] Path /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-22de57c3-3178-42ec-a08b-9ee7793a2890 not found in is_blk_device check {{(pid=87230) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 09 14:50:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8171442e-2eec-4a45-8617-57e5f4211cc6 tempest-TestStampPattern-1052481563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1e99cbc0-ed4d-4afc-98e9-f3d7fc32b506 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-22de57c3-3178-42ec-a08b-9ee7793a2890 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:50:05 devstack sudo[104921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1e99cbc0-ed4d-4afc-98e9-f3d7fc32b506 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-22de57c3-3178-42ec-a08b-9ee7793a2890
Jul 09 14:50:05 devstack sudo[104921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:50:10 devstack sudo[104921]: pam_unix(sudo:session): session closed for user root
Jul 09 14:50:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8171442e-2eec-4a45-8617-57e5f4211cc6 tempest-TestStampPattern-1052481563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1e99cbc0-ed4d-4afc-98e9-f3d7fc32b506 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-22de57c3-3178-42ec-a08b-9ee7793a2890" returned: 0 in 4.969s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:50:10 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7534257-f976-4701-81cb-bbecb65543a6]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:50:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8171442e-2eec-4a45-8617-57e5f4211cc6 tempest-TestStampPattern-1052481563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1e99cbc0-ed4d-4afc-98e9-f3d7fc32b506 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:50:10 devstack sudo[104935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1e99cbc0-ed4d-4afc-98e9-f3d7fc32b506
Jul 09 14:50:10 devstack sudo[104935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:50:11 devstack sudo[104935]: pam_unix(sudo:session): session closed for user root
Jul 09 14:50:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8171442e-2eec-4a45-8617-57e5f4211cc6 tempest-TestStampPattern-1052481563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1e99cbc0-ed4d-4afc-98e9-f3d7fc32b506" returned: 0 in 1.112s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:50:11 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-8171442e-2eec-4a45-8617-57e5f4211cc6 tempest-TestStampPattern-1052481563 None] Image conversion details: src /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1e99cbc0-ed4d-4afc-98e9-f3d7fc32b506, size 1024.00 MB, duration 4.97 sec, destination /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-22de57c3-3178-42ec-a08b-9ee7793a2890 {{(pid=87230) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 09 14:50:11 devstack cinder-volume[87230]: INFO cinder.image.image_utils [None req-8171442e-2eec-4a45-8617-57e5f4211cc6 tempest-TestStampPattern-1052481563 None] Converted 1024.00 MB image at 205.99 MB/s
Jul 09 14:50:11 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-8171442e-2eec-4a45-8617-57e5f4211cc6 tempest-TestStampPattern-1052481563 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-22de57c3-3178-42ec-a08b-9ee7793a2890 is being set with open permissions: ugo+rw
Jul 09 14:50:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8171442e-2eec-4a45-8617-57e5f4211cc6 tempest-TestStampPattern-1052481563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-22de57c3-3178-42ec-a08b-9ee7793a2890 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:50:11 devstack sudo[104943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-22de57c3-3178-42ec-a08b-9ee7793a2890
Jul 09 14:50:11 devstack sudo[104943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:50:12 devstack sudo[104943]: pam_unix(sudo:session): session closed for user root
Jul 09 14:50:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8171442e-2eec-4a45-8617-57e5f4211cc6 tempest-TestStampPattern-1052481563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-22de57c3-3178-42ec-a08b-9ee7793a2890" returned: 0 in 0.755s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:50:12 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8171442e-2eec-4a45-8617-57e5f4211cc6 tempest-TestStampPattern-1052481563 None] Lock "cinder-quobyte-22de57c3-3178-42ec-a08b-9ee7793a2890" released by "_copy_volume_from_snapshot" :: held 8.650s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:50:12 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8171442e-2eec-4a45-8617-57e5f4211cc6 tempest-TestStampPattern-1052481563 None] Lock "cinder-quobyte-e85c4487-5a3b-4664-a99a-21cbe97e94f8-22de57c3-3178-42ec-a08b-9ee7793a2890" released by "_create_volume_from_snapshot" :: held 8.700s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:50:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8171442e-2eec-4a45-8617-57e5f4211cc6 tempest-TestStampPattern-1052481563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.735s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:50:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0c7ceb86-f5fc-4bc8-b775-31329fc29280 tempest-CinderUnicodeTest-1565738034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.638s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:50:12 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-0c7ceb86-f5fc-4bc8-b775-31329fc29280 tempest-CinderUnicodeTest-1565738034 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:50:04Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1927652336',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75e2798f-f3c7-498d-af97-b6923f18e247,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2259130c12845f48c9c4f0ad2377415',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:50:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:50:05Z,use_quota=True,user_id='105ac68036af4cc8ab9935856d21cc92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:50:12 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-0c7ceb86-f5fc-4bc8-b775-31329fc29280 tempest-CinderUnicodeTest-1565738034 None] Creating volume 75e2798f-f3c7-498d-af97-b6923f18e247 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:50:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0c7ceb86-f5fc-4bc8-b775-31329fc29280 tempest-CinderUnicodeTest-1565738034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:50:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0c7ceb86-f5fc-4bc8-b775-31329fc29280 tempest-CinderUnicodeTest-1565738034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:50:12 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-0c7ceb86-f5fc-4bc8-b775-31329fc29280 tempest-CinderUnicodeTest-1565738034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:50:12 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-0c7ceb86-f5fc-4bc8-b775-31329fc29280 tempest-CinderUnicodeTest-1565738034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:50:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0c7ceb86-f5fc-4bc8-b775-31329fc29280 tempest-CinderUnicodeTest-1565738034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:50:12 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-0c7ceb86-f5fc-4bc8-b775-31329fc29280 tempest-CinderUnicodeTest-1565738034 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:50:12 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-0c7ceb86-f5fc-4bc8-b775-31329fc29280 tempest-CinderUnicodeTest-1565738034 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:50:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0c7ceb86-f5fc-4bc8-b775-31329fc29280 tempest-CinderUnicodeTest-1565738034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-75e2798f-f3c7-498d-af97-b6923f18e247 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:50:12 devstack sudo[104952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-75e2798f-f3c7-498d-af97-b6923f18e247 1073741824
Jul 09 14:50:12 devstack sudo[104952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:50:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8171442e-2eec-4a45-8617-57e5f4211cc6 tempest-TestStampPattern-1052481563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20d0cb66-5681-4c2c-8aa6-4164e6ebb40f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22de57c3-3178-42ec-a08b-9ee7793a2890', 'volume_size': 1, 'snapshot_id': 'e85c4487-5a3b-4664-a99a-21cbe97e94f8'}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:50:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8171442e-2eec-4a45-8617-57e5f4211cc6 tempest-TestStampPattern-1052481563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0b31256-4299-4bc8-a235-ebaaa2df1ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:50:12 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-8171442e-2eec-4a45-8617-57e5f4211cc6 tempest-TestStampPattern-1052481563 None] Volume volume-22de57c3-3178-42ec-a08b-9ee7793a2890 (22de57c3-3178-42ec-a08b-9ee7793a2890): created successfully
Jul 09 14:50:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8171442e-2eec-4a45-8617-57e5f4211cc6 tempest-TestStampPattern-1052481563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0b31256-4299-4bc8-a235-ebaaa2df1ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:50:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8171442e-2eec-4a45-8617-57e5f4211cc6 tempest-TestStampPattern-1052481563 None] Flow 'volume_create_manager' (f24f0409-e65f-46e1-812a-60d19c3cf9b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:50:12 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-8171442e-2eec-4a45-8617-57e5f4211cc6 tempest-TestStampPattern-1052481563 None] Created volume successfully.
Jul 09 14:50:13 devstack sudo[104952]: pam_unix(sudo:session): session closed for user root
Jul 09 14:50:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0c7ceb86-f5fc-4bc8-b775-31329fc29280 tempest-CinderUnicodeTest-1565738034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-75e2798f-f3c7-498d-af97-b6923f18e247 1073741824" returned: 0 in 0.913s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:50:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0c7ceb86-f5fc-4bc8-b775-31329fc29280 tempest-CinderUnicodeTest-1565738034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-75e2798f-f3c7-498d-af97-b6923f18e247 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:50:13 devstack sudo[104977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-75e2798f-f3c7-498d-af97-b6923f18e247
Jul 09 14:50:13 devstack sudo[104977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:50:14 devstack sudo[104977]: pam_unix(sudo:session): session closed for user root
Jul 09 14:50:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0c7ceb86-f5fc-4bc8-b775-31329fc29280 tempest-CinderUnicodeTest-1565738034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-75e2798f-f3c7-498d-af97-b6923f18e247" returned: 0 in 0.662s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:50:14 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-0c7ceb86-f5fc-4bc8-b775-31329fc29280 tempest-CinderUnicodeTest-1565738034 None] <== create_volume: return (1625ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:50:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0c7ceb86-f5fc-4bc8-b775-31329fc29280 tempest-CinderUnicodeTest-1565738034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.630s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:50:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0c7ceb86-f5fc-4bc8-b775-31329fc29280 tempest-CinderUnicodeTest-1565738034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcde1584-0135-4eb8-9430-1b19e5d70ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75e2798f-f3c7-498d-af97-b6923f18e247', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:50:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0c7ceb86-f5fc-4bc8-b775-31329fc29280 tempest-CinderUnicodeTest-1565738034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dda1ca3b-441b-4d07-b9f7-2cd849183355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:50:14 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-0c7ceb86-f5fc-4bc8-b775-31329fc29280 tempest-CinderUnicodeTest-1565738034 None] Volume volume-75e2798f-f3c7-498d-af97-b6923f18e247 (75e2798f-f3c7-498d-af97-b6923f18e247): created successfully
Jul 09 14:50:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0c7ceb86-f5fc-4bc8-b775-31329fc29280 tempest-CinderUnicodeTest-1565738034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dda1ca3b-441b-4d07-b9f7-2cd849183355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:50:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0c7ceb86-f5fc-4bc8-b775-31329fc29280 tempest-CinderUnicodeTest-1565738034 None] Flow 'volume_create_manager' (d70f9ae2-61b8-4b0c-b0be-37b93fdc2f74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:50:14 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-0c7ceb86-f5fc-4bc8-b775-31329fc29280 tempest-CinderUnicodeTest-1565738034 None] Created volume successfully.
Jul 09 14:50:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-21d2a529-79b0-41fd-86ca-a59209536ccb tempest-CinderUnicodeTest-1565738034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:50:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-21d2a529-79b0-41fd-86ca-a59209536ccb tempest-CinderUnicodeTest-1565738034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:50:14 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-21d2a529-79b0-41fd-86ca-a59209536ccb tempest-CinderUnicodeTest-1565738034 None] Creating offline snapshot 372464bf-5d54-4e0c-8bb5-2743b9400725 of volume 75e2798f-f3c7-498d-af97-b6923f18e247 {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 14:50:14 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c8c928e-f0f2-4d9f-a55a-6db137bf690f]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:50:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-21d2a529-79b0-41fd-86ca-a59209536ccb tempest-CinderUnicodeTest-1565738034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-75e2798f-f3c7-498d-af97-b6923f18e247 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:50:14 devstack sudo[104980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-75e2798f-f3c7-498d-af97-b6923f18e247
Jul 09 14:50:14 devstack sudo[104980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:50:15 devstack sudo[104980]: pam_unix(sudo:session): session closed for user root
Jul 09 14:50:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-21d2a529-79b0-41fd-86ca-a59209536ccb tempest-CinderUnicodeTest-1565738034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-75e2798f-f3c7-498d-af97-b6923f18e247" returned: 0 in 0.904s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:50:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-21d2a529-79b0-41fd-86ca-a59209536ccb tempest-CinderUnicodeTest-1565738034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-75e2798f-f3c7-498d-af97-b6923f18e247,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-75e2798f-f3c7-498d-af97-b6923f18e247.372464bf-5d54-4e0c-8bb5-2743b9400725 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:50:15 devstack sudo[105005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-75e2798f-f3c7-498d-af97-b6923f18e247,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-75e2798f-f3c7-498d-af97-b6923f18e247.372464bf-5d54-4e0c-8bb5-2743b9400725 1G
Jul 09 14:50:15 devstack sudo[105005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:50:16 devstack sudo[105005]: pam_unix(sudo:session): session closed for user root
Jul 09 14:50:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-21d2a529-79b0-41fd-86ca-a59209536ccb tempest-CinderUnicodeTest-1565738034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-75e2798f-f3c7-498d-af97-b6923f18e247,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-75e2798f-f3c7-498d-af97-b6923f18e247.372464bf-5d54-4e0c-8bb5-2743b9400725 1G" returned: 0 in 0.812s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:50:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-21d2a529-79b0-41fd-86ca-a59209536ccb tempest-CinderUnicodeTest-1565738034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75e2798f-f3c7-498d-af97-b6923f18e247 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-75e2798f-f3c7-498d-af97-b6923f18e247.372464bf-5d54-4e0c-8bb5-2743b9400725 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:50:16 devstack sudo[105011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75e2798f-f3c7-498d-af97-b6923f18e247 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-75e2798f-f3c7-498d-af97-b6923f18e247.372464bf-5d54-4e0c-8bb5-2743b9400725
Jul 09 14:50:16 devstack sudo[105011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:50:17 devstack sudo[105011]: pam_unix(sudo:session): session closed for user root
Jul 09 14:50:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-21d2a529-79b0-41fd-86ca-a59209536ccb tempest-CinderUnicodeTest-1565738034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75e2798f-f3c7-498d-af97-b6923f18e247 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-75e2798f-f3c7-498d-af97-b6923f18e247.372464bf-5d54-4e0c-8bb5-2743b9400725" returned: 0 in 0.719s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:50:17 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-21d2a529-79b0-41fd-86ca-a59209536ccb tempest-CinderUnicodeTest-1565738034 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-75e2798f-f3c7-498d-af97-b6923f18e247.372464bf-5d54-4e0c-8bb5-2743b9400725 is being set with open permissions: ugo+rw
Jul 09 14:50:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-21d2a529-79b0-41fd-86ca-a59209536ccb tempest-CinderUnicodeTest-1565738034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-75e2798f-f3c7-498d-af97-b6923f18e247.372464bf-5d54-4e0c-8bb5-2743b9400725 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:50:17 devstack sudo[105036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-75e2798f-f3c7-498d-af97-b6923f18e247.372464bf-5d54-4e0c-8bb5-2743b9400725
Jul 09 14:50:17 devstack sudo[105036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:50:17 devstack sudo[105036]: pam_unix(sudo:session): session closed for user root
Jul 09 14:50:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-21d2a529-79b0-41fd-86ca-a59209536ccb tempest-CinderUnicodeTest-1565738034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-75e2798f-f3c7-498d-af97-b6923f18e247.372464bf-5d54-4e0c-8bb5-2743b9400725" returned: 0 in 0.645s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:50:17 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:UPDATE=75,cinder:SELECT=70,cinder:INSERT=19,cinder:DELETE=6 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 14:50:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-21d2a529-79b0-41fd-86ca-a59209536ccb tempest-CinderUnicodeTest-1565738034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-75e2798f-f3c7-498d-af97-b6923f18e247.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:50:17 devstack sudo[105041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-75e2798f-f3c7-498d-af97-b6923f18e247.info
Jul 09 14:50:17 devstack sudo[105041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:50:18 devstack sudo[105041]: pam_unix(sudo:session): session closed for user root
Jul 09 14:50:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-21d2a529-79b0-41fd-86ca-a59209536ccb tempest-CinderUnicodeTest-1565738034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-75e2798f-f3c7-498d-af97-b6923f18e247.info" returned: 0 in 0.739s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:50:18 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-21d2a529-79b0-41fd-86ca-a59209536ccb tempest-CinderUnicodeTest-1565738034 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-75e2798f-f3c7-498d-af97-b6923f18e247.info is being set with open permissions: ugo+rw
Jul 09 14:50:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-21d2a529-79b0-41fd-86ca-a59209536ccb tempest-CinderUnicodeTest-1565738034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-75e2798f-f3c7-498d-af97-b6923f18e247.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:50:18 devstack sudo[105044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-75e2798f-f3c7-498d-af97-b6923f18e247.info
Jul 09 14:50:18 devstack sudo[105044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:50:19 devstack sudo[105044]: pam_unix(sudo:session): session closed for user root
Jul 09 14:50:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-21d2a529-79b0-41fd-86ca-a59209536ccb tempest-CinderUnicodeTest-1565738034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-75e2798f-f3c7-498d-af97-b6923f18e247.info" returned: 0 in 0.671s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:50:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-21d2a529-79b0-41fd-86ca-a59209536ccb tempest-CinderUnicodeTest-1565738034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.595s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:50:19 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=66,cinder:INSERT=25,cinder:UPDATE=86,cinder:DELETE=10 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 14:50:19 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-21d2a529-79b0-41fd-86ca-a59209536ccb tempest-CinderUnicodeTest-1565738034 None] Create snapshot completed successfully
Jul 09 14:50:20 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b70c7219-441b-4892-9eb2-13f2ad7a4ca9 tempest-CinderUnicodeTest-1565738034 None] Acquiring lock "cinder-372464bf-5d54-4e0c-8bb5-2743b9400725-delete_snapshot" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:50:20 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b70c7219-441b-4892-9eb2-13f2ad7a4ca9 tempest-CinderUnicodeTest-1565738034 None] Lock "cinder-372464bf-5d54-4e0c-8bb5-2743b9400725-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:50:20 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b70c7219-441b-4892-9eb2-13f2ad7a4ca9 tempest-CinderUnicodeTest-1565738034 None] Acquiring lock "cinder-quobyte-75e2798f-f3c7-498d-af97-b6923f18e247" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:50:20 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b70c7219-441b-4892-9eb2-13f2ad7a4ca9 tempest-CinderUnicodeTest-1565738034 None] Lock "cinder-quobyte-75e2798f-f3c7-498d-af97-b6923f18e247" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:50:20 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b70c7219-441b-4892-9eb2-13f2ad7a4ca9 tempest-CinderUnicodeTest-1565738034 None] Acquiring lock "cinder-quobyte-372464bf-5d54-4e0c-8bb5-2743b9400725" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:50:20 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b70c7219-441b-4892-9eb2-13f2ad7a4ca9 tempest-CinderUnicodeTest-1565738034 None] Lock "cinder-quobyte-372464bf-5d54-4e0c-8bb5-2743b9400725" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:50:20 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-b70c7219-441b-4892-9eb2-13f2ad7a4ca9 tempest-CinderUnicodeTest-1565738034 None] Deleting offline snapshot 372464bf-5d54-4e0c-8bb5-2743b9400725 of volume 75e2798f-f3c7-498d-af97-b6923f18e247 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 14:50:20 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-b70c7219-441b-4892-9eb2-13f2ad7a4ca9 tempest-CinderUnicodeTest-1565738034 None] snapshot_file for this snap is: volume-75e2798f-f3c7-498d-af97-b6923f18e247.372464bf-5d54-4e0c-8bb5-2743b9400725 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 14:50:20 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e4bcf6-254f-47fd-af09-e435e5fadd47]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:50:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b70c7219-441b-4892-9eb2-13f2ad7a4ca9 tempest-CinderUnicodeTest-1565738034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-75e2798f-f3c7-498d-af97-b6923f18e247.372464bf-5d54-4e0c-8bb5-2743b9400725 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:50:20 devstack sudo[105048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-75e2798f-f3c7-498d-af97-b6923f18e247.372464bf-5d54-4e0c-8bb5-2743b9400725
Jul 09 14:50:20 devstack sudo[105048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:50:21 devstack sudo[105048]: pam_unix(sudo:session): session closed for user root
Jul 09 14:50:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b70c7219-441b-4892-9eb2-13f2ad7a4ca9 tempest-CinderUnicodeTest-1565738034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-75e2798f-f3c7-498d-af97-b6923f18e247.372464bf-5d54-4e0c-8bb5-2743b9400725" returned: 0 in 0.811s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:50:21 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-b70c7219-441b-4892-9eb2-13f2ad7a4ca9 tempest-CinderUnicodeTest-1565738034 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75e2798f-f3c7-498d-af97-b6923f18e247(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 14:50:21 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c7fe284-2ab8-4c43-9588-913db4e711f0]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:50:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b70c7219-441b-4892-9eb2-13f2ad7a4ca9 tempest-CinderUnicodeTest-1565738034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-75e2798f-f3c7-498d-af97-b6923f18e247 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:50:21 devstack sudo[105054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-75e2798f-f3c7-498d-af97-b6923f18e247
Jul 09 14:50:21 devstack sudo[105054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:50:21 devstack sudo[105054]: pam_unix(sudo:session): session closed for user root
Jul 09 14:50:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b70c7219-441b-4892-9eb2-13f2ad7a4ca9 tempest-CinderUnicodeTest-1565738034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-75e2798f-f3c7-498d-af97-b6923f18e247" returned: 0 in 0.806s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:50:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b70c7219-441b-4892-9eb2-13f2ad7a4ca9 tempest-CinderUnicodeTest-1565738034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-75e2798f-f3c7-498d-af97-b6923f18e247.372464bf-5d54-4e0c-8bb5-2743b9400725 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:50:21 devstack sudo[105061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-75e2798f-f3c7-498d-af97-b6923f18e247.372464bf-5d54-4e0c-8bb5-2743b9400725
Jul 09 14:50:21 devstack sudo[105061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:50:22 devstack sudo[105061]: pam_unix(sudo:session): session closed for user root
Jul 09 14:50:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b70c7219-441b-4892-9eb2-13f2ad7a4ca9 tempest-CinderUnicodeTest-1565738034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-75e2798f-f3c7-498d-af97-b6923f18e247.372464bf-5d54-4e0c-8bb5-2743b9400725" returned: 0 in 0.814s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:50:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b70c7219-441b-4892-9eb2-13f2ad7a4ca9 tempest-CinderUnicodeTest-1565738034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-75e2798f-f3c7-498d-af97-b6923f18e247.372464bf-5d54-4e0c-8bb5-2743b9400725 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:50:22 devstack sudo[105068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-75e2798f-f3c7-498d-af97-b6923f18e247.372464bf-5d54-4e0c-8bb5-2743b9400725
Jul 09 14:50:22 devstack sudo[105068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:50:23 devstack sudo[105068]: pam_unix(sudo:session): session closed for user root
Jul 09 14:50:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b70c7219-441b-4892-9eb2-13f2ad7a4ca9 tempest-CinderUnicodeTest-1565738034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-75e2798f-f3c7-498d-af97-b6923f18e247.372464bf-5d54-4e0c-8bb5-2743b9400725" returned: 0 in 0.677s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:50:23 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b70c7219-441b-4892-9eb2-13f2ad7a4ca9 tempest-CinderUnicodeTest-1565738034 None] Lock "cinder-quobyte-372464bf-5d54-4e0c-8bb5-2743b9400725" released by "_delete_snapshot" :: held 3.262s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:50:23 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b70c7219-441b-4892-9eb2-13f2ad7a4ca9 tempest-CinderUnicodeTest-1565738034 None] Lock "cinder-quobyte-75e2798f-f3c7-498d-af97-b6923f18e247" released by "delete_snapshot" :: held 3.288s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:50:23 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-b70c7219-441b-4892-9eb2-13f2ad7a4ca9 tempest-CinderUnicodeTest-1565738034 None] Created reservations ['afe9dba0-f1eb-421a-af0c-31459f418f0b', '205037df-a6b1-4974-b442-2b47b58b02fa', 'b5c6bd38-f41a-4e4a-8dec-4f63995e27b3', 'ef5b2e64-010d-421e-8a67-7be7c30a5e06'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:50:23 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-b70c7219-441b-4892-9eb2-13f2ad7a4ca9 tempest-CinderUnicodeTest-1565738034 None] Delete snapshot completed successfully.
Jul 09 14:50:23 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b70c7219-441b-4892-9eb2-13f2ad7a4ca9 tempest-CinderUnicodeTest-1565738034 None] Lock "cinder-372464bf-5d54-4e0c-8bb5-2743b9400725-delete_snapshot" released by "delete_snapshot" :: held 3.473s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:50:24 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3a0e6ef4-e94a-47e0-903c-976a6492ce4f tempest-CinderUnicodeTest-1565738034 None] Acquiring lock "cinder-75e2798f-f3c7-498d-af97-b6923f18e247-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:50:24 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3a0e6ef4-e94a-47e0-903c-976a6492ce4f tempest-CinderUnicodeTest-1565738034 None] Lock "cinder-75e2798f-f3c7-498d-af97-b6923f18e247-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:50:24 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3a0e6ef4-e94a-47e0-903c-976a6492ce4f tempest-CinderUnicodeTest-1565738034 None] Acquiring lock "cinder-quobyte-75e2798f-f3c7-498d-af97-b6923f18e247" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:50:24 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3a0e6ef4-e94a-47e0-903c-976a6492ce4f tempest-CinderUnicodeTest-1565738034 None] Lock "cinder-quobyte-75e2798f-f3c7-498d-af97-b6923f18e247" acquired by "delete_volume" :: waited 0.016s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:50:24 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[a636bda4-848e-43f7-9ab9-c94c23d647d8]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:50:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3a0e6ef4-e94a-47e0-903c-976a6492ce4f tempest-CinderUnicodeTest-1565738034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-75e2798f-f3c7-498d-af97-b6923f18e247 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:50:24 devstack sudo[105071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-75e2798f-f3c7-498d-af97-b6923f18e247
Jul 09 14:50:24 devstack sudo[105071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:50:25 devstack sudo[105071]: pam_unix(sudo:session): session closed for user root
Jul 09 14:50:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3a0e6ef4-e94a-47e0-903c-976a6492ce4f tempest-CinderUnicodeTest-1565738034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-75e2798f-f3c7-498d-af97-b6923f18e247" returned: 0 in 0.826s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:50:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3a0e6ef4-e94a-47e0-903c-976a6492ce4f tempest-CinderUnicodeTest-1565738034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-75e2798f-f3c7-498d-af97-b6923f18e247 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:50:25 devstack sudo[105076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-75e2798f-f3c7-498d-af97-b6923f18e247
Jul 09 14:50:25 devstack sudo[105076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:50:25 devstack sudo[105076]: pam_unix(sudo:session): session closed for user root
Jul 09 14:50:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3a0e6ef4-e94a-47e0-903c-976a6492ce4f tempest-CinderUnicodeTest-1565738034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-75e2798f-f3c7-498d-af97-b6923f18e247" returned: 0 in 0.683s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:50:26 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3a0e6ef4-e94a-47e0-903c-976a6492ce4f tempest-CinderUnicodeTest-1565738034 None] Lock "cinder-quobyte-75e2798f-f3c7-498d-af97-b6923f18e247" released by "delete_volume" :: held 1.580s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:50:26 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-3a0e6ef4-e94a-47e0-903c-976a6492ce4f tempest-CinderUnicodeTest-1565738034 None] Created reservations ['65bf5852-db00-4921-9997-c6b6cc943222', '81ed6df1-eabe-4b6d-ac61-17055b9f34f4', '99bed093-75a3-483d-a794-321b89f8e6ce', '9ed2e262-c83a-44f7-a78d-6c997b17129b'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:50:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3a0e6ef4-e94a-47e0-903c-976a6492ce4f tempest-CinderUnicodeTest-1565738034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:50:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3a0e6ef4-e94a-47e0-903c-976a6492ce4f tempest-CinderUnicodeTest-1565738034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:50:26 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3a0e6ef4-e94a-47e0-903c-976a6492ce4f tempest-CinderUnicodeTest-1565738034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:50:26 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3a0e6ef4-e94a-47e0-903c-976a6492ce4f tempest-CinderUnicodeTest-1565738034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:50:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3a0e6ef4-e94a-47e0-903c-976a6492ce4f tempest-CinderUnicodeTest-1565738034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:50:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3a0e6ef4-e94a-47e0-903c-976a6492ce4f tempest-CinderUnicodeTest-1565738034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:50:26 devstack sudo[105079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:50:26 devstack sudo[105079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:50:26 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-ce916986-4bc8-4a78-858a-7991bb4128a6 tempest-CinderUnicodeTest-1565738034 None] Acquiring lock "cinder-f7ee3e02-32b7-4687-a5e0-394d1209b691-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:50:26 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-ce916986-4bc8-4a78-858a-7991bb4128a6 tempest-CinderUnicodeTest-1565738034 None] Lock "cinder-f7ee3e02-32b7-4687-a5e0-394d1209b691-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:50:26 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-ce916986-4bc8-4a78-858a-7991bb4128a6 tempest-CinderUnicodeTest-1565738034 None] Acquiring lock "cinder-quobyte-f7ee3e02-32b7-4687-a5e0-394d1209b691" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:50:26 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-ce916986-4bc8-4a78-858a-7991bb4128a6 tempest-CinderUnicodeTest-1565738034 None] Lock "cinder-quobyte-f7ee3e02-32b7-4687-a5e0-394d1209b691" acquired by "delete_volume" :: waited 0.020s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:50:26 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[6612f3b4-8c8d-4978-bdd7-b8f57307eceb]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:50:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ce916986-4bc8-4a78-858a-7991bb4128a6 tempest-CinderUnicodeTest-1565738034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-f7ee3e02-32b7-4687-a5e0-394d1209b691 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:50:26 devstack sudo[105081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-f7ee3e02-32b7-4687-a5e0-394d1209b691
Jul 09 14:50:26 devstack sudo[105081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:50:26 devstack sudo[105079]: pam_unix(sudo:session): session closed for user root
Jul 09 14:50:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3a0e6ef4-e94a-47e0-903c-976a6492ce4f tempest-CinderUnicodeTest-1565738034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.717s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:50:26 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-3a0e6ef4-e94a-47e0-903c-976a6492ce4f tempest-CinderUnicodeTest-1565738034 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:50:26 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-3a0e6ef4-e94a-47e0-903c-976a6492ce4f tempest-CinderUnicodeTest-1565738034 None] Deleted volume successfully.
Jul 09 14:50:26 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3a0e6ef4-e94a-47e0-903c-976a6492ce4f tempest-CinderUnicodeTest-1565738034 None] Lock "cinder-75e2798f-f3c7-498d-af97-b6923f18e247-delete_volume" released by "delete_volume" :: held 2.580s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:50:27 devstack sudo[105081]: pam_unix(sudo:session): session closed for user root
Jul 09 14:50:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ce916986-4bc8-4a78-858a-7991bb4128a6 tempest-CinderUnicodeTest-1565738034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-f7ee3e02-32b7-4687-a5e0-394d1209b691" returned: 0 in 0.817s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:50:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ce916986-4bc8-4a78-858a-7991bb4128a6 tempest-CinderUnicodeTest-1565738034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-f7ee3e02-32b7-4687-a5e0-394d1209b691 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:50:27 devstack sudo[105087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-f7ee3e02-32b7-4687-a5e0-394d1209b691
Jul 09 14:50:27 devstack sudo[105087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:50:28 devstack sudo[105087]: pam_unix(sudo:session): session closed for user root
Jul 09 14:50:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ce916986-4bc8-4a78-858a-7991bb4128a6 tempest-CinderUnicodeTest-1565738034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-f7ee3e02-32b7-4687-a5e0-394d1209b691" returned: 0 in 0.685s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:50:28 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-ce916986-4bc8-4a78-858a-7991bb4128a6 tempest-CinderUnicodeTest-1565738034 None] Lock "cinder-quobyte-f7ee3e02-32b7-4687-a5e0-394d1209b691" released by "delete_volume" :: held 1.553s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:50:28 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-ce916986-4bc8-4a78-858a-7991bb4128a6 tempest-CinderUnicodeTest-1565738034 None] Created reservations ['c8c47f19-a6f1-4ae8-9d3b-861435312931', '5a6fd042-e5d5-46a0-9e56-a390af57536b', '7d53edd4-072c-4e71-a1d3-d1c3524369c2', '5a03fe01-e4fc-48b5-82a8-fccdbe944b28'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:50:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-ce916986-4bc8-4a78-858a-7991bb4128a6 tempest-CinderUnicodeTest-1565738034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:50:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-ce916986-4bc8-4a78-858a-7991bb4128a6 tempest-CinderUnicodeTest-1565738034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:50:28 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-ce916986-4bc8-4a78-858a-7991bb4128a6 tempest-CinderUnicodeTest-1565738034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:50:28 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-ce916986-4bc8-4a78-858a-7991bb4128a6 tempest-CinderUnicodeTest-1565738034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:50:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-ce916986-4bc8-4a78-858a-7991bb4128a6 tempest-CinderUnicodeTest-1565738034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:50:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ce916986-4bc8-4a78-858a-7991bb4128a6 tempest-CinderUnicodeTest-1565738034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:50:28 devstack sudo[105090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:50:28 devstack sudo[105090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:50:29 devstack sudo[105090]: pam_unix(sudo:session): session closed for user root
Jul 09 14:50:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ce916986-4bc8-4a78-858a-7991bb4128a6 tempest-CinderUnicodeTest-1565738034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.689s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:50:29 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-ce916986-4bc8-4a78-858a-7991bb4128a6 tempest-CinderUnicodeTest-1565738034 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:50:29 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-ce916986-4bc8-4a78-858a-7991bb4128a6 tempest-CinderUnicodeTest-1565738034 None] Deleted volume successfully.
Jul 09 14:50:29 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-ce916986-4bc8-4a78-858a-7991bb4128a6 tempest-CinderUnicodeTest-1565738034 None] Lock "cinder-f7ee3e02-32b7-4687-a5e0-394d1209b691-delete_volume" released by "delete_volume" :: held 2.499s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:50:32 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-3759e0bf-1e0e-4af7-ad0a-0a3689df3783 tempest-ProjectReaderTests-1385150104 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:50:32 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3759e0bf-1e0e-4af7-ad0a-0a3689df3783 tempest-ProjectReaderTests-1385150104 None] Flow 'volume_create_manager' (476993e2-da92-4dfc-9090-d89a2b5ead57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:50:32 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3759e0bf-1e0e-4af7-ad0a-0a3689df3783 tempest-ProjectReaderTests-1385150104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (179565e1-75f0-4336-97e6-019c889fa2c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:50:32 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3759e0bf-1e0e-4af7-ad0a-0a3689df3783 tempest-ProjectReaderTests-1385150104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (179565e1-75f0-4336-97e6-019c889fa2c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:50:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1138798956',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2b8910c-27e6-4cc4-adf8-a7fa3bf97abd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='433491ec947b462cb19882f654960980',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:50:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:50:32Z,use_quota=True,user_id='f30717af46654193b7e73296de12b350',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:50:32 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3759e0bf-1e0e-4af7-ad0a-0a3689df3783 tempest-ProjectReaderTests-1385150104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0a8f031-1305-487c-ad6a-1d414e9bbf1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:50:32 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3759e0bf-1e0e-4af7-ad0a-0a3689df3783 tempest-ProjectReaderTests-1385150104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0a8f031-1305-487c-ad6a-1d414e9bbf1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:50:32 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3759e0bf-1e0e-4af7-ad0a-0a3689df3783 tempest-ProjectReaderTests-1385150104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (035eb959-681d-49df-80f3-793e852ae21f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:50:32 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3759e0bf-1e0e-4af7-ad0a-0a3689df3783 tempest-ProjectReaderTests-1385150104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (035eb959-681d-49df-80f3-793e852ae21f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2b8910c-27e6-4cc4-adf8-a7fa3bf97abd', 'volume_name': 'volume-c2b8910c-27e6-4cc4-adf8-a7fa3bf97abd', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:50:32 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3759e0bf-1e0e-4af7-ad0a-0a3689df3783 tempest-ProjectReaderTests-1385150104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ced2daea-0b21-469f-8b13-807a6bd51d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:50:32 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3759e0bf-1e0e-4af7-ad0a-0a3689df3783 tempest-ProjectReaderTests-1385150104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ced2daea-0b21-469f-8b13-807a6bd51d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:50:32 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3759e0bf-1e0e-4af7-ad0a-0a3689df3783 tempest-ProjectReaderTests-1385150104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10035591-ad6b-483e-bb5f-15f48cad2824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:50:32 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-3759e0bf-1e0e-4af7-ad0a-0a3689df3783 tempest-ProjectReaderTests-1385150104 None] Volume c2b8910c-27e6-4cc4-adf8-a7fa3bf97abd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2b8910c-27e6-4cc4-adf8-a7fa3bf97abd', 'volume_size': 1}
Jul 09 14:50:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3759e0bf-1e0e-4af7-ad0a-0a3689df3783 tempest-ProjectReaderTests-1385150104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:50:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3759e0bf-1e0e-4af7-ad0a-0a3689df3783 tempest-ProjectReaderTests-1385150104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:50:32 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3759e0bf-1e0e-4af7-ad0a-0a3689df3783 tempest-ProjectReaderTests-1385150104 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:50:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1138798956',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2b8910c-27e6-4cc4-adf8-a7fa3bf97abd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='433491ec947b462cb19882f654960980',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:50:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:50:32Z,use_quota=True,user_id='f30717af46654193b7e73296de12b350',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:50:32 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-3759e0bf-1e0e-4af7-ad0a-0a3689df3783 tempest-ProjectReaderTests-1385150104 None] Creating volume c2b8910c-27e6-4cc4-adf8-a7fa3bf97abd {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:50:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3759e0bf-1e0e-4af7-ad0a-0a3689df3783 tempest-ProjectReaderTests-1385150104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:50:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3759e0bf-1e0e-4af7-ad0a-0a3689df3783 tempest-ProjectReaderTests-1385150104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:50:32 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3759e0bf-1e0e-4af7-ad0a-0a3689df3783 tempest-ProjectReaderTests-1385150104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:50:32 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3759e0bf-1e0e-4af7-ad0a-0a3689df3783 tempest-ProjectReaderTests-1385150104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:50:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3759e0bf-1e0e-4af7-ad0a-0a3689df3783 tempest-ProjectReaderTests-1385150104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:50:32 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3759e0bf-1e0e-4af7-ad0a-0a3689df3783 tempest-ProjectReaderTests-1385150104 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:50:32 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-3759e0bf-1e0e-4af7-ad0a-0a3689df3783 tempest-ProjectReaderTests-1385150104 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:50:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3759e0bf-1e0e-4af7-ad0a-0a3689df3783 tempest-ProjectReaderTests-1385150104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-c2b8910c-27e6-4cc4-adf8-a7fa3bf97abd 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:50:32 devstack sudo[105103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-c2b8910c-27e6-4cc4-adf8-a7fa3bf97abd 1073741824
Jul 09 14:50:32 devstack sudo[105103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:50:33 devstack sudo[105103]: pam_unix(sudo:session): session closed for user root
Jul 09 14:50:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3759e0bf-1e0e-4af7-ad0a-0a3689df3783 tempest-ProjectReaderTests-1385150104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-c2b8910c-27e6-4cc4-adf8-a7fa3bf97abd 1073741824" returned: 0 in 0.820s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:50:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3759e0bf-1e0e-4af7-ad0a-0a3689df3783 tempest-ProjectReaderTests-1385150104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-c2b8910c-27e6-4cc4-adf8-a7fa3bf97abd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:50:33 devstack sudo[105109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-c2b8910c-27e6-4cc4-adf8-a7fa3bf97abd
Jul 09 14:50:33 devstack sudo[105109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:50:33 devstack sudo[105109]: pam_unix(sudo:session): session closed for user root
Jul 09 14:50:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3759e0bf-1e0e-4af7-ad0a-0a3689df3783 tempest-ProjectReaderTests-1385150104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-c2b8910c-27e6-4cc4-adf8-a7fa3bf97abd" returned: 0 in 0.663s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:50:33 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3759e0bf-1e0e-4af7-ad0a-0a3689df3783 tempest-ProjectReaderTests-1385150104 None] <== create_volume: return (1526ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:50:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3759e0bf-1e0e-4af7-ad0a-0a3689df3783 tempest-ProjectReaderTests-1385150104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.529s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:50:33 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3759e0bf-1e0e-4af7-ad0a-0a3689df3783 tempest-ProjectReaderTests-1385150104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10035591-ad6b-483e-bb5f-15f48cad2824) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2b8910c-27e6-4cc4-adf8-a7fa3bf97abd', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:50:33 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3759e0bf-1e0e-4af7-ad0a-0a3689df3783 tempest-ProjectReaderTests-1385150104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46d4445f-1b33-4467-a981-f9c5e10880aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:50:33 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-3759e0bf-1e0e-4af7-ad0a-0a3689df3783 tempest-ProjectReaderTests-1385150104 None] Volume volume-c2b8910c-27e6-4cc4-adf8-a7fa3bf97abd (c2b8910c-27e6-4cc4-adf8-a7fa3bf97abd): created successfully
Jul 09 14:50:33 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3759e0bf-1e0e-4af7-ad0a-0a3689df3783 tempest-ProjectReaderTests-1385150104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46d4445f-1b33-4467-a981-f9c5e10880aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:50:33 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3759e0bf-1e0e-4af7-ad0a-0a3689df3783 tempest-ProjectReaderTests-1385150104 None] Flow 'volume_create_manager' (476993e2-da92-4dfc-9090-d89a2b5ead57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:50:33 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-3759e0bf-1e0e-4af7-ad0a-0a3689df3783 tempest-ProjectReaderTests-1385150104 None] Created volume successfully.
Jul 09 14:50:34 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-20dfdaf0-a6d7-4c9c-91ea-b7b8bf5b9020 tempest-ProjectReaderTests-1385150104 None] Acquiring lock "cinder-c2b8910c-27e6-4cc4-adf8-a7fa3bf97abd-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:50:34 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-20dfdaf0-a6d7-4c9c-91ea-b7b8bf5b9020 tempest-ProjectReaderTests-1385150104 None] Lock "cinder-c2b8910c-27e6-4cc4-adf8-a7fa3bf97abd-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:50:34 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-20dfdaf0-a6d7-4c9c-91ea-b7b8bf5b9020 tempest-ProjectReaderTests-1385150104 None] Acquiring lock "cinder-quobyte-c2b8910c-27e6-4cc4-adf8-a7fa3bf97abd" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:50:34 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-20dfdaf0-a6d7-4c9c-91ea-b7b8bf5b9020 tempest-ProjectReaderTests-1385150104 None] Lock "cinder-quobyte-c2b8910c-27e6-4cc4-adf8-a7fa3bf97abd" acquired by "delete_volume" :: waited 0.014s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:50:34 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[719b768e-79c4-4f72-8c70-9e4c612bc5b6]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:50:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-20dfdaf0-a6d7-4c9c-91ea-b7b8bf5b9020 tempest-ProjectReaderTests-1385150104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-c2b8910c-27e6-4cc4-adf8-a7fa3bf97abd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:50:34 devstack sudo[105112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-c2b8910c-27e6-4cc4-adf8-a7fa3bf97abd
Jul 09 14:50:34 devstack sudo[105112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:50:35 devstack sudo[105112]: pam_unix(sudo:session): session closed for user root
Jul 09 14:50:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-20dfdaf0-a6d7-4c9c-91ea-b7b8bf5b9020 tempest-ProjectReaderTests-1385150104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-c2b8910c-27e6-4cc4-adf8-a7fa3bf97abd" returned: 0 in 0.777s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:50:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-20dfdaf0-a6d7-4c9c-91ea-b7b8bf5b9020 tempest-ProjectReaderTests-1385150104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-c2b8910c-27e6-4cc4-adf8-a7fa3bf97abd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:50:35 devstack sudo[105117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-c2b8910c-27e6-4cc4-adf8-a7fa3bf97abd
Jul 09 14:50:35 devstack sudo[105117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:50:35 devstack sudo[105117]: pam_unix(sudo:session): session closed for user root
Jul 09 14:50:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-20dfdaf0-a6d7-4c9c-91ea-b7b8bf5b9020 tempest-ProjectReaderTests-1385150104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-c2b8910c-27e6-4cc4-adf8-a7fa3bf97abd" returned: 0 in 0.643s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:50:36 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-20dfdaf0-a6d7-4c9c-91ea-b7b8bf5b9020 tempest-ProjectReaderTests-1385150104 None] Lock "cinder-quobyte-c2b8910c-27e6-4cc4-adf8-a7fa3bf97abd" released by "delete_volume" :: held 1.459s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:50:36 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-20dfdaf0-a6d7-4c9c-91ea-b7b8bf5b9020 tempest-ProjectReaderTests-1385150104 None] Created reservations ['b5bfb6a9-7f43-4022-a708-0b9f71b9fe64', 'e9a7b5ac-7b91-4d26-9d43-5a50ba5e0f0e', '98a63040-14c3-443b-8c9b-da87eafd2ace', '6f3462bd-c4c6-46d4-82fe-fa88ae278e12'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:50:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-20dfdaf0-a6d7-4c9c-91ea-b7b8bf5b9020 tempest-ProjectReaderTests-1385150104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:50:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-20dfdaf0-a6d7-4c9c-91ea-b7b8bf5b9020 tempest-ProjectReaderTests-1385150104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:50:36 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-20dfdaf0-a6d7-4c9c-91ea-b7b8bf5b9020 tempest-ProjectReaderTests-1385150104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:50:36 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-20dfdaf0-a6d7-4c9c-91ea-b7b8bf5b9020 tempest-ProjectReaderTests-1385150104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:50:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-20dfdaf0-a6d7-4c9c-91ea-b7b8bf5b9020 tempest-ProjectReaderTests-1385150104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:50:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-20dfdaf0-a6d7-4c9c-91ea-b7b8bf5b9020 tempest-ProjectReaderTests-1385150104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:50:36 devstack sudo[105120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:50:36 devstack sudo[105120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:50:36 devstack sudo[105120]: pam_unix(sudo:session): session closed for user root
Jul 09 14:50:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-20dfdaf0-a6d7-4c9c-91ea-b7b8bf5b9020 tempest-ProjectReaderTests-1385150104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.669s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:50:36 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-20dfdaf0-a6d7-4c9c-91ea-b7b8bf5b9020 tempest-ProjectReaderTests-1385150104 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:50:36 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-20dfdaf0-a6d7-4c9c-91ea-b7b8bf5b9020 tempest-ProjectReaderTests-1385150104 None] Deleted volume successfully.
Jul 09 14:50:36 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-20dfdaf0-a6d7-4c9c-91ea-b7b8bf5b9020 tempest-ProjectReaderTests-1385150104 None] Lock "cinder-c2b8910c-27e6-4cc4-adf8-a7fa3bf97abd-delete_volume" released by "delete_volume" :: held 2.343s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:50:37 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-50b76d9f-e22d-40a1-8dff-0cb05862c60c tempest-ProjectReaderTests-1385150104 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:50:37 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-50b76d9f-e22d-40a1-8dff-0cb05862c60c tempest-ProjectReaderTests-1385150104 None] Flow 'volume_create_manager' (89202c81-5b06-4cfd-9481-fff6876538e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:50:37 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-50b76d9f-e22d-40a1-8dff-0cb05862c60c tempest-ProjectReaderTests-1385150104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73bbb00e-e058-4f05-af19-93ed46a456b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:50:37 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-50b76d9f-e22d-40a1-8dff-0cb05862c60c tempest-ProjectReaderTests-1385150104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73bbb00e-e058-4f05-af19-93ed46a456b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:50:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-642866033',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=905fdfe6-9693-4bd6-b601-d87d8eddd9d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='433491ec947b462cb19882f654960980',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:50:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:50:37Z,use_quota=True,user_id='f30717af46654193b7e73296de12b350',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:50:37 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-50b76d9f-e22d-40a1-8dff-0cb05862c60c tempest-ProjectReaderTests-1385150104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71825d9d-dff0-4f07-a14c-b7a4eae4ca48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:50:37 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-50b76d9f-e22d-40a1-8dff-0cb05862c60c tempest-ProjectReaderTests-1385150104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71825d9d-dff0-4f07-a14c-b7a4eae4ca48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:50:37 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-50b76d9f-e22d-40a1-8dff-0cb05862c60c tempest-ProjectReaderTests-1385150104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97939aab-3bf0-4189-b283-dfe39a1b7b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:50:37 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-50b76d9f-e22d-40a1-8dff-0cb05862c60c tempest-ProjectReaderTests-1385150104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97939aab-3bf0-4189-b283-dfe39a1b7b96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '905fdfe6-9693-4bd6-b601-d87d8eddd9d9', 'volume_name': 'volume-905fdfe6-9693-4bd6-b601-d87d8eddd9d9', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:50:37 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-50b76d9f-e22d-40a1-8dff-0cb05862c60c tempest-ProjectReaderTests-1385150104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9c1c08b-eb84-4489-b201-b050e594d4f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:50:37 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-50b76d9f-e22d-40a1-8dff-0cb05862c60c tempest-ProjectReaderTests-1385150104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9c1c08b-eb84-4489-b201-b050e594d4f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:50:37 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-50b76d9f-e22d-40a1-8dff-0cb05862c60c tempest-ProjectReaderTests-1385150104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (683d22e7-83ed-4aeb-9513-7a5f9dbc6fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:50:37 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-50b76d9f-e22d-40a1-8dff-0cb05862c60c tempest-ProjectReaderTests-1385150104 None] Volume 905fdfe6-9693-4bd6-b601-d87d8eddd9d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-905fdfe6-9693-4bd6-b601-d87d8eddd9d9', 'volume_size': 1}
Jul 09 14:50:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-50b76d9f-e22d-40a1-8dff-0cb05862c60c tempest-ProjectReaderTests-1385150104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:50:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-50b76d9f-e22d-40a1-8dff-0cb05862c60c tempest-ProjectReaderTests-1385150104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:50:37 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-50b76d9f-e22d-40a1-8dff-0cb05862c60c tempest-ProjectReaderTests-1385150104 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:50:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-642866033',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=905fdfe6-9693-4bd6-b601-d87d8eddd9d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='433491ec947b462cb19882f654960980',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:50:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:50:37Z,use_quota=True,user_id='f30717af46654193b7e73296de12b350',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:50:37 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-50b76d9f-e22d-40a1-8dff-0cb05862c60c tempest-ProjectReaderTests-1385150104 None] Creating volume 905fdfe6-9693-4bd6-b601-d87d8eddd9d9 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:50:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-50b76d9f-e22d-40a1-8dff-0cb05862c60c tempest-ProjectReaderTests-1385150104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:50:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-50b76d9f-e22d-40a1-8dff-0cb05862c60c tempest-ProjectReaderTests-1385150104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:50:37 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-50b76d9f-e22d-40a1-8dff-0cb05862c60c tempest-ProjectReaderTests-1385150104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:50:37 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-50b76d9f-e22d-40a1-8dff-0cb05862c60c tempest-ProjectReaderTests-1385150104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:50:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-50b76d9f-e22d-40a1-8dff-0cb05862c60c tempest-ProjectReaderTests-1385150104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:50:37 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-50b76d9f-e22d-40a1-8dff-0cb05862c60c tempest-ProjectReaderTests-1385150104 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:50:37 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-50b76d9f-e22d-40a1-8dff-0cb05862c60c tempest-ProjectReaderTests-1385150104 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:50:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-50b76d9f-e22d-40a1-8dff-0cb05862c60c tempest-ProjectReaderTests-1385150104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-905fdfe6-9693-4bd6-b601-d87d8eddd9d9 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:50:37 devstack sudo[105123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-905fdfe6-9693-4bd6-b601-d87d8eddd9d9 1073741824
Jul 09 14:50:37 devstack sudo[105123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:50:38 devstack sudo[105123]: pam_unix(sudo:session): session closed for user root
Jul 09 14:50:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-50b76d9f-e22d-40a1-8dff-0cb05862c60c tempest-ProjectReaderTests-1385150104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-905fdfe6-9693-4bd6-b601-d87d8eddd9d9 1073741824" returned: 0 in 0.811s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:50:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-50b76d9f-e22d-40a1-8dff-0cb05862c60c tempest-ProjectReaderTests-1385150104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-905fdfe6-9693-4bd6-b601-d87d8eddd9d9 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:50:38 devstack sudo[105129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-905fdfe6-9693-4bd6-b601-d87d8eddd9d9
Jul 09 14:50:38 devstack sudo[105129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:50:38 devstack sudo[105129]: pam_unix(sudo:session): session closed for user root
Jul 09 14:50:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-50b76d9f-e22d-40a1-8dff-0cb05862c60c tempest-ProjectReaderTests-1385150104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-905fdfe6-9693-4bd6-b601-d87d8eddd9d9" returned: 0 in 0.656s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:50:38 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-50b76d9f-e22d-40a1-8dff-0cb05862c60c tempest-ProjectReaderTests-1385150104 None] <== create_volume: return (1508ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:50:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-50b76d9f-e22d-40a1-8dff-0cb05862c60c tempest-ProjectReaderTests-1385150104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.511s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:50:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-50b76d9f-e22d-40a1-8dff-0cb05862c60c tempest-ProjectReaderTests-1385150104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (683d22e7-83ed-4aeb-9513-7a5f9dbc6fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-905fdfe6-9693-4bd6-b601-d87d8eddd9d9', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:50:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-50b76d9f-e22d-40a1-8dff-0cb05862c60c tempest-ProjectReaderTests-1385150104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d74a3905-700b-4151-ad21-25f019d54871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:50:38 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-50b76d9f-e22d-40a1-8dff-0cb05862c60c tempest-ProjectReaderTests-1385150104 None] Volume volume-905fdfe6-9693-4bd6-b601-d87d8eddd9d9 (905fdfe6-9693-4bd6-b601-d87d8eddd9d9): created successfully
Jul 09 14:50:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-50b76d9f-e22d-40a1-8dff-0cb05862c60c tempest-ProjectReaderTests-1385150104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d74a3905-700b-4151-ad21-25f019d54871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:50:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-50b76d9f-e22d-40a1-8dff-0cb05862c60c tempest-ProjectReaderTests-1385150104 None] Flow 'volume_create_manager' (89202c81-5b06-4cfd-9481-fff6876538e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:50:38 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-50b76d9f-e22d-40a1-8dff-0cb05862c60c tempest-ProjectReaderTests-1385150104 None] Created volume successfully.
Jul 09 14:50:39 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-216c66a6-b5c5-4019-bc01-83de195fa530 tempest-ProjectReaderTests-1385150104 None] Acquiring lock "cinder-905fdfe6-9693-4bd6-b601-d87d8eddd9d9-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:50:39 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-216c66a6-b5c5-4019-bc01-83de195fa530 tempest-ProjectReaderTests-1385150104 None] Lock "cinder-905fdfe6-9693-4bd6-b601-d87d8eddd9d9-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:50:39 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-216c66a6-b5c5-4019-bc01-83de195fa530 tempest-ProjectReaderTests-1385150104 None] Acquiring lock "cinder-quobyte-905fdfe6-9693-4bd6-b601-d87d8eddd9d9" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:50:39 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-216c66a6-b5c5-4019-bc01-83de195fa530 tempest-ProjectReaderTests-1385150104 None] Lock "cinder-quobyte-905fdfe6-9693-4bd6-b601-d87d8eddd9d9" acquired by "delete_volume" :: waited 0.013s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:50:39 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[333a41a7-9261-4a73-a498-e899e87d4f19]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:50:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-216c66a6-b5c5-4019-bc01-83de195fa530 tempest-ProjectReaderTests-1385150104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-905fdfe6-9693-4bd6-b601-d87d8eddd9d9 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:50:39 devstack sudo[105132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-905fdfe6-9693-4bd6-b601-d87d8eddd9d9
Jul 09 14:50:39 devstack sudo[105132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:50:40 devstack sudo[105132]: pam_unix(sudo:session): session closed for user root
Jul 09 14:50:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-216c66a6-b5c5-4019-bc01-83de195fa530 tempest-ProjectReaderTests-1385150104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-905fdfe6-9693-4bd6-b601-d87d8eddd9d9" returned: 0 in 0.751s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:50:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-216c66a6-b5c5-4019-bc01-83de195fa530 tempest-ProjectReaderTests-1385150104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-905fdfe6-9693-4bd6-b601-d87d8eddd9d9 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:50:40 devstack sudo[105137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-905fdfe6-9693-4bd6-b601-d87d8eddd9d9
Jul 09 14:50:40 devstack sudo[105137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:50:40 devstack sudo[105137]: pam_unix(sudo:session): session closed for user root
Jul 09 14:50:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-216c66a6-b5c5-4019-bc01-83de195fa530 tempest-ProjectReaderTests-1385150104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-905fdfe6-9693-4bd6-b601-d87d8eddd9d9" returned: 0 in 0.651s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:50:40 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-216c66a6-b5c5-4019-bc01-83de195fa530 tempest-ProjectReaderTests-1385150104 None] Lock "cinder-quobyte-905fdfe6-9693-4bd6-b601-d87d8eddd9d9" released by "delete_volume" :: held 1.439s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:50:40 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-216c66a6-b5c5-4019-bc01-83de195fa530 tempest-ProjectReaderTests-1385150104 None] Created reservations ['9af0e4fe-75e1-4fb9-8661-79cc91c22c68', 'ffab157e-7c72-4663-809c-0d3f1c1e8f6a', '23b68e54-7922-42de-ad71-b8fac070a943', '7e8dfc3c-c987-49c0-a227-f9d74941e435'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:50:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-216c66a6-b5c5-4019-bc01-83de195fa530 tempest-ProjectReaderTests-1385150104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:50:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-216c66a6-b5c5-4019-bc01-83de195fa530 tempest-ProjectReaderTests-1385150104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:50:40 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-216c66a6-b5c5-4019-bc01-83de195fa530 tempest-ProjectReaderTests-1385150104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:50:40 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-216c66a6-b5c5-4019-bc01-83de195fa530 tempest-ProjectReaderTests-1385150104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:50:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-216c66a6-b5c5-4019-bc01-83de195fa530 tempest-ProjectReaderTests-1385150104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:50:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-216c66a6-b5c5-4019-bc01-83de195fa530 tempest-ProjectReaderTests-1385150104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:50:40 devstack sudo[105141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:50:40 devstack sudo[105141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:50:41 devstack sudo[105141]: pam_unix(sudo:session): session closed for user root
Jul 09 14:50:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-216c66a6-b5c5-4019-bc01-83de195fa530 tempest-ProjectReaderTests-1385150104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.687s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:50:41 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-216c66a6-b5c5-4019-bc01-83de195fa530 tempest-ProjectReaderTests-1385150104 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:50:41 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-216c66a6-b5c5-4019-bc01-83de195fa530 tempest-ProjectReaderTests-1385150104 None] Deleted volume successfully.
Jul 09 14:50:41 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-216c66a6-b5c5-4019-bc01-83de195fa530 tempest-ProjectReaderTests-1385150104 None] Lock "cinder-905fdfe6-9693-4bd6-b601-d87d8eddd9d9-delete_volume" released by "delete_volume" :: held 2.333s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:50:41 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-d77f0591-975f-4c82-90d3-48bb7f3e2295 tempest-ProjectReaderTests-1385150104 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:50:42 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d77f0591-975f-4c82-90d3-48bb7f3e2295 tempest-ProjectReaderTests-1385150104 None] Flow 'volume_create_manager' (445749c8-b321-4f6b-b32a-4dc85ebf9e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:50:42 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d77f0591-975f-4c82-90d3-48bb7f3e2295 tempest-ProjectReaderTests-1385150104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7414e920-5e5e-4bb7-b2cf-0ce656780a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:50:42 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d77f0591-975f-4c82-90d3-48bb7f3e2295 tempest-ProjectReaderTests-1385150104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7414e920-5e5e-4bb7-b2cf-0ce656780a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:50:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2130364613',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5954b84-6f60-4275-82cd-6440e494dfda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='433491ec947b462cb19882f654960980',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:50:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:50:42Z,use_quota=True,user_id='f30717af46654193b7e73296de12b350',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:50:42 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d77f0591-975f-4c82-90d3-48bb7f3e2295 tempest-ProjectReaderTests-1385150104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (366c14ba-6063-4e77-9291-e15e2b0a12ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:50:42 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d77f0591-975f-4c82-90d3-48bb7f3e2295 tempest-ProjectReaderTests-1385150104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (366c14ba-6063-4e77-9291-e15e2b0a12ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:50:42 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d77f0591-975f-4c82-90d3-48bb7f3e2295 tempest-ProjectReaderTests-1385150104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6da95111-23e2-4ff0-9e7d-333c3a5bb589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:50:42 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d77f0591-975f-4c82-90d3-48bb7f3e2295 tempest-ProjectReaderTests-1385150104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6da95111-23e2-4ff0-9e7d-333c3a5bb589) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5954b84-6f60-4275-82cd-6440e494dfda', 'volume_name': 'volume-c5954b84-6f60-4275-82cd-6440e494dfda', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:50:42 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d77f0591-975f-4c82-90d3-48bb7f3e2295 tempest-ProjectReaderTests-1385150104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (397d340f-72b5-4a33-aa22-26944db6af04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:50:42 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d77f0591-975f-4c82-90d3-48bb7f3e2295 tempest-ProjectReaderTests-1385150104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (397d340f-72b5-4a33-aa22-26944db6af04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:50:42 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d77f0591-975f-4c82-90d3-48bb7f3e2295 tempest-ProjectReaderTests-1385150104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (296c57d3-9dc9-4acc-8f6f-9238fe982238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:50:42 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-d77f0591-975f-4c82-90d3-48bb7f3e2295 tempest-ProjectReaderTests-1385150104 None] Volume c5954b84-6f60-4275-82cd-6440e494dfda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5954b84-6f60-4275-82cd-6440e494dfda', 'volume_size': 1}
Jul 09 14:50:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d77f0591-975f-4c82-90d3-48bb7f3e2295 tempest-ProjectReaderTests-1385150104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:50:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d77f0591-975f-4c82-90d3-48bb7f3e2295 tempest-ProjectReaderTests-1385150104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:50:42 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-d77f0591-975f-4c82-90d3-48bb7f3e2295 tempest-ProjectReaderTests-1385150104 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:50:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2130364613',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5954b84-6f60-4275-82cd-6440e494dfda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='433491ec947b462cb19882f654960980',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:50:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:50:42Z,use_quota=True,user_id='f30717af46654193b7e73296de12b350',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:50:42 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-d77f0591-975f-4c82-90d3-48bb7f3e2295 tempest-ProjectReaderTests-1385150104 None] Creating volume c5954b84-6f60-4275-82cd-6440e494dfda {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:50:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d77f0591-975f-4c82-90d3-48bb7f3e2295 tempest-ProjectReaderTests-1385150104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:50:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d77f0591-975f-4c82-90d3-48bb7f3e2295 tempest-ProjectReaderTests-1385150104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:50:42 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-d77f0591-975f-4c82-90d3-48bb7f3e2295 tempest-ProjectReaderTests-1385150104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:50:42 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-d77f0591-975f-4c82-90d3-48bb7f3e2295 tempest-ProjectReaderTests-1385150104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:50:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d77f0591-975f-4c82-90d3-48bb7f3e2295 tempest-ProjectReaderTests-1385150104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:50:42 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-d77f0591-975f-4c82-90d3-48bb7f3e2295 tempest-ProjectReaderTests-1385150104 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:50:42 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-d77f0591-975f-4c82-90d3-48bb7f3e2295 tempest-ProjectReaderTests-1385150104 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:50:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d77f0591-975f-4c82-90d3-48bb7f3e2295 tempest-ProjectReaderTests-1385150104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-c5954b84-6f60-4275-82cd-6440e494dfda 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:50:42 devstack sudo[105144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-c5954b84-6f60-4275-82cd-6440e494dfda 1073741824
Jul 09 14:50:42 devstack sudo[105144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:50:42 devstack sudo[105144]: pam_unix(sudo:session): session closed for user root
Jul 09 14:50:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d77f0591-975f-4c82-90d3-48bb7f3e2295 tempest-ProjectReaderTests-1385150104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-c5954b84-6f60-4275-82cd-6440e494dfda 1073741824" returned: 0 in 0.836s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:50:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d77f0591-975f-4c82-90d3-48bb7f3e2295 tempest-ProjectReaderTests-1385150104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-c5954b84-6f60-4275-82cd-6440e494dfda {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:50:42 devstack sudo[105149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-c5954b84-6f60-4275-82cd-6440e494dfda
Jul 09 14:50:42 devstack sudo[105149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:50:43 devstack sudo[105149]: pam_unix(sudo:session): session closed for user root
Jul 09 14:50:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d77f0591-975f-4c82-90d3-48bb7f3e2295 tempest-ProjectReaderTests-1385150104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-c5954b84-6f60-4275-82cd-6440e494dfda" returned: 0 in 0.648s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:50:43 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-d77f0591-975f-4c82-90d3-48bb7f3e2295 tempest-ProjectReaderTests-1385150104 None] <== create_volume: return (1534ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:50:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d77f0591-975f-4c82-90d3-48bb7f3e2295 tempest-ProjectReaderTests-1385150104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.538s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:50:43 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d77f0591-975f-4c82-90d3-48bb7f3e2295 tempest-ProjectReaderTests-1385150104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (296c57d3-9dc9-4acc-8f6f-9238fe982238) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5954b84-6f60-4275-82cd-6440e494dfda', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:50:43 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d77f0591-975f-4c82-90d3-48bb7f3e2295 tempest-ProjectReaderTests-1385150104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff026369-dfb5-421d-b3e9-6ba79c1251fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:50:43 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-d77f0591-975f-4c82-90d3-48bb7f3e2295 tempest-ProjectReaderTests-1385150104 None] Volume volume-c5954b84-6f60-4275-82cd-6440e494dfda (c5954b84-6f60-4275-82cd-6440e494dfda): created successfully
Jul 09 14:50:43 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d77f0591-975f-4c82-90d3-48bb7f3e2295 tempest-ProjectReaderTests-1385150104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff026369-dfb5-421d-b3e9-6ba79c1251fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:50:43 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d77f0591-975f-4c82-90d3-48bb7f3e2295 tempest-ProjectReaderTests-1385150104 None] Flow 'volume_create_manager' (445749c8-b321-4f6b-b32a-4dc85ebf9e6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:50:43 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-d77f0591-975f-4c82-90d3-48bb7f3e2295 tempest-ProjectReaderTests-1385150104 None] Created volume successfully.
Jul 09 14:50:44 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c6d84278-979b-4260-a5e8-aa0b44d550a5 tempest-ProjectReaderTests-1385150104 None] Acquiring lock "cinder-c5954b84-6f60-4275-82cd-6440e494dfda-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:50:44 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c6d84278-979b-4260-a5e8-aa0b44d550a5 tempest-ProjectReaderTests-1385150104 None] Lock "cinder-c5954b84-6f60-4275-82cd-6440e494dfda-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:50:44 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c6d84278-979b-4260-a5e8-aa0b44d550a5 tempest-ProjectReaderTests-1385150104 None] Acquiring lock "cinder-quobyte-c5954b84-6f60-4275-82cd-6440e494dfda" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:50:44 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c6d84278-979b-4260-a5e8-aa0b44d550a5 tempest-ProjectReaderTests-1385150104 None] Lock "cinder-quobyte-c5954b84-6f60-4275-82cd-6440e494dfda" acquired by "delete_volume" :: waited 0.017s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:50:44 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d685aff-ac3e-496b-b2cc-b48ba62e126d]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:50:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c6d84278-979b-4260-a5e8-aa0b44d550a5 tempest-ProjectReaderTests-1385150104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-c5954b84-6f60-4275-82cd-6440e494dfda {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:50:44 devstack sudo[105152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-c5954b84-6f60-4275-82cd-6440e494dfda
Jul 09 14:50:44 devstack sudo[105152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:50:44 devstack sudo[105152]: pam_unix(sudo:session): session closed for user root
Jul 09 14:50:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c6d84278-979b-4260-a5e8-aa0b44d550a5 tempest-ProjectReaderTests-1385150104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-c5954b84-6f60-4275-82cd-6440e494dfda" returned: 0 in 0.770s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:50:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c6d84278-979b-4260-a5e8-aa0b44d550a5 tempest-ProjectReaderTests-1385150104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-c5954b84-6f60-4275-82cd-6440e494dfda {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:50:45 devstack sudo[105164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-c5954b84-6f60-4275-82cd-6440e494dfda
Jul 09 14:50:45 devstack sudo[105164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:50:45 devstack sudo[105164]: pam_unix(sudo:session): session closed for user root
Jul 09 14:50:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c6d84278-979b-4260-a5e8-aa0b44d550a5 tempest-ProjectReaderTests-1385150104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-c5954b84-6f60-4275-82cd-6440e494dfda" returned: 0 in 0.632s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:50:45 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c6d84278-979b-4260-a5e8-aa0b44d550a5 tempest-ProjectReaderTests-1385150104 None] Lock "cinder-quobyte-c5954b84-6f60-4275-82cd-6440e494dfda" released by "delete_volume" :: held 1.439s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:50:45 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-c6d84278-979b-4260-a5e8-aa0b44d550a5 tempest-ProjectReaderTests-1385150104 None] Created reservations ['83e36e5a-2a5a-4e1a-870e-5b9c7d6c20e6', '5472f305-7a5f-4da0-ac52-cf9ca5e7994f', 'af1e04da-248a-4b0b-8cb8-f9b92f14ab6d', 'ab0b417e-1b64-43bb-b8bc-3f9ee1173090'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:50:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c6d84278-979b-4260-a5e8-aa0b44d550a5 tempest-ProjectReaderTests-1385150104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:50:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c6d84278-979b-4260-a5e8-aa0b44d550a5 tempest-ProjectReaderTests-1385150104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:50:45 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-c6d84278-979b-4260-a5e8-aa0b44d550a5 tempest-ProjectReaderTests-1385150104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:50:45 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-c6d84278-979b-4260-a5e8-aa0b44d550a5 tempest-ProjectReaderTests-1385150104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:50:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c6d84278-979b-4260-a5e8-aa0b44d550a5 tempest-ProjectReaderTests-1385150104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:50:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c6d84278-979b-4260-a5e8-aa0b44d550a5 tempest-ProjectReaderTests-1385150104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:50:45 devstack sudo[105167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:50:45 devstack sudo[105167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:50:46 devstack sudo[105167]: pam_unix(sudo:session): session closed for user root
Jul 09 14:50:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c6d84278-979b-4260-a5e8-aa0b44d550a5 tempest-ProjectReaderTests-1385150104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.707s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:50:46 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-c6d84278-979b-4260-a5e8-aa0b44d550a5 tempest-ProjectReaderTests-1385150104 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:50:46 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-c6d84278-979b-4260-a5e8-aa0b44d550a5 tempest-ProjectReaderTests-1385150104 None] Deleted volume successfully.
Jul 09 14:50:46 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c6d84278-979b-4260-a5e8-aa0b44d550a5 tempest-ProjectReaderTests-1385150104 None] Lock "cinder-c5954b84-6f60-4275-82cd-6440e494dfda-delete_volume" released by "delete_volume" :: held 2.353s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:50:46 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4a6bc8b-1658-4163-a600-793f1f00ae2f tempest-ProjectReaderTests-1385150104 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:50:46 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a4a6bc8b-1658-4163-a600-793f1f00ae2f tempest-ProjectReaderTests-1385150104 None] Flow 'volume_create_manager' (27343bf3-6491-4b19-a2dd-43f27e2c6535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:50:46 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a4a6bc8b-1658-4163-a600-793f1f00ae2f tempest-ProjectReaderTests-1385150104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c930742-c2b4-484c-94f4-96443a98c841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:50:46 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a4a6bc8b-1658-4163-a600-793f1f00ae2f tempest-ProjectReaderTests-1385150104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c930742-c2b4-484c-94f4-96443a98c841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:50:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-924771419',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fec59211-e916-4d23-9ed9-69174d9b5c2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='433491ec947b462cb19882f654960980',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:50:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:50:47Z,use_quota=True,user_id='f30717af46654193b7e73296de12b350',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:50:46 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a4a6bc8b-1658-4163-a600-793f1f00ae2f tempest-ProjectReaderTests-1385150104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f268f9d6-58a2-4dde-8685-4d1a138bab9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:50:46 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a4a6bc8b-1658-4163-a600-793f1f00ae2f tempest-ProjectReaderTests-1385150104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f268f9d6-58a2-4dde-8685-4d1a138bab9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:50:46 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a4a6bc8b-1658-4163-a600-793f1f00ae2f tempest-ProjectReaderTests-1385150104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc2735df-65cc-46ff-8d43-1cf451ae8825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:50:46 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a4a6bc8b-1658-4163-a600-793f1f00ae2f tempest-ProjectReaderTests-1385150104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc2735df-65cc-46ff-8d43-1cf451ae8825) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fec59211-e916-4d23-9ed9-69174d9b5c2b', 'volume_name': 'volume-fec59211-e916-4d23-9ed9-69174d9b5c2b', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:50:46 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a4a6bc8b-1658-4163-a600-793f1f00ae2f tempest-ProjectReaderTests-1385150104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0b59e75-ed9b-480e-a30b-f14beb288cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:50:46 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a4a6bc8b-1658-4163-a600-793f1f00ae2f tempest-ProjectReaderTests-1385150104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0b59e75-ed9b-480e-a30b-f14beb288cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:50:46 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a4a6bc8b-1658-4163-a600-793f1f00ae2f tempest-ProjectReaderTests-1385150104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb225750-384b-4d65-ab3a-84b851f3bbb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:50:46 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-a4a6bc8b-1658-4163-a600-793f1f00ae2f tempest-ProjectReaderTests-1385150104 None] Volume fec59211-e916-4d23-9ed9-69174d9b5c2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fec59211-e916-4d23-9ed9-69174d9b5c2b', 'volume_size': 1}
Jul 09 14:50:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a4a6bc8b-1658-4163-a600-793f1f00ae2f tempest-ProjectReaderTests-1385150104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:50:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a4a6bc8b-1658-4163-a600-793f1f00ae2f tempest-ProjectReaderTests-1385150104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:50:46 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a4a6bc8b-1658-4163-a600-793f1f00ae2f tempest-ProjectReaderTests-1385150104 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:50:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-924771419',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fec59211-e916-4d23-9ed9-69174d9b5c2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='433491ec947b462cb19882f654960980',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:50:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:50:47Z,use_quota=True,user_id='f30717af46654193b7e73296de12b350',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:50:46 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-a4a6bc8b-1658-4163-a600-793f1f00ae2f tempest-ProjectReaderTests-1385150104 None] Creating volume fec59211-e916-4d23-9ed9-69174d9b5c2b {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:50:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a4a6bc8b-1658-4163-a600-793f1f00ae2f tempest-ProjectReaderTests-1385150104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:50:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a4a6bc8b-1658-4163-a600-793f1f00ae2f tempest-ProjectReaderTests-1385150104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:50:46 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a4a6bc8b-1658-4163-a600-793f1f00ae2f tempest-ProjectReaderTests-1385150104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:50:46 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a4a6bc8b-1658-4163-a600-793f1f00ae2f tempest-ProjectReaderTests-1385150104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:50:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a4a6bc8b-1658-4163-a600-793f1f00ae2f tempest-ProjectReaderTests-1385150104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:50:46 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a4a6bc8b-1658-4163-a600-793f1f00ae2f tempest-ProjectReaderTests-1385150104 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:50:46 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-a4a6bc8b-1658-4163-a600-793f1f00ae2f tempest-ProjectReaderTests-1385150104 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:50:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a4a6bc8b-1658-4163-a600-793f1f00ae2f tempest-ProjectReaderTests-1385150104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-fec59211-e916-4d23-9ed9-69174d9b5c2b 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:50:46 devstack sudo[105206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-fec59211-e916-4d23-9ed9-69174d9b5c2b 1073741824
Jul 09 14:50:46 devstack sudo[105206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:50:47 devstack sudo[105206]: pam_unix(sudo:session): session closed for user root
Jul 09 14:50:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a4a6bc8b-1658-4163-a600-793f1f00ae2f tempest-ProjectReaderTests-1385150104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-fec59211-e916-4d23-9ed9-69174d9b5c2b 1073741824" returned: 0 in 0.902s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:50:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a4a6bc8b-1658-4163-a600-793f1f00ae2f tempest-ProjectReaderTests-1385150104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-fec59211-e916-4d23-9ed9-69174d9b5c2b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:50:47 devstack sudo[105220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-fec59211-e916-4d23-9ed9-69174d9b5c2b
Jul 09 14:50:47 devstack sudo[105220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:50:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-50efedbd-c06a-4ebe-8528-42c7e6991c34 req-b30a617f-cdd2-41b4-a79a-882937a44525 tempest-TestStampPattern-1052481563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:50:48 devstack sudo[105220]: pam_unix(sudo:session): session closed for user root
Jul 09 14:50:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a4a6bc8b-1658-4163-a600-793f1f00ae2f tempest-ProjectReaderTests-1385150104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-fec59211-e916-4d23-9ed9-69174d9b5c2b" returned: 0 in 0.637s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:50:48 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a4a6bc8b-1658-4163-a600-793f1f00ae2f tempest-ProjectReaderTests-1385150104 None] <== create_volume: return (1586ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:50:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a4a6bc8b-1658-4163-a600-793f1f00ae2f tempest-ProjectReaderTests-1385150104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.589s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:50:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-50efedbd-c06a-4ebe-8528-42c7e6991c34 req-b30a617f-cdd2-41b4-a79a-882937a44525 tempest-TestStampPattern-1052481563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.604s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:50:48 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a4a6bc8b-1658-4163-a600-793f1f00ae2f tempest-ProjectReaderTests-1385150104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb225750-384b-4d65-ab3a-84b851f3bbb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fec59211-e916-4d23-9ed9-69174d9b5c2b', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:50:48 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a4a6bc8b-1658-4163-a600-793f1f00ae2f tempest-ProjectReaderTests-1385150104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b6f31d1-f82f-4cf8-a55b-73ce23343562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:50:48 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b8be07a-2e23-4196-a77a-6030ffb4565d]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:50:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-50efedbd-c06a-4ebe-8528-42c7e6991c34 req-b30a617f-cdd2-41b4-a79a-882937a44525 tempest-TestStampPattern-1052481563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-22de57c3-3178-42ec-a08b-9ee7793a2890 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:50:48 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-a4a6bc8b-1658-4163-a600-793f1f00ae2f tempest-ProjectReaderTests-1385150104 None] Volume volume-fec59211-e916-4d23-9ed9-69174d9b5c2b (fec59211-e916-4d23-9ed9-69174d9b5c2b): created successfully
Jul 09 14:50:48 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a4a6bc8b-1658-4163-a600-793f1f00ae2f tempest-ProjectReaderTests-1385150104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b6f31d1-f82f-4cf8-a55b-73ce23343562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:50:48 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a4a6bc8b-1658-4163-a600-793f1f00ae2f tempest-ProjectReaderTests-1385150104 None] Flow 'volume_create_manager' (27343bf3-6491-4b19-a2dd-43f27e2c6535) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:50:48 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-a4a6bc8b-1658-4163-a600-793f1f00ae2f tempest-ProjectReaderTests-1385150104 None] Created volume successfully.
Jul 09 14:50:48 devstack sudo[105223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-22de57c3-3178-42ec-a08b-9ee7793a2890
Jul 09 14:50:48 devstack sudo[105223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:50:48 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-ce791903-df02-4734-ba39-0965a9e07f29 tempest-ProjectReaderTests-1385150104 None] Acquiring lock "cinder-fec59211-e916-4d23-9ed9-69174d9b5c2b-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:50:48 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-ce791903-df02-4734-ba39-0965a9e07f29 tempest-ProjectReaderTests-1385150104 None] Lock "cinder-fec59211-e916-4d23-9ed9-69174d9b5c2b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:50:48 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-ce791903-df02-4734-ba39-0965a9e07f29 tempest-ProjectReaderTests-1385150104 None] Acquiring lock "cinder-quobyte-fec59211-e916-4d23-9ed9-69174d9b5c2b" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:50:49 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-ce791903-df02-4734-ba39-0965a9e07f29 tempest-ProjectReaderTests-1385150104 None] Lock "cinder-quobyte-fec59211-e916-4d23-9ed9-69174d9b5c2b" acquired by "delete_volume" :: waited 0.016s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:50:49 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e97af1-0975-455e-bde0-3d304db7ba08]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:50:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ce791903-df02-4734-ba39-0965a9e07f29 tempest-ProjectReaderTests-1385150104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-fec59211-e916-4d23-9ed9-69174d9b5c2b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:50:49 devstack sudo[105225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-fec59211-e916-4d23-9ed9-69174d9b5c2b
Jul 09 14:50:49 devstack sudo[105225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:50:49 devstack sudo[105223]: pam_unix(sudo:session): session closed for user root
Jul 09 14:50:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-50efedbd-c06a-4ebe-8528-42c7e6991c34 req-b30a617f-cdd2-41b4-a79a-882937a44525 tempest-TestStampPattern-1052481563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-22de57c3-3178-42ec-a08b-9ee7793a2890" returned: 0 in 0.752s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:50:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-50efedbd-c06a-4ebe-8528-42c7e6991c34 req-b30a617f-cdd2-41b4-a79a-882937a44525 tempest-TestStampPattern-1052481563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.780s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:50:49 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-50efedbd-c06a-4ebe-8528-42c7e6991c34 req-b30a617f-cdd2-41b4-a79a-882937a44525 tempest-TestStampPattern-1052481563 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653', 'name': 'volume-22de57c3-3178-42ec-a08b-9ee7793a2890', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '61db70cf-c03e-48cb-be52-a41e944030a5', 'enforce_multipath': True} {{(pid=87230) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 09 14:50:49 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-50efedbd-c06a-4ebe-8528-42c7e6991c34 req-b30a617f-cdd2-41b4-a79a-882937a44525 tempest-TestStampPattern-1052481563 None] attachment_update completed successfully.
Jul 09 14:50:49 devstack sudo[105225]: pam_unix(sudo:session): session closed for user root
Jul 09 14:50:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ce791903-df02-4734-ba39-0965a9e07f29 tempest-ProjectReaderTests-1385150104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-fec59211-e916-4d23-9ed9-69174d9b5c2b" returned: 0 in 0.756s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:50:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ce791903-df02-4734-ba39-0965a9e07f29 tempest-ProjectReaderTests-1385150104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-fec59211-e916-4d23-9ed9-69174d9b5c2b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:50:49 devstack sudo[105302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-fec59211-e916-4d23-9ed9-69174d9b5c2b
Jul 09 14:50:49 devstack sudo[105302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:50:50 devstack sudo[105302]: pam_unix(sudo:session): session closed for user root
Jul 09 14:50:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ce791903-df02-4734-ba39-0965a9e07f29 tempest-ProjectReaderTests-1385150104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-fec59211-e916-4d23-9ed9-69174d9b5c2b" returned: 0 in 0.699s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:50:50 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-ce791903-df02-4734-ba39-0965a9e07f29 tempest-ProjectReaderTests-1385150104 None] Lock "cinder-quobyte-fec59211-e916-4d23-9ed9-69174d9b5c2b" released by "delete_volume" :: held 1.493s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:50:50 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-ce791903-df02-4734-ba39-0965a9e07f29 tempest-ProjectReaderTests-1385150104 None] Created reservations ['fc79912a-4ed0-4d20-9b7b-78efcea5c2f1', '254edcdb-b51f-4070-bde3-f71a1c248122', 'a925eb51-b565-4dc2-a7a1-b4ff103ce5a5', 'dc528be5-3d8a-43e3-b89f-48fef036d1be'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:50:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-ce791903-df02-4734-ba39-0965a9e07f29 tempest-ProjectReaderTests-1385150104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:50:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-ce791903-df02-4734-ba39-0965a9e07f29 tempest-ProjectReaderTests-1385150104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:50:50 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-ce791903-df02-4734-ba39-0965a9e07f29 tempest-ProjectReaderTests-1385150104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:50:50 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-ce791903-df02-4734-ba39-0965a9e07f29 tempest-ProjectReaderTests-1385150104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:50:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-ce791903-df02-4734-ba39-0965a9e07f29 tempest-ProjectReaderTests-1385150104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:50:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ce791903-df02-4734-ba39-0965a9e07f29 tempest-ProjectReaderTests-1385150104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:50:50 devstack sudo[105621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:50:50 devstack sudo[105621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:50:51 devstack sudo[105621]: pam_unix(sudo:session): session closed for user root
Jul 09 14:50:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ce791903-df02-4734-ba39-0965a9e07f29 tempest-ProjectReaderTests-1385150104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.652s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:50:51 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-ce791903-df02-4734-ba39-0965a9e07f29 tempest-ProjectReaderTests-1385150104 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:50:51 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-ce791903-df02-4734-ba39-0965a9e07f29 tempest-ProjectReaderTests-1385150104 None] Deleted volume successfully.
Jul 09 14:50:51 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-ce791903-df02-4734-ba39-0965a9e07f29 tempest-ProjectReaderTests-1385150104 None] Lock "cinder-fec59211-e916-4d23-9ed9-69174d9b5c2b-delete_volume" released by "delete_volume" :: held 2.341s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:50:52 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 14:50:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:50:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:50:52 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:50:52 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:50:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:50:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:50:52 devstack sudo[105626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:50:52 devstack sudo[105626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:50:53 devstack sudo[105626]: pam_unix(sudo:session): session closed for user root
Jul 09 14:50:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.665s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:50:53 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:50:53 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Running periodic task VolumeManager._thread_info {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 14:50:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] thread count: 28 {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 09 14:50:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] thread info: [<_MainThread(MainThread, started 125388812103808)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125388713797504)>, <Thread(Thread-3 (stat_writer), started daemon 125388699995392)>, <Thread(Rabbit-heartbeat, started daemon 125388700522560)>, <Thread(Thread-5 (_runner), started daemon 125388698545216)>, <Thread(Thread-7 (_runner), started daemon 125388698611264)>, <Thread(fd_logger, started daemon 125388703020672)>, <Thread(privsep_reader, started daemon 125388696441088)>, <Thread(tpool_thread_0, started daemon 125388687943360)>, <Thread(tpool_thread_1, started daemon 125388679550656)>, <Thread(tpool_thread_2, started daemon 125388671141568)>, <Thread(tpool_thread_3, started daemon 125388662732480)>, <Thread(tpool_thread_4, started daemon 125388654323392)>, <Thread(tpool_thread_5, started daemon 125388645914304)>, <Thread(tpool_thread_6, started daemon 125388637505216)>, <Thread(tpool_thread_7, started daemon 125388629096128)>, <Thread(tpool_thread_8, started daemon 125388620687040)>, <Thread(tpool_thread_9, started daemon 125388612277952)>, <Thread(tpool_thread_10, started daemon 125388603868864)>, <Thread(tpool_thread_11, started daemon 125388595459776)>, <Thread(tpool_thread_12, started daemon 125388587050688)>, <Thread(tpool_thread_13, started daemon 125388578641600)>, <Thread(tpool_thread_14, started daemon 125388570232512)>, <Thread(tpool_thread_15, started daemon 125388561823424)>, <Thread(tpool_thread_16, started daemon 125388553414336)>, <Thread(tpool_thread_17, started daemon 125388545005248)>, <Thread(tpool_thread_18, started daemon 125388536596160)>, <Thread(tpool_thread_19, started daemon 125388528187072)>] {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 09 14:50:56 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-3ca6e6ec-9572-4282-8d9a-f906c7be3198 req-10f98a4b-698e-4e2d-8e27-e524a5e61ad0 tempest-TestStampPattern-1052481563 None] Terminate volume connection completed successfully.
Jul 09 14:50:56 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-3ca6e6ec-9572-4282-8d9a-f906c7be3198 req-10f98a4b-698e-4e2d-8e27-e524a5e61ad0 tempest-TestStampPattern-1052481563 None] Deleting attachment 61db70cf-c03e-48cb-be52-a41e944030a5. {{(pid=87230) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 09 14:51:05 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8684101f-9863-4316-a1ef-4d54ef82b8bd tempest-TestStampPattern-1052481563 None] Acquiring lock "cinder-22de57c3-3178-42ec-a08b-9ee7793a2890-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:51:05 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8684101f-9863-4316-a1ef-4d54ef82b8bd tempest-TestStampPattern-1052481563 None] Lock "cinder-22de57c3-3178-42ec-a08b-9ee7793a2890-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:51:05 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8684101f-9863-4316-a1ef-4d54ef82b8bd tempest-TestStampPattern-1052481563 None] Acquiring lock "cinder-quobyte-22de57c3-3178-42ec-a08b-9ee7793a2890" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:51:05 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8684101f-9863-4316-a1ef-4d54ef82b8bd tempest-TestStampPattern-1052481563 None] Lock "cinder-quobyte-22de57c3-3178-42ec-a08b-9ee7793a2890" acquired by "delete_volume" :: waited 0.014s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:51:05 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a8621a-86f7-4c5c-823e-2b8f5540ddd3]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:51:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8684101f-9863-4316-a1ef-4d54ef82b8bd tempest-TestStampPattern-1052481563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-22de57c3-3178-42ec-a08b-9ee7793a2890 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:51:05 devstack sudo[105716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-22de57c3-3178-42ec-a08b-9ee7793a2890
Jul 09 14:51:05 devstack sudo[105716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:51:06 devstack sudo[105716]: pam_unix(sudo:session): session closed for user root
Jul 09 14:51:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8684101f-9863-4316-a1ef-4d54ef82b8bd tempest-TestStampPattern-1052481563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-22de57c3-3178-42ec-a08b-9ee7793a2890" returned: 0 in 0.786s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:51:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8684101f-9863-4316-a1ef-4d54ef82b8bd tempest-TestStampPattern-1052481563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-22de57c3-3178-42ec-a08b-9ee7793a2890 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:51:06 devstack sudo[105721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-22de57c3-3178-42ec-a08b-9ee7793a2890
Jul 09 14:51:06 devstack sudo[105721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:51:06 devstack sudo[105721]: pam_unix(sudo:session): session closed for user root
Jul 09 14:51:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8684101f-9863-4316-a1ef-4d54ef82b8bd tempest-TestStampPattern-1052481563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-22de57c3-3178-42ec-a08b-9ee7793a2890" returned: 0 in 0.688s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:51:06 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8684101f-9863-4316-a1ef-4d54ef82b8bd tempest-TestStampPattern-1052481563 None] Lock "cinder-quobyte-22de57c3-3178-42ec-a08b-9ee7793a2890" released by "delete_volume" :: held 1.512s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:51:06 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-8684101f-9863-4316-a1ef-4d54ef82b8bd tempest-TestStampPattern-1052481563 None] Created reservations ['66df8882-bd94-423e-92f5-a9f08e1eec17', 'b3c5fea3-6cb6-4c79-8f82-c2db261f2d7e', 'f2263bce-cffa-4cfa-aba0-c79133c9c3df', '072e2667-249d-4adf-aa20-676201d2d5b0'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:51:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8684101f-9863-4316-a1ef-4d54ef82b8bd tempest-TestStampPattern-1052481563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:51:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8684101f-9863-4316-a1ef-4d54ef82b8bd tempest-TestStampPattern-1052481563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:51:07 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-8684101f-9863-4316-a1ef-4d54ef82b8bd tempest-TestStampPattern-1052481563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:51:07 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-8684101f-9863-4316-a1ef-4d54ef82b8bd tempest-TestStampPattern-1052481563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:51:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8684101f-9863-4316-a1ef-4d54ef82b8bd tempest-TestStampPattern-1052481563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:51:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8684101f-9863-4316-a1ef-4d54ef82b8bd tempest-TestStampPattern-1052481563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:51:07 devstack sudo[105724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:51:07 devstack sudo[105724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:51:07 devstack sudo[105724]: pam_unix(sudo:session): session closed for user root
Jul 09 14:51:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8684101f-9863-4316-a1ef-4d54ef82b8bd tempest-TestStampPattern-1052481563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.685s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:51:07 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-8684101f-9863-4316-a1ef-4d54ef82b8bd tempest-TestStampPattern-1052481563 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:51:07 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-8684101f-9863-4316-a1ef-4d54ef82b8bd tempest-TestStampPattern-1052481563 None] Deleted volume successfully.
Jul 09 14:51:07 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8684101f-9863-4316-a1ef-4d54ef82b8bd tempest-TestStampPattern-1052481563 None] Lock "cinder-22de57c3-3178-42ec-a08b-9ee7793a2890-delete_volume" released by "delete_volume" :: held 2.433s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:51:07 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c6981715-7b2c-489e-bd7e-f6a65400fe20 tempest-TestStampPattern-1052481563 None] Acquiring lock "cinder-e85c4487-5a3b-4664-a99a-21cbe97e94f8-delete_snapshot" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:51:07 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c6981715-7b2c-489e-bd7e-f6a65400fe20 tempest-TestStampPattern-1052481563 None] Lock "cinder-e85c4487-5a3b-4664-a99a-21cbe97e94f8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:51:07 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c6981715-7b2c-489e-bd7e-f6a65400fe20 tempest-TestStampPattern-1052481563 None] Acquiring lock "cinder-quobyte-1e99cbc0-ed4d-4afc-98e9-f3d7fc32b506" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:51:07 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c6981715-7b2c-489e-bd7e-f6a65400fe20 tempest-TestStampPattern-1052481563 None] Lock "cinder-quobyte-1e99cbc0-ed4d-4afc-98e9-f3d7fc32b506" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:51:07 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c6981715-7b2c-489e-bd7e-f6a65400fe20 tempest-TestStampPattern-1052481563 None] Acquiring lock "cinder-quobyte-e85c4487-5a3b-4664-a99a-21cbe97e94f8" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:51:07 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c6981715-7b2c-489e-bd7e-f6a65400fe20 tempest-TestStampPattern-1052481563 None] Lock "cinder-quobyte-e85c4487-5a3b-4664-a99a-21cbe97e94f8" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:51:07 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-c6981715-7b2c-489e-bd7e-f6a65400fe20 tempest-TestStampPattern-1052481563 None] Deleting offline snapshot e85c4487-5a3b-4664-a99a-21cbe97e94f8 of volume 1e99cbc0-ed4d-4afc-98e9-f3d7fc32b506 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 14:51:07 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-c6981715-7b2c-489e-bd7e-f6a65400fe20 tempest-TestStampPattern-1052481563 None] snapshot_file for this snap is: volume-1e99cbc0-ed4d-4afc-98e9-f3d7fc32b506.e85c4487-5a3b-4664-a99a-21cbe97e94f8 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 14:51:07 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[433c8abd-625c-4f51-974e-9ba48bcb8a52]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:51:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c6981715-7b2c-489e-bd7e-f6a65400fe20 tempest-TestStampPattern-1052481563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1e99cbc0-ed4d-4afc-98e9-f3d7fc32b506.e85c4487-5a3b-4664-a99a-21cbe97e94f8 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:51:08 devstack sudo[105727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1e99cbc0-ed4d-4afc-98e9-f3d7fc32b506.e85c4487-5a3b-4664-a99a-21cbe97e94f8
Jul 09 14:51:08 devstack sudo[105727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:51:08 devstack sudo[105727]: pam_unix(sudo:session): session closed for user root
Jul 09 14:51:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c6981715-7b2c-489e-bd7e-f6a65400fe20 tempest-TestStampPattern-1052481563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1e99cbc0-ed4d-4afc-98e9-f3d7fc32b506.e85c4487-5a3b-4664-a99a-21cbe97e94f8" returned: 0 in 0.741s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:51:08 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-c6981715-7b2c-489e-bd7e-f6a65400fe20 tempest-TestStampPattern-1052481563 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e99cbc0-ed4d-4afc-98e9-f3d7fc32b506(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 14:51:08 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b4a8de-131b-4f0b-b61a-d3200b8a9d6c]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:51:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c6981715-7b2c-489e-bd7e-f6a65400fe20 tempest-TestStampPattern-1052481563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1e99cbc0-ed4d-4afc-98e9-f3d7fc32b506 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:51:08 devstack sudo[105733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1e99cbc0-ed4d-4afc-98e9-f3d7fc32b506
Jul 09 14:51:08 devstack sudo[105733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:51:09 devstack sudo[105733]: pam_unix(sudo:session): session closed for user root
Jul 09 14:51:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c6981715-7b2c-489e-bd7e-f6a65400fe20 tempest-TestStampPattern-1052481563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1e99cbc0-ed4d-4afc-98e9-f3d7fc32b506" returned: 0 in 0.725s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:51:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c6981715-7b2c-489e-bd7e-f6a65400fe20 tempest-TestStampPattern-1052481563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1e99cbc0-ed4d-4afc-98e9-f3d7fc32b506.e85c4487-5a3b-4664-a99a-21cbe97e94f8 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:51:09 devstack sudo[105738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1e99cbc0-ed4d-4afc-98e9-f3d7fc32b506.e85c4487-5a3b-4664-a99a-21cbe97e94f8
Jul 09 14:51:09 devstack sudo[105738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:51:10 devstack sudo[105738]: pam_unix(sudo:session): session closed for user root
Jul 09 14:51:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c6981715-7b2c-489e-bd7e-f6a65400fe20 tempest-TestStampPattern-1052481563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1e99cbc0-ed4d-4afc-98e9-f3d7fc32b506.e85c4487-5a3b-4664-a99a-21cbe97e94f8" returned: 0 in 0.714s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:51:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c6981715-7b2c-489e-bd7e-f6a65400fe20 tempest-TestStampPattern-1052481563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1e99cbc0-ed4d-4afc-98e9-f3d7fc32b506.e85c4487-5a3b-4664-a99a-21cbe97e94f8 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:51:10 devstack sudo[105743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1e99cbc0-ed4d-4afc-98e9-f3d7fc32b506.e85c4487-5a3b-4664-a99a-21cbe97e94f8
Jul 09 14:51:10 devstack sudo[105743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:51:10 devstack sudo[105743]: pam_unix(sudo:session): session closed for user root
Jul 09 14:51:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c6981715-7b2c-489e-bd7e-f6a65400fe20 tempest-TestStampPattern-1052481563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1e99cbc0-ed4d-4afc-98e9-f3d7fc32b506.e85c4487-5a3b-4664-a99a-21cbe97e94f8" returned: 0 in 0.621s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:51:10 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c6981715-7b2c-489e-bd7e-f6a65400fe20 tempest-TestStampPattern-1052481563 None] Lock "cinder-quobyte-e85c4487-5a3b-4664-a99a-21cbe97e94f8" released by "_delete_snapshot" :: held 2.898s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:51:10 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c6981715-7b2c-489e-bd7e-f6a65400fe20 tempest-TestStampPattern-1052481563 None] Lock "cinder-quobyte-1e99cbc0-ed4d-4afc-98e9-f3d7fc32b506" released by "delete_snapshot" :: held 2.923s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:51:10 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-c6981715-7b2c-489e-bd7e-f6a65400fe20 tempest-TestStampPattern-1052481563 None] Created reservations ['e3d2e38d-a95e-4795-83ef-658056f7ffc2', '272b6556-5434-4a1c-8f88-627eacc2d7b5', '50534a36-3294-470c-a387-af3d8f068dcb', '828e1bc7-f946-4743-868f-7d0a51247e45'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:51:10 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-c6981715-7b2c-489e-bd7e-f6a65400fe20 tempest-TestStampPattern-1052481563 None] Delete snapshot completed successfully.
Jul 09 14:51:10 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c6981715-7b2c-489e-bd7e-f6a65400fe20 tempest-TestStampPattern-1052481563 None] Lock "cinder-e85c4487-5a3b-4664-a99a-21cbe97e94f8-delete_snapshot" released by "delete_snapshot" :: held 3.057s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:51:19 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-2a57440e-0ae1-4692-8540-9daf56a78050 tempest-TestStampPattern-1052481563 None] Acquiring lock "cinder-1e99cbc0-ed4d-4afc-98e9-f3d7fc32b506-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:51:19 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-2a57440e-0ae1-4692-8540-9daf56a78050 tempest-TestStampPattern-1052481563 None] Lock "cinder-1e99cbc0-ed4d-4afc-98e9-f3d7fc32b506-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:51:19 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=57,cinder:DELETE=7,cinder:INSERT=20,cinder:UPDATE=79 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 14:51:19 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-2a57440e-0ae1-4692-8540-9daf56a78050 tempest-TestStampPattern-1052481563 None] Acquiring lock "cinder-quobyte-1e99cbc0-ed4d-4afc-98e9-f3d7fc32b506" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:51:19 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-2a57440e-0ae1-4692-8540-9daf56a78050 tempest-TestStampPattern-1052481563 None] Lock "cinder-quobyte-1e99cbc0-ed4d-4afc-98e9-f3d7fc32b506" acquired by "delete_volume" :: waited 0.021s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:51:19 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[90179e40-1a76-435c-bfdd-0738ccd87b1a]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:51:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2a57440e-0ae1-4692-8540-9daf56a78050 tempest-TestStampPattern-1052481563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1e99cbc0-ed4d-4afc-98e9-f3d7fc32b506 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:51:19 devstack sudo[105777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1e99cbc0-ed4d-4afc-98e9-f3d7fc32b506
Jul 09 14:51:19 devstack sudo[105777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:51:19 devstack sudo[105777]: pam_unix(sudo:session): session closed for user root
Jul 09 14:51:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2a57440e-0ae1-4692-8540-9daf56a78050 tempest-TestStampPattern-1052481563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1e99cbc0-ed4d-4afc-98e9-f3d7fc32b506" returned: 0 in 0.729s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:51:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2a57440e-0ae1-4692-8540-9daf56a78050 tempest-TestStampPattern-1052481563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1e99cbc0-ed4d-4afc-98e9-f3d7fc32b506 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:51:19 devstack sudo[105782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1e99cbc0-ed4d-4afc-98e9-f3d7fc32b506
Jul 09 14:51:19 devstack sudo[105782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:51:20 devstack sudo[105782]: pam_unix(sudo:session): session closed for user root
Jul 09 14:51:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2a57440e-0ae1-4692-8540-9daf56a78050 tempest-TestStampPattern-1052481563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1e99cbc0-ed4d-4afc-98e9-f3d7fc32b506" returned: 0 in 0.615s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:51:20 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-2a57440e-0ae1-4692-8540-9daf56a78050 tempest-TestStampPattern-1052481563 None] Lock "cinder-quobyte-1e99cbc0-ed4d-4afc-98e9-f3d7fc32b506" released by "delete_volume" :: held 1.413s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:51:20 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=68,cinder:INSERT=20,cinder:UPDATE=83,cinder:DELETE=5 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 14:51:20 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-2a57440e-0ae1-4692-8540-9daf56a78050 tempest-TestStampPattern-1052481563 None] Created reservations ['67cfc281-b73c-4911-b5cd-d0caf3226554', '98c160fe-b144-4e49-b6dc-505f43cdc06a', 'f7cd8918-bf80-494f-a47f-b6ac2c0ae9ac', 'cc27d197-b277-4a07-85a4-59ae1341d355'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:51:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-2a57440e-0ae1-4692-8540-9daf56a78050 tempest-TestStampPattern-1052481563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:51:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-2a57440e-0ae1-4692-8540-9daf56a78050 tempest-TestStampPattern-1052481563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:51:20 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-2a57440e-0ae1-4692-8540-9daf56a78050 tempest-TestStampPattern-1052481563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:51:20 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-2a57440e-0ae1-4692-8540-9daf56a78050 tempest-TestStampPattern-1052481563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:51:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-2a57440e-0ae1-4692-8540-9daf56a78050 tempest-TestStampPattern-1052481563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:51:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2a57440e-0ae1-4692-8540-9daf56a78050 tempest-TestStampPattern-1052481563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:51:20 devstack sudo[105785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:51:20 devstack sudo[105785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:51:21 devstack sudo[105785]: pam_unix(sudo:session): session closed for user root
Jul 09 14:51:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2a57440e-0ae1-4692-8540-9daf56a78050 tempest-TestStampPattern-1052481563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.623s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:51:21 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-2a57440e-0ae1-4692-8540-9daf56a78050 tempest-TestStampPattern-1052481563 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:51:21 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-2a57440e-0ae1-4692-8540-9daf56a78050 tempest-TestStampPattern-1052481563 None] Deleted volume successfully.
Jul 09 14:51:21 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-2a57440e-0ae1-4692-8540-9daf56a78050 tempest-TestStampPattern-1052481563 None] Lock "cinder-1e99cbc0-ed4d-4afc-98e9-f3d7fc32b506-delete_volume" released by "delete_volume" :: held 2.269s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:51:30 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=6,cinder:INSERT=4,cinder:UPDATE=8 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 14:51:31 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:UPDATE=7,cinder:SELECT=1,cinder:DELETE=1 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 14:51:32 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-393ffdc4-6b1b-499b-9408-465f2ffb8d4e tempest-VolumeDependencyTests-1612149189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:51:32 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-393ffdc4-6b1b-499b-9408-465f2ffb8d4e tempest-VolumeDependencyTests-1612149189 None] Flow 'volume_create_manager' (67639970-4653-4ec0-9c02-745d982ccda8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:51:32 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-393ffdc4-6b1b-499b-9408-465f2ffb8d4e tempest-VolumeDependencyTests-1612149189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ebc74f2-119e-4025-91d1-496a396beaaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:51:32 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-393ffdc4-6b1b-499b-9408-465f2ffb8d4e tempest-VolumeDependencyTests-1612149189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ebc74f2-119e-4025-91d1-496a396beaaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:51:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-772342110',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bb786fd-1d59-452d-9158-b289bd045f80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db7f28c63d094d259503334b3d7e67a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:51:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:51:33Z,use_quota=True,user_id='593a1f87ae14465d93c9468e1e6456c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:51:32 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-393ffdc4-6b1b-499b-9408-465f2ffb8d4e tempest-VolumeDependencyTests-1612149189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9779c9ed-326b-4a6a-be69-9aaa91607fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:51:32 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-393ffdc4-6b1b-499b-9408-465f2ffb8d4e tempest-VolumeDependencyTests-1612149189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9779c9ed-326b-4a6a-be69-9aaa91607fd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:51:32 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-393ffdc4-6b1b-499b-9408-465f2ffb8d4e tempest-VolumeDependencyTests-1612149189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a85b704-3751-4382-8a48-02d3fd4f2a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:51:32 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-393ffdc4-6b1b-499b-9408-465f2ffb8d4e tempest-VolumeDependencyTests-1612149189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a85b704-3751-4382-8a48-02d3fd4f2a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bb786fd-1d59-452d-9158-b289bd045f80', 'volume_name': 'volume-8bb786fd-1d59-452d-9158-b289bd045f80', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:51:32 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-393ffdc4-6b1b-499b-9408-465f2ffb8d4e tempest-VolumeDependencyTests-1612149189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ced9945d-7961-405e-9bab-5af396483c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:51:32 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-393ffdc4-6b1b-499b-9408-465f2ffb8d4e tempest-VolumeDependencyTests-1612149189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ced9945d-7961-405e-9bab-5af396483c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:51:32 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-393ffdc4-6b1b-499b-9408-465f2ffb8d4e tempest-VolumeDependencyTests-1612149189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5ae7303-7a59-49f2-ae67-6021e6c67cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:51:32 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-393ffdc4-6b1b-499b-9408-465f2ffb8d4e tempest-VolumeDependencyTests-1612149189 None] Volume 8bb786fd-1d59-452d-9158-b289bd045f80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bb786fd-1d59-452d-9158-b289bd045f80', 'volume_size': 1}
Jul 09 14:51:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-393ffdc4-6b1b-499b-9408-465f2ffb8d4e tempest-VolumeDependencyTests-1612149189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:51:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-393ffdc4-6b1b-499b-9408-465f2ffb8d4e tempest-VolumeDependencyTests-1612149189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:51:32 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-393ffdc4-6b1b-499b-9408-465f2ffb8d4e tempest-VolumeDependencyTests-1612149189 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:51:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-772342110',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bb786fd-1d59-452d-9158-b289bd045f80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db7f28c63d094d259503334b3d7e67a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:51:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:51:33Z,use_quota=True,user_id='593a1f87ae14465d93c9468e1e6456c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:51:32 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-393ffdc4-6b1b-499b-9408-465f2ffb8d4e tempest-VolumeDependencyTests-1612149189 None] Creating volume 8bb786fd-1d59-452d-9158-b289bd045f80 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:51:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-393ffdc4-6b1b-499b-9408-465f2ffb8d4e tempest-VolumeDependencyTests-1612149189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:51:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-393ffdc4-6b1b-499b-9408-465f2ffb8d4e tempest-VolumeDependencyTests-1612149189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:51:32 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-393ffdc4-6b1b-499b-9408-465f2ffb8d4e tempest-VolumeDependencyTests-1612149189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:51:32 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-393ffdc4-6b1b-499b-9408-465f2ffb8d4e tempest-VolumeDependencyTests-1612149189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:51:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-393ffdc4-6b1b-499b-9408-465f2ffb8d4e tempest-VolumeDependencyTests-1612149189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:51:32 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-393ffdc4-6b1b-499b-9408-465f2ffb8d4e tempest-VolumeDependencyTests-1612149189 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:51:32 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-393ffdc4-6b1b-499b-9408-465f2ffb8d4e tempest-VolumeDependencyTests-1612149189 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:51:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-393ffdc4-6b1b-499b-9408-465f2ffb8d4e tempest-VolumeDependencyTests-1612149189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8bb786fd-1d59-452d-9158-b289bd045f80 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:51:32 devstack sudo[105796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8bb786fd-1d59-452d-9158-b289bd045f80 1073741824
Jul 09 14:51:32 devstack sudo[105796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:51:33 devstack sudo[105796]: pam_unix(sudo:session): session closed for user root
Jul 09 14:51:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-393ffdc4-6b1b-499b-9408-465f2ffb8d4e tempest-VolumeDependencyTests-1612149189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8bb786fd-1d59-452d-9158-b289bd045f80 1073741824" returned: 0 in 0.812s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:51:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-393ffdc4-6b1b-499b-9408-465f2ffb8d4e tempest-VolumeDependencyTests-1612149189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8bb786fd-1d59-452d-9158-b289bd045f80 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:51:33 devstack sudo[105801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8bb786fd-1d59-452d-9158-b289bd045f80
Jul 09 14:51:33 devstack sudo[105801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:51:34 devstack sudo[105801]: pam_unix(sudo:session): session closed for user root
Jul 09 14:51:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-393ffdc4-6b1b-499b-9408-465f2ffb8d4e tempest-VolumeDependencyTests-1612149189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8bb786fd-1d59-452d-9158-b289bd045f80" returned: 0 in 0.636s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:51:34 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-393ffdc4-6b1b-499b-9408-465f2ffb8d4e tempest-VolumeDependencyTests-1612149189 None] <== create_volume: return (1493ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:51:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-393ffdc4-6b1b-499b-9408-465f2ffb8d4e tempest-VolumeDependencyTests-1612149189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.495s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:51:34 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-393ffdc4-6b1b-499b-9408-465f2ffb8d4e tempest-VolumeDependencyTests-1612149189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5ae7303-7a59-49f2-ae67-6021e6c67cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bb786fd-1d59-452d-9158-b289bd045f80', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:51:34 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-393ffdc4-6b1b-499b-9408-465f2ffb8d4e tempest-VolumeDependencyTests-1612149189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e38c3c85-0ae6-4465-bbab-382cecaf0e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:51:34 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-393ffdc4-6b1b-499b-9408-465f2ffb8d4e tempest-VolumeDependencyTests-1612149189 None] Volume volume-8bb786fd-1d59-452d-9158-b289bd045f80 (8bb786fd-1d59-452d-9158-b289bd045f80): created successfully
Jul 09 14:51:34 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-393ffdc4-6b1b-499b-9408-465f2ffb8d4e tempest-VolumeDependencyTests-1612149189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e38c3c85-0ae6-4465-bbab-382cecaf0e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:51:34 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-393ffdc4-6b1b-499b-9408-465f2ffb8d4e tempest-VolumeDependencyTests-1612149189 None] Flow 'volume_create_manager' (67639970-4653-4ec0-9c02-745d982ccda8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:51:34 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-393ffdc4-6b1b-499b-9408-465f2ffb8d4e tempest-VolumeDependencyTests-1612149189 None] Created volume successfully.
Jul 09 14:51:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-ce9618d9-1f23-495d-8701-5b55bc1ba298 tempest-VolumeDependencyTests-1612149189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:51:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-ce9618d9-1f23-495d-8701-5b55bc1ba298 tempest-VolumeDependencyTests-1612149189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:51:35 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-ce9618d9-1f23-495d-8701-5b55bc1ba298 tempest-VolumeDependencyTests-1612149189 None] Creating offline snapshot 085a4b99-30d5-40dc-9b30-62d8a302f198 of volume 8bb786fd-1d59-452d-9158-b289bd045f80 {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 14:51:35 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[c76e9ea4-d3a2-4dba-a59f-118fa4a760ad]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:51:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ce9618d9-1f23-495d-8701-5b55bc1ba298 tempest-VolumeDependencyTests-1612149189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8bb786fd-1d59-452d-9158-b289bd045f80 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:51:35 devstack sudo[105804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8bb786fd-1d59-452d-9158-b289bd045f80
Jul 09 14:51:35 devstack sudo[105804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:51:35 devstack sudo[105804]: pam_unix(sudo:session): session closed for user root
Jul 09 14:51:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ce9618d9-1f23-495d-8701-5b55bc1ba298 tempest-VolumeDependencyTests-1612149189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8bb786fd-1d59-452d-9158-b289bd045f80" returned: 0 in 0.723s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:51:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ce9618d9-1f23-495d-8701-5b55bc1ba298 tempest-VolumeDependencyTests-1612149189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8bb786fd-1d59-452d-9158-b289bd045f80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8bb786fd-1d59-452d-9158-b289bd045f80.085a4b99-30d5-40dc-9b30-62d8a302f198 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:51:35 devstack sudo[105809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8bb786fd-1d59-452d-9158-b289bd045f80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8bb786fd-1d59-452d-9158-b289bd045f80.085a4b99-30d5-40dc-9b30-62d8a302f198 1G
Jul 09 14:51:35 devstack sudo[105809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:51:36 devstack sudo[105809]: pam_unix(sudo:session): session closed for user root
Jul 09 14:51:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ce9618d9-1f23-495d-8701-5b55bc1ba298 tempest-VolumeDependencyTests-1612149189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8bb786fd-1d59-452d-9158-b289bd045f80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8bb786fd-1d59-452d-9158-b289bd045f80.085a4b99-30d5-40dc-9b30-62d8a302f198 1G" returned: 0 in 0.811s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:51:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ce9618d9-1f23-495d-8701-5b55bc1ba298 tempest-VolumeDependencyTests-1612149189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8bb786fd-1d59-452d-9158-b289bd045f80 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8bb786fd-1d59-452d-9158-b289bd045f80.085a4b99-30d5-40dc-9b30-62d8a302f198 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:51:36 devstack sudo[105814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8bb786fd-1d59-452d-9158-b289bd045f80 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8bb786fd-1d59-452d-9158-b289bd045f80.085a4b99-30d5-40dc-9b30-62d8a302f198
Jul 09 14:51:36 devstack sudo[105814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:51:37 devstack sudo[105814]: pam_unix(sudo:session): session closed for user root
Jul 09 14:51:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ce9618d9-1f23-495d-8701-5b55bc1ba298 tempest-VolumeDependencyTests-1612149189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8bb786fd-1d59-452d-9158-b289bd045f80 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8bb786fd-1d59-452d-9158-b289bd045f80.085a4b99-30d5-40dc-9b30-62d8a302f198" returned: 0 in 0.705s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:51:37 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-ce9618d9-1f23-495d-8701-5b55bc1ba298 tempest-VolumeDependencyTests-1612149189 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8bb786fd-1d59-452d-9158-b289bd045f80.085a4b99-30d5-40dc-9b30-62d8a302f198 is being set with open permissions: ugo+rw
Jul 09 14:51:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ce9618d9-1f23-495d-8701-5b55bc1ba298 tempest-VolumeDependencyTests-1612149189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8bb786fd-1d59-452d-9158-b289bd045f80.085a4b99-30d5-40dc-9b30-62d8a302f198 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:51:37 devstack sudo[105819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8bb786fd-1d59-452d-9158-b289bd045f80.085a4b99-30d5-40dc-9b30-62d8a302f198
Jul 09 14:51:37 devstack sudo[105819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:51:37 devstack sudo[105819]: pam_unix(sudo:session): session closed for user root
Jul 09 14:51:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ce9618d9-1f23-495d-8701-5b55bc1ba298 tempest-VolumeDependencyTests-1612149189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8bb786fd-1d59-452d-9158-b289bd045f80.085a4b99-30d5-40dc-9b30-62d8a302f198" returned: 0 in 0.635s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:51:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ce9618d9-1f23-495d-8701-5b55bc1ba298 tempest-VolumeDependencyTests-1612149189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8bb786fd-1d59-452d-9158-b289bd045f80.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:51:37 devstack sudo[105822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8bb786fd-1d59-452d-9158-b289bd045f80.info
Jul 09 14:51:37 devstack sudo[105822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:51:38 devstack sudo[105822]: pam_unix(sudo:session): session closed for user root
Jul 09 14:51:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ce9618d9-1f23-495d-8701-5b55bc1ba298 tempest-VolumeDependencyTests-1612149189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8bb786fd-1d59-452d-9158-b289bd045f80.info" returned: 0 in 0.653s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:51:38 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-ce9618d9-1f23-495d-8701-5b55bc1ba298 tempest-VolumeDependencyTests-1612149189 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8bb786fd-1d59-452d-9158-b289bd045f80.info is being set with open permissions: ugo+rw
Jul 09 14:51:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ce9618d9-1f23-495d-8701-5b55bc1ba298 tempest-VolumeDependencyTests-1612149189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8bb786fd-1d59-452d-9158-b289bd045f80.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:51:38 devstack sudo[105825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8bb786fd-1d59-452d-9158-b289bd045f80.info
Jul 09 14:51:38 devstack sudo[105825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:51:39 devstack sudo[105825]: pam_unix(sudo:session): session closed for user root
Jul 09 14:51:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ce9618d9-1f23-495d-8701-5b55bc1ba298 tempest-VolumeDependencyTests-1612149189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8bb786fd-1d59-452d-9158-b289bd045f80.info" returned: 0 in 0.649s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:51:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-ce9618d9-1f23-495d-8701-5b55bc1ba298 tempest-VolumeDependencyTests-1612149189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.267s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:51:39 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-ce9618d9-1f23-495d-8701-5b55bc1ba298 tempest-VolumeDependencyTests-1612149189 None] Create snapshot completed successfully
Jul 09 14:51:40 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-6256a6f4-563d-4115-b0da-2faf319c6b49 tempest-VolumeDependencyTests-1612149189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:51:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6256a6f4-563d-4115-b0da-2faf319c6b49 tempest-VolumeDependencyTests-1612149189 None] Flow 'volume_create_manager' (88cff31d-ad52-440a-9dee-3788fcb3cc1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:51:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6256a6f4-563d-4115-b0da-2faf319c6b49 tempest-VolumeDependencyTests-1612149189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a694dc4-ce07-4b7c-b144-bc6de98ef8a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:51:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6256a6f4-563d-4115-b0da-2faf319c6b49 tempest-VolumeDependencyTests-1612149189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a694dc4-ce07-4b7c-b144-bc6de98ef8a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:51:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1485417903',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18f9341b-6423-492d-b491-02612804024b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db7f28c63d094d259503334b3d7e67a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:51:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=085a4b99-30d5-40dc-9b30-62d8a302f198,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:51:41Z,use_quota=True,user_id='593a1f87ae14465d93c9468e1e6456c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:51:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6256a6f4-563d-4115-b0da-2faf319c6b49 tempest-VolumeDependencyTests-1612149189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (855b91b5-f424-4429-b676-4b0a7eb29b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:51:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6256a6f4-563d-4115-b0da-2faf319c6b49 tempest-VolumeDependencyTests-1612149189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (855b91b5-f424-4429-b676-4b0a7eb29b6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:51:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6256a6f4-563d-4115-b0da-2faf319c6b49 tempest-VolumeDependencyTests-1612149189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19ebbc31-4c58-44ee-baed-508ef1741926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:51:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6256a6f4-563d-4115-b0da-2faf319c6b49 tempest-VolumeDependencyTests-1612149189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19ebbc31-4c58-44ee-baed-508ef1741926) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '18f9341b-6423-492d-b491-02612804024b', 'volume_name': 'volume-18f9341b-6423-492d-b491-02612804024b', 'volume_size': 1, 'snapshot_id': '085a4b99-30d5-40dc-9b30-62d8a302f198'}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:51:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6256a6f4-563d-4115-b0da-2faf319c6b49 tempest-VolumeDependencyTests-1612149189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f631f9c9-12d6-4240-8cc3-d40d1d08a684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:51:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6256a6f4-563d-4115-b0da-2faf319c6b49 tempest-VolumeDependencyTests-1612149189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f631f9c9-12d6-4240-8cc3-d40d1d08a684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:51:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6256a6f4-563d-4115-b0da-2faf319c6b49 tempest-VolumeDependencyTests-1612149189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c91798a-f088-428c-9b94-3b9930efd6bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:51:40 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-6256a6f4-563d-4115-b0da-2faf319c6b49 tempest-VolumeDependencyTests-1612149189 None] Volume 18f9341b-6423-492d-b491-02612804024b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-18f9341b-6423-492d-b491-02612804024b', 'volume_size': 1, 'snapshot_id': '085a4b99-30d5-40dc-9b30-62d8a302f198'}
Jul 09 14:51:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6256a6f4-563d-4115-b0da-2faf319c6b49 tempest-VolumeDependencyTests-1612149189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:51:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6256a6f4-563d-4115-b0da-2faf319c6b49 tempest-VolumeDependencyTests-1612149189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:51:40 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-6256a6f4-563d-4115-b0da-2faf319c6b49 tempest-VolumeDependencyTests-1612149189 None] Acquiring lock "cinder-quobyte-085a4b99-30d5-40dc-9b30-62d8a302f198-18f9341b-6423-492d-b491-02612804024b" by "_create_volume_from_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:51:40 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-6256a6f4-563d-4115-b0da-2faf319c6b49 tempest-VolumeDependencyTests-1612149189 None] Lock "cinder-quobyte-085a4b99-30d5-40dc-9b30-62d8a302f198-18f9341b-6423-492d-b491-02612804024b" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:51:40 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-6256a6f4-563d-4115-b0da-2faf319c6b49 tempest-VolumeDependencyTests-1612149189 None] Creating volume 18f9341b-6423-492d-b491-02612804024b from snapshot 085a4b99-30d5-40dc-9b30-62d8a302f198 {{(pid=87230) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 09 14:51:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6256a6f4-563d-4115-b0da-2faf319c6b49 tempest-VolumeDependencyTests-1612149189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:51:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6256a6f4-563d-4115-b0da-2faf319c6b49 tempest-VolumeDependencyTests-1612149189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:51:40 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-6256a6f4-563d-4115-b0da-2faf319c6b49 tempest-VolumeDependencyTests-1612149189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:51:40 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-6256a6f4-563d-4115-b0da-2faf319c6b49 tempest-VolumeDependencyTests-1612149189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:51:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6256a6f4-563d-4115-b0da-2faf319c6b49 tempest-VolumeDependencyTests-1612149189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:51:40 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-6256a6f4-563d-4115-b0da-2faf319c6b49 tempest-VolumeDependencyTests-1612149189 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:51:40 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-6256a6f4-563d-4115-b0da-2faf319c6b49 tempest-VolumeDependencyTests-1612149189 None] Acquiring lock "cinder-quobyte-18f9341b-6423-492d-b491-02612804024b" by "_copy_volume_from_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:51:40 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-6256a6f4-563d-4115-b0da-2faf319c6b49 tempest-VolumeDependencyTests-1612149189 None] Lock "cinder-quobyte-18f9341b-6423-492d-b491-02612804024b" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:51:40 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-6256a6f4-563d-4115-b0da-2faf319c6b49 tempest-VolumeDependencyTests-1612149189 None] snapshot: 085a4b99-30d5-40dc-9b30-62d8a302f198, volume: 18f9341b-6423-492d-b491-02612804024b,  {{(pid=87230) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 09 14:51:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6256a6f4-563d-4115-b0da-2faf319c6b49 tempest-VolumeDependencyTests-1612149189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:51:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6256a6f4-563d-4115-b0da-2faf319c6b49 tempest-VolumeDependencyTests-1612149189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:51:40 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-6256a6f4-563d-4115-b0da-2faf319c6b49 tempest-VolumeDependencyTests-1612149189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:51:40 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-6256a6f4-563d-4115-b0da-2faf319c6b49 tempest-VolumeDependencyTests-1612149189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:51:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6256a6f4-563d-4115-b0da-2faf319c6b49 tempest-VolumeDependencyTests-1612149189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:51:40 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[459a0234-1991-4d53-8f7e-4188aa0988c3]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:51:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6256a6f4-563d-4115-b0da-2faf319c6b49 tempest-VolumeDependencyTests-1612149189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8bb786fd-1d59-452d-9158-b289bd045f80.085a4b99-30d5-40dc-9b30-62d8a302f198 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:51:40 devstack sudo[105829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8bb786fd-1d59-452d-9158-b289bd045f80.085a4b99-30d5-40dc-9b30-62d8a302f198
Jul 09 14:51:40 devstack sudo[105829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:51:41 devstack sudo[105829]: pam_unix(sudo:session): session closed for user root
Jul 09 14:51:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6256a6f4-563d-4115-b0da-2faf319c6b49 tempest-VolumeDependencyTests-1612149189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8bb786fd-1d59-452d-9158-b289bd045f80.085a4b99-30d5-40dc-9b30-62d8a302f198" returned: 0 in 0.757s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:51:41 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-6256a6f4-563d-4115-b0da-2faf319c6b49 tempest-VolumeDependencyTests-1612149189 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8bb786fd-1d59-452d-9158-b289bd045f80(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 14:51:41 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-6256a6f4-563d-4115-b0da-2faf319c6b49 tempest-VolumeDependencyTests-1612149189 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8bb786fd-1d59-452d-9158-b289bd045f80 {{(pid=87230) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 09 14:51:41 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-6256a6f4-563d-4115-b0da-2faf319c6b49 tempest-VolumeDependencyTests-1612149189 None] Creating direct copy from snapshot {{(pid=87230) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 09 14:51:41 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc837db2-2018-4f3a-97ac-058b792bae34]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:51:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6256a6f4-563d-4115-b0da-2faf319c6b49 tempest-VolumeDependencyTests-1612149189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8bb786fd-1d59-452d-9158-b289bd045f80 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:51:41 devstack sudo[105834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8bb786fd-1d59-452d-9158-b289bd045f80
Jul 09 14:51:41 devstack sudo[105834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:51:42 devstack sudo[105834]: pam_unix(sudo:session): session closed for user root
Jul 09 14:51:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6256a6f4-563d-4115-b0da-2faf319c6b49 tempest-VolumeDependencyTests-1612149189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8bb786fd-1d59-452d-9158-b289bd045f80" returned: 0 in 0.757s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:51:42 devstack cinder-volume[87230]: DEBUG cinder.utils [None req-6256a6f4-563d-4115-b0da-2faf319c6b49 tempest-VolumeDependencyTests-1612149189 None] Path /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-18f9341b-6423-492d-b491-02612804024b not found in is_blk_device check {{(pid=87230) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 09 14:51:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6256a6f4-563d-4115-b0da-2faf319c6b49 tempest-VolumeDependencyTests-1612149189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8bb786fd-1d59-452d-9158-b289bd045f80 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-18f9341b-6423-492d-b491-02612804024b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:51:42 devstack sudo[105839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8bb786fd-1d59-452d-9158-b289bd045f80 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-18f9341b-6423-492d-b491-02612804024b
Jul 09 14:51:42 devstack sudo[105839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:51:46 devstack sudo[105839]: pam_unix(sudo:session): session closed for user root
Jul 09 14:51:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6256a6f4-563d-4115-b0da-2faf319c6b49 tempest-VolumeDependencyTests-1612149189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8bb786fd-1d59-452d-9158-b289bd045f80 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-18f9341b-6423-492d-b491-02612804024b" returned: 0 in 4.497s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:51:46 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fbe8b22-3942-4b2a-9c7e-da1f80746c6d]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:51:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6256a6f4-563d-4115-b0da-2faf319c6b49 tempest-VolumeDependencyTests-1612149189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8bb786fd-1d59-452d-9158-b289bd045f80 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:51:47 devstack sudo[105886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8bb786fd-1d59-452d-9158-b289bd045f80
Jul 09 14:51:47 devstack sudo[105886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:51:47 devstack sudo[105886]: pam_unix(sudo:session): session closed for user root
Jul 09 14:51:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6256a6f4-563d-4115-b0da-2faf319c6b49 tempest-VolumeDependencyTests-1612149189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8bb786fd-1d59-452d-9158-b289bd045f80" returned: 0 in 0.914s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:51:47 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-6256a6f4-563d-4115-b0da-2faf319c6b49 tempest-VolumeDependencyTests-1612149189 None] Image conversion details: src /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8bb786fd-1d59-452d-9158-b289bd045f80, size 1024.00 MB, duration 4.50 sec, destination /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-18f9341b-6423-492d-b491-02612804024b {{(pid=87230) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 09 14:51:47 devstack cinder-volume[87230]: INFO cinder.image.image_utils [None req-6256a6f4-563d-4115-b0da-2faf319c6b49 tempest-VolumeDependencyTests-1612149189 None] Converted 1024.00 MB image at 227.64 MB/s
Jul 09 14:51:47 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-6256a6f4-563d-4115-b0da-2faf319c6b49 tempest-VolumeDependencyTests-1612149189 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-18f9341b-6423-492d-b491-02612804024b is being set with open permissions: ugo+rw
Jul 09 14:51:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6256a6f4-563d-4115-b0da-2faf319c6b49 tempest-VolumeDependencyTests-1612149189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-18f9341b-6423-492d-b491-02612804024b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:51:47 devstack sudo[105893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-18f9341b-6423-492d-b491-02612804024b
Jul 09 14:51:47 devstack sudo[105893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:51:48 devstack sudo[105893]: pam_unix(sudo:session): session closed for user root
Jul 09 14:51:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6256a6f4-563d-4115-b0da-2faf319c6b49 tempest-VolumeDependencyTests-1612149189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-18f9341b-6423-492d-b491-02612804024b" returned: 0 in 0.648s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:51:48 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-6256a6f4-563d-4115-b0da-2faf319c6b49 tempest-VolumeDependencyTests-1612149189 None] Lock "cinder-quobyte-18f9341b-6423-492d-b491-02612804024b" released by "_copy_volume_from_snapshot" :: held 7.664s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:51:48 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-6256a6f4-563d-4115-b0da-2faf319c6b49 tempest-VolumeDependencyTests-1612149189 None] Lock "cinder-quobyte-085a4b99-30d5-40dc-9b30-62d8a302f198-18f9341b-6423-492d-b491-02612804024b" released by "_create_volume_from_snapshot" :: held 7.691s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:51:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6256a6f4-563d-4115-b0da-2faf319c6b49 tempest-VolumeDependencyTests-1612149189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.705s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:51:48 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6256a6f4-563d-4115-b0da-2faf319c6b49 tempest-VolumeDependencyTests-1612149189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c91798a-f088-428c-9b94-3b9930efd6bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18f9341b-6423-492d-b491-02612804024b', 'volume_size': 1, 'snapshot_id': '085a4b99-30d5-40dc-9b30-62d8a302f198'}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:51:48 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6256a6f4-563d-4115-b0da-2faf319c6b49 tempest-VolumeDependencyTests-1612149189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65171722-cba5-490a-bfeb-47fdf1c687a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:51:48 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-6256a6f4-563d-4115-b0da-2faf319c6b49 tempest-VolumeDependencyTests-1612149189 None] Volume volume-18f9341b-6423-492d-b491-02612804024b (18f9341b-6423-492d-b491-02612804024b): created successfully
Jul 09 14:51:48 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6256a6f4-563d-4115-b0da-2faf319c6b49 tempest-VolumeDependencyTests-1612149189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65171722-cba5-490a-bfeb-47fdf1c687a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:51:48 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6256a6f4-563d-4115-b0da-2faf319c6b49 tempest-VolumeDependencyTests-1612149189 None] Flow 'volume_create_manager' (88cff31d-ad52-440a-9dee-3788fcb3cc1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:51:48 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-6256a6f4-563d-4115-b0da-2faf319c6b49 tempest-VolumeDependencyTests-1612149189 None] Created volume successfully.
Jul 09 14:51:49 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8541b9b8-b8b3-4501-b41c-3ebe8336f089 tempest-VolumeDependencyTests-1612149189 None] Acquiring lock "cinder-085a4b99-30d5-40dc-9b30-62d8a302f198-delete_snapshot" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:51:49 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8541b9b8-b8b3-4501-b41c-3ebe8336f089 tempest-VolumeDependencyTests-1612149189 None] Lock "cinder-085a4b99-30d5-40dc-9b30-62d8a302f198-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:51:49 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8541b9b8-b8b3-4501-b41c-3ebe8336f089 tempest-VolumeDependencyTests-1612149189 None] Acquiring lock "cinder-quobyte-8bb786fd-1d59-452d-9158-b289bd045f80" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:51:49 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8541b9b8-b8b3-4501-b41c-3ebe8336f089 tempest-VolumeDependencyTests-1612149189 None] Lock "cinder-quobyte-8bb786fd-1d59-452d-9158-b289bd045f80" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:51:49 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8541b9b8-b8b3-4501-b41c-3ebe8336f089 tempest-VolumeDependencyTests-1612149189 None] Acquiring lock "cinder-quobyte-085a4b99-30d5-40dc-9b30-62d8a302f198" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:51:49 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8541b9b8-b8b3-4501-b41c-3ebe8336f089 tempest-VolumeDependencyTests-1612149189 None] Lock "cinder-quobyte-085a4b99-30d5-40dc-9b30-62d8a302f198" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:51:49 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-8541b9b8-b8b3-4501-b41c-3ebe8336f089 tempest-VolumeDependencyTests-1612149189 None] Deleting offline snapshot 085a4b99-30d5-40dc-9b30-62d8a302f198 of volume 8bb786fd-1d59-452d-9158-b289bd045f80 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 14:51:49 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-8541b9b8-b8b3-4501-b41c-3ebe8336f089 tempest-VolumeDependencyTests-1612149189 None] snapshot_file for this snap is: volume-8bb786fd-1d59-452d-9158-b289bd045f80.085a4b99-30d5-40dc-9b30-62d8a302f198 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 14:51:49 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[66316295-6341-4120-a515-fd7b2b6037d9]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:51:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8541b9b8-b8b3-4501-b41c-3ebe8336f089 tempest-VolumeDependencyTests-1612149189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8bb786fd-1d59-452d-9158-b289bd045f80.085a4b99-30d5-40dc-9b30-62d8a302f198 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:51:49 devstack sudo[105896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8bb786fd-1d59-452d-9158-b289bd045f80.085a4b99-30d5-40dc-9b30-62d8a302f198
Jul 09 14:51:49 devstack sudo[105896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:51:50 devstack sudo[105896]: pam_unix(sudo:session): session closed for user root
Jul 09 14:51:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8541b9b8-b8b3-4501-b41c-3ebe8336f089 tempest-VolumeDependencyTests-1612149189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8bb786fd-1d59-452d-9158-b289bd045f80.085a4b99-30d5-40dc-9b30-62d8a302f198" returned: 0 in 0.743s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:51:50 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-8541b9b8-b8b3-4501-b41c-3ebe8336f089 tempest-VolumeDependencyTests-1612149189 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8bb786fd-1d59-452d-9158-b289bd045f80(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 14:51:50 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f18c81-d283-4886-98fc-2d77efc6b99e]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:51:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8541b9b8-b8b3-4501-b41c-3ebe8336f089 tempest-VolumeDependencyTests-1612149189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8bb786fd-1d59-452d-9158-b289bd045f80 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:51:50 devstack sudo[105901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8bb786fd-1d59-452d-9158-b289bd045f80
Jul 09 14:51:50 devstack sudo[105901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:51:50 devstack sudo[105901]: pam_unix(sudo:session): session closed for user root
Jul 09 14:51:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8541b9b8-b8b3-4501-b41c-3ebe8336f089 tempest-VolumeDependencyTests-1612149189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8bb786fd-1d59-452d-9158-b289bd045f80" returned: 0 in 0.712s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:51:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8541b9b8-b8b3-4501-b41c-3ebe8336f089 tempest-VolumeDependencyTests-1612149189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8bb786fd-1d59-452d-9158-b289bd045f80.085a4b99-30d5-40dc-9b30-62d8a302f198 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:51:50 devstack sudo[105907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8bb786fd-1d59-452d-9158-b289bd045f80.085a4b99-30d5-40dc-9b30-62d8a302f198
Jul 09 14:51:50 devstack sudo[105907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:51:51 devstack sudo[105907]: pam_unix(sudo:session): session closed for user root
Jul 09 14:51:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8541b9b8-b8b3-4501-b41c-3ebe8336f089 tempest-VolumeDependencyTests-1612149189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8bb786fd-1d59-452d-9158-b289bd045f80.085a4b99-30d5-40dc-9b30-62d8a302f198" returned: 0 in 0.697s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:51:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8541b9b8-b8b3-4501-b41c-3ebe8336f089 tempest-VolumeDependencyTests-1612149189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8bb786fd-1d59-452d-9158-b289bd045f80.085a4b99-30d5-40dc-9b30-62d8a302f198 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:51:51 devstack sudo[105912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8bb786fd-1d59-452d-9158-b289bd045f80.085a4b99-30d5-40dc-9b30-62d8a302f198
Jul 09 14:51:51 devstack sudo[105912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:51:52 devstack sudo[105912]: pam_unix(sudo:session): session closed for user root
Jul 09 14:51:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8541b9b8-b8b3-4501-b41c-3ebe8336f089 tempest-VolumeDependencyTests-1612149189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8bb786fd-1d59-452d-9158-b289bd045f80.085a4b99-30d5-40dc-9b30-62d8a302f198" returned: 0 in 0.611s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:51:52 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8541b9b8-b8b3-4501-b41c-3ebe8336f089 tempest-VolumeDependencyTests-1612149189 None] Lock "cinder-quobyte-085a4b99-30d5-40dc-9b30-62d8a302f198" released by "_delete_snapshot" :: held 2.857s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:51:52 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8541b9b8-b8b3-4501-b41c-3ebe8336f089 tempest-VolumeDependencyTests-1612149189 None] Lock "cinder-quobyte-8bb786fd-1d59-452d-9158-b289bd045f80" released by "delete_snapshot" :: held 2.879s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:51:52 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-8541b9b8-b8b3-4501-b41c-3ebe8336f089 tempest-VolumeDependencyTests-1612149189 None] Created reservations ['edcff8c2-6679-4c93-bb84-d61fa294edaf', '22c588a8-65e2-480a-aeff-83099fc59490', 'f098c8c3-6fe0-48d0-90bb-c95e87f31ec6', '9fa51357-c97b-426b-af74-1c231358671c'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:51:52 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 14:51:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:51:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:51:52 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:51:52 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:51:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:51:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:51:52 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-8541b9b8-b8b3-4501-b41c-3ebe8336f089 tempest-VolumeDependencyTests-1612149189 None] Delete snapshot completed successfully.
Jul 09 14:51:52 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8541b9b8-b8b3-4501-b41c-3ebe8336f089 tempest-VolumeDependencyTests-1612149189 None] Lock "cinder-085a4b99-30d5-40dc-9b30-62d8a302f198-delete_snapshot" released by "delete_snapshot" :: held 3.029s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:51:52 devstack sudo[105915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:51:52 devstack sudo[105915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:51:52 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-45513931-bb8b-4012-a748-e33fa5886f5f tempest-VolumeDependencyTests-1612149189 None] Acquiring lock "cinder-8bb786fd-1d59-452d-9158-b289bd045f80-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:51:52 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-45513931-bb8b-4012-a748-e33fa5886f5f tempest-VolumeDependencyTests-1612149189 None] Lock "cinder-8bb786fd-1d59-452d-9158-b289bd045f80-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:51:52 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-45513931-bb8b-4012-a748-e33fa5886f5f tempest-VolumeDependencyTests-1612149189 None] Acquiring lock "cinder-quobyte-8bb786fd-1d59-452d-9158-b289bd045f80" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:51:52 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-45513931-bb8b-4012-a748-e33fa5886f5f tempest-VolumeDependencyTests-1612149189 None] Lock "cinder-quobyte-8bb786fd-1d59-452d-9158-b289bd045f80" acquired by "delete_volume" :: waited 0.015s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:51:52 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[de51f5aa-b2c3-45ab-b914-abf8119047b9]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:51:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-45513931-bb8b-4012-a748-e33fa5886f5f tempest-VolumeDependencyTests-1612149189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8bb786fd-1d59-452d-9158-b289bd045f80 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:51:52 devstack sudo[105917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8bb786fd-1d59-452d-9158-b289bd045f80
Jul 09 14:51:52 devstack sudo[105917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:51:53 devstack sudo[105915]: pam_unix(sudo:session): session closed for user root
Jul 09 14:51:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.663s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:51:53 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:51:53 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Running periodic task VolumeManager._thread_info {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 14:51:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] thread count: 28 {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 09 14:51:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] thread info: [<_MainThread(MainThread, started 125388812103808)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125388713797504)>, <Thread(Thread-3 (stat_writer), started daemon 125388699995392)>, <Thread(Rabbit-heartbeat, started daemon 125388700522560)>, <Thread(Thread-5 (_runner), started daemon 125388698545216)>, <Thread(Thread-7 (_runner), started daemon 125388698611264)>, <Thread(fd_logger, started daemon 125388703020672)>, <Thread(privsep_reader, started daemon 125388696441088)>, <Thread(tpool_thread_0, started daemon 125388687943360)>, <Thread(tpool_thread_1, started daemon 125388679550656)>, <Thread(tpool_thread_2, started daemon 125388671141568)>, <Thread(tpool_thread_3, started daemon 125388662732480)>, <Thread(tpool_thread_4, started daemon 125388654323392)>, <Thread(tpool_thread_5, started daemon 125388645914304)>, <Thread(tpool_thread_6, started daemon 125388637505216)>, <Thread(tpool_thread_7, started daemon 125388629096128)>, <Thread(tpool_thread_8, started daemon 125388620687040)>, <Thread(tpool_thread_9, started daemon 125388612277952)>, <Thread(tpool_thread_10, started daemon 125388603868864)>, <Thread(tpool_thread_11, started daemon 125388595459776)>, <Thread(tpool_thread_12, started daemon 125388587050688)>, <Thread(tpool_thread_13, started daemon 125388578641600)>, <Thread(tpool_thread_14, started daemon 125388570232512)>, <Thread(tpool_thread_15, started daemon 125388561823424)>, <Thread(tpool_thread_16, started daemon 125388553414336)>, <Thread(tpool_thread_17, started daemon 125388545005248)>, <Thread(tpool_thread_18, started daemon 125388536596160)>, <Thread(tpool_thread_19, started daemon 125388528187072)>] {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 09 14:51:53 devstack sudo[105917]: pam_unix(sudo:session): session closed for user root
Jul 09 14:51:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-45513931-bb8b-4012-a748-e33fa5886f5f tempest-VolumeDependencyTests-1612149189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8bb786fd-1d59-452d-9158-b289bd045f80" returned: 0 in 0.740s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:51:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-45513931-bb8b-4012-a748-e33fa5886f5f tempest-VolumeDependencyTests-1612149189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8bb786fd-1d59-452d-9158-b289bd045f80 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:51:53 devstack sudo[105923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8bb786fd-1d59-452d-9158-b289bd045f80
Jul 09 14:51:53 devstack sudo[105923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:51:54 devstack sudo[105923]: pam_unix(sudo:session): session closed for user root
Jul 09 14:51:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-45513931-bb8b-4012-a748-e33fa5886f5f tempest-VolumeDependencyTests-1612149189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8bb786fd-1d59-452d-9158-b289bd045f80" returned: 0 in 0.647s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:51:54 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-45513931-bb8b-4012-a748-e33fa5886f5f tempest-VolumeDependencyTests-1612149189 None] Lock "cinder-quobyte-8bb786fd-1d59-452d-9158-b289bd045f80" released by "delete_volume" :: held 1.447s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:51:54 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-45513931-bb8b-4012-a748-e33fa5886f5f tempest-VolumeDependencyTests-1612149189 None] Created reservations ['5e4d3a53-8b3f-4ac7-b390-345d2c681732', '5fd190f1-7da1-47f0-b1b5-87000e823122', '196bd3b7-cb4b-4fb7-8e11-82b9910bf5b1', 'e8bdb346-b95d-4b3a-bf25-8a36043c0445'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:51:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-45513931-bb8b-4012-a748-e33fa5886f5f tempest-VolumeDependencyTests-1612149189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:51:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-45513931-bb8b-4012-a748-e33fa5886f5f tempest-VolumeDependencyTests-1612149189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:51:54 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-45513931-bb8b-4012-a748-e33fa5886f5f tempest-VolumeDependencyTests-1612149189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:51:54 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-45513931-bb8b-4012-a748-e33fa5886f5f tempest-VolumeDependencyTests-1612149189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:51:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-45513931-bb8b-4012-a748-e33fa5886f5f tempest-VolumeDependencyTests-1612149189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:51:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-45513931-bb8b-4012-a748-e33fa5886f5f tempest-VolumeDependencyTests-1612149189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:51:54 devstack sudo[105926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:51:54 devstack sudo[105926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:51:54 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-69f4df75-00ad-4cca-98cd-0f1ec2b37654 tempest-VolumeDependencyTests-1612149189 None] Acquiring lock "cinder-18f9341b-6423-492d-b491-02612804024b-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:51:54 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-69f4df75-00ad-4cca-98cd-0f1ec2b37654 tempest-VolumeDependencyTests-1612149189 None] Lock "cinder-18f9341b-6423-492d-b491-02612804024b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:51:54 devstack sudo[105926]: pam_unix(sudo:session): session closed for user root
Jul 09 14:51:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-45513931-bb8b-4012-a748-e33fa5886f5f tempest-VolumeDependencyTests-1612149189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.644s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:51:54 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-45513931-bb8b-4012-a748-e33fa5886f5f tempest-VolumeDependencyTests-1612149189 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:51:54 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-45513931-bb8b-4012-a748-e33fa5886f5f tempest-VolumeDependencyTests-1612149189 None] Deleted volume successfully.
Jul 09 14:51:54 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-69f4df75-00ad-4cca-98cd-0f1ec2b37654 tempest-VolumeDependencyTests-1612149189 None] Acquiring lock "cinder-quobyte-18f9341b-6423-492d-b491-02612804024b" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:51:54 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-69f4df75-00ad-4cca-98cd-0f1ec2b37654 tempest-VolumeDependencyTests-1612149189 None] Lock "cinder-quobyte-18f9341b-6423-492d-b491-02612804024b" acquired by "delete_volume" :: waited 0.026s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:51:54 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-45513931-bb8b-4012-a748-e33fa5886f5f tempest-VolumeDependencyTests-1612149189 None] Lock "cinder-8bb786fd-1d59-452d-9158-b289bd045f80-delete_volume" released by "delete_volume" :: held 2.322s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:51:54 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[168b94b5-4773-4e78-8ea7-3e26c2b6ff6d]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:51:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-69f4df75-00ad-4cca-98cd-0f1ec2b37654 tempest-VolumeDependencyTests-1612149189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-18f9341b-6423-492d-b491-02612804024b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:51:55 devstack sudo[105929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-18f9341b-6423-492d-b491-02612804024b
Jul 09 14:51:55 devstack sudo[105929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:51:55 devstack sudo[105929]: pam_unix(sudo:session): session closed for user root
Jul 09 14:51:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-69f4df75-00ad-4cca-98cd-0f1ec2b37654 tempest-VolumeDependencyTests-1612149189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-18f9341b-6423-492d-b491-02612804024b" returned: 0 in 0.724s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:51:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-69f4df75-00ad-4cca-98cd-0f1ec2b37654 tempest-VolumeDependencyTests-1612149189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-18f9341b-6423-492d-b491-02612804024b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:51:55 devstack sudo[105934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-18f9341b-6423-492d-b491-02612804024b
Jul 09 14:51:55 devstack sudo[105934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:51:56 devstack sudo[105934]: pam_unix(sudo:session): session closed for user root
Jul 09 14:51:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-69f4df75-00ad-4cca-98cd-0f1ec2b37654 tempest-VolumeDependencyTests-1612149189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-18f9341b-6423-492d-b491-02612804024b" returned: 0 in 0.636s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:51:56 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-69f4df75-00ad-4cca-98cd-0f1ec2b37654 tempest-VolumeDependencyTests-1612149189 None] Lock "cinder-quobyte-18f9341b-6423-492d-b491-02612804024b" released by "delete_volume" :: held 1.400s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:51:56 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-69f4df75-00ad-4cca-98cd-0f1ec2b37654 tempest-VolumeDependencyTests-1612149189 None] Created reservations ['a280fabe-e16d-47d9-8a58-c7e036be8088', 'c94050b0-b5de-4c74-ab80-c830553b418a', 'b1ecabf7-1e38-452d-96c6-e243d21c2b68', 'a66075a9-094a-4c69-b80a-c2532ac246f8'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:51:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-69f4df75-00ad-4cca-98cd-0f1ec2b37654 tempest-VolumeDependencyTests-1612149189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:51:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-69f4df75-00ad-4cca-98cd-0f1ec2b37654 tempest-VolumeDependencyTests-1612149189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:51:56 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-69f4df75-00ad-4cca-98cd-0f1ec2b37654 tempest-VolumeDependencyTests-1612149189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:51:56 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-69f4df75-00ad-4cca-98cd-0f1ec2b37654 tempest-VolumeDependencyTests-1612149189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:51:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-69f4df75-00ad-4cca-98cd-0f1ec2b37654 tempest-VolumeDependencyTests-1612149189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:51:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-69f4df75-00ad-4cca-98cd-0f1ec2b37654 tempest-VolumeDependencyTests-1612149189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:51:56 devstack sudo[105943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:51:56 devstack sudo[105943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:51:57 devstack sudo[105943]: pam_unix(sudo:session): session closed for user root
Jul 09 14:51:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-69f4df75-00ad-4cca-98cd-0f1ec2b37654 tempest-VolumeDependencyTests-1612149189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.653s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:51:57 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-69f4df75-00ad-4cca-98cd-0f1ec2b37654 tempest-VolumeDependencyTests-1612149189 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:51:57 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-69f4df75-00ad-4cca-98cd-0f1ec2b37654 tempest-VolumeDependencyTests-1612149189 None] Deleted volume successfully.
Jul 09 14:51:57 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-69f4df75-00ad-4cca-98cd-0f1ec2b37654 tempest-VolumeDependencyTests-1612149189 None] Lock "cinder-18f9341b-6423-492d-b491-02612804024b-delete_volume" released by "delete_volume" :: held 2.263s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:52:06 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=26,cinder:INSERT=7,cinder:UPDATE=26,cinder:DELETE=1 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 14:52:07 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=22,cinder:UPDATE=31,cinder:DELETE=4,cinder:INSERT=7 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 14:52:25 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-0787f971-db8b-4694-badd-7e4012d53a66 tempest-SnapshotDependencyTests-1314607688 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:52:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0787f971-db8b-4694-badd-7e4012d53a66 tempest-SnapshotDependencyTests-1314607688 None] Flow 'volume_create_manager' (54e89167-742c-4501-a011-55f79d1d9bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:52:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0787f971-db8b-4694-badd-7e4012d53a66 tempest-SnapshotDependencyTests-1314607688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7c5cfc2-9b98-4c3c-b2d5-113e4fe514b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:52:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0787f971-db8b-4694-badd-7e4012d53a66 tempest-SnapshotDependencyTests-1314607688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7c5cfc2-9b98-4c3c-b2d5-113e4fe514b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:52:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-132699715',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d4b7217-f49f-4899-92ef-0a8612100a11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84ff9d9c316a4706a77602b1c1937e6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:52:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:52:25Z,use_quota=True,user_id='d4c47667da4041bcaa8aff51ddfbec7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:52:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0787f971-db8b-4694-badd-7e4012d53a66 tempest-SnapshotDependencyTests-1314607688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6de65994-5f1e-4958-8822-f55f23d85ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:52:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0787f971-db8b-4694-badd-7e4012d53a66 tempest-SnapshotDependencyTests-1314607688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6de65994-5f1e-4958-8822-f55f23d85ed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:52:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0787f971-db8b-4694-badd-7e4012d53a66 tempest-SnapshotDependencyTests-1314607688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecf67d3f-f049-470f-8e1b-b195e34aa4e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:52:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0787f971-db8b-4694-badd-7e4012d53a66 tempest-SnapshotDependencyTests-1314607688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecf67d3f-f049-470f-8e1b-b195e34aa4e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d4b7217-f49f-4899-92ef-0a8612100a11', 'volume_name': 'volume-2d4b7217-f49f-4899-92ef-0a8612100a11', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:52:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0787f971-db8b-4694-badd-7e4012d53a66 tempest-SnapshotDependencyTests-1314607688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e77b802-48f2-4154-8bf0-3ca45acf4f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:52:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0787f971-db8b-4694-badd-7e4012d53a66 tempest-SnapshotDependencyTests-1314607688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e77b802-48f2-4154-8bf0-3ca45acf4f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:52:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0787f971-db8b-4694-badd-7e4012d53a66 tempest-SnapshotDependencyTests-1314607688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fb60773-2924-4d41-9789-976681416740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:52:25 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-0787f971-db8b-4694-badd-7e4012d53a66 tempest-SnapshotDependencyTests-1314607688 None] Volume 2d4b7217-f49f-4899-92ef-0a8612100a11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d4b7217-f49f-4899-92ef-0a8612100a11', 'volume_size': 1}
Jul 09 14:52:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0787f971-db8b-4694-badd-7e4012d53a66 tempest-SnapshotDependencyTests-1314607688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:52:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0787f971-db8b-4694-badd-7e4012d53a66 tempest-SnapshotDependencyTests-1314607688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:52:25 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-0787f971-db8b-4694-badd-7e4012d53a66 tempest-SnapshotDependencyTests-1314607688 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:52:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-132699715',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d4b7217-f49f-4899-92ef-0a8612100a11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84ff9d9c316a4706a77602b1c1937e6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:52:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:52:25Z,use_quota=True,user_id='d4c47667da4041bcaa8aff51ddfbec7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:52:25 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-0787f971-db8b-4694-badd-7e4012d53a66 tempest-SnapshotDependencyTests-1314607688 None] Creating volume 2d4b7217-f49f-4899-92ef-0a8612100a11 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:52:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0787f971-db8b-4694-badd-7e4012d53a66 tempest-SnapshotDependencyTests-1314607688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:52:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0787f971-db8b-4694-badd-7e4012d53a66 tempest-SnapshotDependencyTests-1314607688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:52:25 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-0787f971-db8b-4694-badd-7e4012d53a66 tempest-SnapshotDependencyTests-1314607688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:52:25 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-0787f971-db8b-4694-badd-7e4012d53a66 tempest-SnapshotDependencyTests-1314607688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:52:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0787f971-db8b-4694-badd-7e4012d53a66 tempest-SnapshotDependencyTests-1314607688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:52:25 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-0787f971-db8b-4694-badd-7e4012d53a66 tempest-SnapshotDependencyTests-1314607688 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:52:25 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-0787f971-db8b-4694-badd-7e4012d53a66 tempest-SnapshotDependencyTests-1314607688 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:52:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0787f971-db8b-4694-badd-7e4012d53a66 tempest-SnapshotDependencyTests-1314607688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d4b7217-f49f-4899-92ef-0a8612100a11 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:52:25 devstack sudo[105957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d4b7217-f49f-4899-92ef-0a8612100a11 1073741824
Jul 09 14:52:25 devstack sudo[105957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:52:26 devstack sudo[105957]: pam_unix(sudo:session): session closed for user root
Jul 09 14:52:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0787f971-db8b-4694-badd-7e4012d53a66 tempest-SnapshotDependencyTests-1314607688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d4b7217-f49f-4899-92ef-0a8612100a11 1073741824" returned: 0 in 0.787s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:52:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0787f971-db8b-4694-badd-7e4012d53a66 tempest-SnapshotDependencyTests-1314607688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d4b7217-f49f-4899-92ef-0a8612100a11 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:52:26 devstack sudo[105962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d4b7217-f49f-4899-92ef-0a8612100a11
Jul 09 14:52:26 devstack sudo[105962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:52:26 devstack sudo[105962]: pam_unix(sudo:session): session closed for user root
Jul 09 14:52:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0787f971-db8b-4694-badd-7e4012d53a66 tempest-SnapshotDependencyTests-1314607688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d4b7217-f49f-4899-92ef-0a8612100a11" returned: 0 in 0.627s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:52:26 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-0787f971-db8b-4694-badd-7e4012d53a66 tempest-SnapshotDependencyTests-1314607688 None] <== create_volume: return (1458ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:52:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0787f971-db8b-4694-badd-7e4012d53a66 tempest-SnapshotDependencyTests-1314607688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.461s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:52:27 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0787f971-db8b-4694-badd-7e4012d53a66 tempest-SnapshotDependencyTests-1314607688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fb60773-2924-4d41-9789-976681416740) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d4b7217-f49f-4899-92ef-0a8612100a11', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:52:27 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0787f971-db8b-4694-badd-7e4012d53a66 tempest-SnapshotDependencyTests-1314607688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39dcf60f-2269-46e5-ad3f-45e88e9fdac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:52:27 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-0787f971-db8b-4694-badd-7e4012d53a66 tempest-SnapshotDependencyTests-1314607688 None] Volume volume-2d4b7217-f49f-4899-92ef-0a8612100a11 (2d4b7217-f49f-4899-92ef-0a8612100a11): created successfully
Jul 09 14:52:27 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0787f971-db8b-4694-badd-7e4012d53a66 tempest-SnapshotDependencyTests-1314607688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39dcf60f-2269-46e5-ad3f-45e88e9fdac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:52:27 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0787f971-db8b-4694-badd-7e4012d53a66 tempest-SnapshotDependencyTests-1314607688 None] Flow 'volume_create_manager' (54e89167-742c-4501-a011-55f79d1d9bab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:52:27 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-0787f971-db8b-4694-badd-7e4012d53a66 tempest-SnapshotDependencyTests-1314607688 None] Created volume successfully.
Jul 09 14:52:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-213e4074-2ebd-40fe-8ff6-699ab52e23ce tempest-SnapshotDependencyTests-1314607688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:52:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-213e4074-2ebd-40fe-8ff6-699ab52e23ce tempest-SnapshotDependencyTests-1314607688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:52:27 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-213e4074-2ebd-40fe-8ff6-699ab52e23ce tempest-SnapshotDependencyTests-1314607688 None] Creating offline snapshot 8ed36f1b-6184-43dd-8924-000ea2ab83b4 of volume 2d4b7217-f49f-4899-92ef-0a8612100a11 {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 14:52:27 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[01048e5f-5025-4119-972a-d7ab3d388800]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:52:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-213e4074-2ebd-40fe-8ff6-699ab52e23ce tempest-SnapshotDependencyTests-1314607688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d4b7217-f49f-4899-92ef-0a8612100a11 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:52:27 devstack sudo[105965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d4b7217-f49f-4899-92ef-0a8612100a11
Jul 09 14:52:27 devstack sudo[105965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:52:28 devstack sudo[105965]: pam_unix(sudo:session): session closed for user root
Jul 09 14:52:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-213e4074-2ebd-40fe-8ff6-699ab52e23ce tempest-SnapshotDependencyTests-1314607688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d4b7217-f49f-4899-92ef-0a8612100a11" returned: 0 in 0.725s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:52:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-213e4074-2ebd-40fe-8ff6-699ab52e23ce tempest-SnapshotDependencyTests-1314607688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d4b7217-f49f-4899-92ef-0a8612100a11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d4b7217-f49f-4899-92ef-0a8612100a11.8ed36f1b-6184-43dd-8924-000ea2ab83b4 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:52:28 devstack sudo[105970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d4b7217-f49f-4899-92ef-0a8612100a11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d4b7217-f49f-4899-92ef-0a8612100a11.8ed36f1b-6184-43dd-8924-000ea2ab83b4 1G
Jul 09 14:52:28 devstack sudo[105970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:52:29 devstack sudo[105970]: pam_unix(sudo:session): session closed for user root
Jul 09 14:52:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-213e4074-2ebd-40fe-8ff6-699ab52e23ce tempest-SnapshotDependencyTests-1314607688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d4b7217-f49f-4899-92ef-0a8612100a11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d4b7217-f49f-4899-92ef-0a8612100a11.8ed36f1b-6184-43dd-8924-000ea2ab83b4 1G" returned: 0 in 0.792s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:52:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-213e4074-2ebd-40fe-8ff6-699ab52e23ce tempest-SnapshotDependencyTests-1314607688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d4b7217-f49f-4899-92ef-0a8612100a11 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d4b7217-f49f-4899-92ef-0a8612100a11.8ed36f1b-6184-43dd-8924-000ea2ab83b4 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:52:29 devstack sudo[105975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d4b7217-f49f-4899-92ef-0a8612100a11 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d4b7217-f49f-4899-92ef-0a8612100a11.8ed36f1b-6184-43dd-8924-000ea2ab83b4
Jul 09 14:52:29 devstack sudo[105975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:52:29 devstack sudo[105975]: pam_unix(sudo:session): session closed for user root
Jul 09 14:52:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-213e4074-2ebd-40fe-8ff6-699ab52e23ce tempest-SnapshotDependencyTests-1314607688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d4b7217-f49f-4899-92ef-0a8612100a11 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d4b7217-f49f-4899-92ef-0a8612100a11.8ed36f1b-6184-43dd-8924-000ea2ab83b4" returned: 0 in 0.685s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:52:29 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-213e4074-2ebd-40fe-8ff6-699ab52e23ce tempest-SnapshotDependencyTests-1314607688 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d4b7217-f49f-4899-92ef-0a8612100a11.8ed36f1b-6184-43dd-8924-000ea2ab83b4 is being set with open permissions: ugo+rw
Jul 09 14:52:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-213e4074-2ebd-40fe-8ff6-699ab52e23ce tempest-SnapshotDependencyTests-1314607688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d4b7217-f49f-4899-92ef-0a8612100a11.8ed36f1b-6184-43dd-8924-000ea2ab83b4 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:52:30 devstack sudo[105980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d4b7217-f49f-4899-92ef-0a8612100a11.8ed36f1b-6184-43dd-8924-000ea2ab83b4
Jul 09 14:52:30 devstack sudo[105980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:52:30 devstack sudo[105980]: pam_unix(sudo:session): session closed for user root
Jul 09 14:52:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-213e4074-2ebd-40fe-8ff6-699ab52e23ce tempest-SnapshotDependencyTests-1314607688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d4b7217-f49f-4899-92ef-0a8612100a11.8ed36f1b-6184-43dd-8924-000ea2ab83b4" returned: 0 in 0.642s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:52:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-213e4074-2ebd-40fe-8ff6-699ab52e23ce tempest-SnapshotDependencyTests-1314607688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d4b7217-f49f-4899-92ef-0a8612100a11.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:52:30 devstack sudo[105983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d4b7217-f49f-4899-92ef-0a8612100a11.info
Jul 09 14:52:30 devstack sudo[105983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:52:31 devstack sudo[105983]: pam_unix(sudo:session): session closed for user root
Jul 09 14:52:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-213e4074-2ebd-40fe-8ff6-699ab52e23ce tempest-SnapshotDependencyTests-1314607688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d4b7217-f49f-4899-92ef-0a8612100a11.info" returned: 0 in 0.648s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:52:31 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-213e4074-2ebd-40fe-8ff6-699ab52e23ce tempest-SnapshotDependencyTests-1314607688 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d4b7217-f49f-4899-92ef-0a8612100a11.info is being set with open permissions: ugo+rw
Jul 09 14:52:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-213e4074-2ebd-40fe-8ff6-699ab52e23ce tempest-SnapshotDependencyTests-1314607688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d4b7217-f49f-4899-92ef-0a8612100a11.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:52:31 devstack sudo[105987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d4b7217-f49f-4899-92ef-0a8612100a11.info
Jul 09 14:52:31 devstack sudo[105987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:52:31 devstack sudo[105987]: pam_unix(sudo:session): session closed for user root
Jul 09 14:52:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-213e4074-2ebd-40fe-8ff6-699ab52e23ce tempest-SnapshotDependencyTests-1314607688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d4b7217-f49f-4899-92ef-0a8612100a11.info" returned: 0 in 0.621s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:52:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-213e4074-2ebd-40fe-8ff6-699ab52e23ce tempest-SnapshotDependencyTests-1314607688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.198s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:52:31 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-213e4074-2ebd-40fe-8ff6-699ab52e23ce tempest-SnapshotDependencyTests-1314607688 None] Create snapshot completed successfully
Jul 09 14:52:33 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-71f59d4a-35a9-4061-b9f6-6bdce127fabd tempest-SnapshotDependencyTests-1314607688 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:52:33 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-71f59d4a-35a9-4061-b9f6-6bdce127fabd tempest-SnapshotDependencyTests-1314607688 None] Flow 'volume_create_manager' (d7dde8cc-5ed2-4d63-b4d7-c8d1c3daea6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:52:33 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-71f59d4a-35a9-4061-b9f6-6bdce127fabd tempest-SnapshotDependencyTests-1314607688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d2f40d2-21e6-4623-8cd9-339fba44e901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:52:33 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-71f59d4a-35a9-4061-b9f6-6bdce127fabd tempest-SnapshotDependencyTests-1314607688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d2f40d2-21e6-4623-8cd9-339fba44e901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:52:33Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c7380f8-8c48-43b2-8f7c-675c467b17af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84ff9d9c316a4706a77602b1c1937e6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:52:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8ed36f1b-6184-43dd-8924-000ea2ab83b4,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:52:33Z,use_quota=True,user_id='d4c47667da4041bcaa8aff51ddfbec7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:52:33 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-71f59d4a-35a9-4061-b9f6-6bdce127fabd tempest-SnapshotDependencyTests-1314607688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e19dccf-4c30-401f-9118-06a359c90bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:52:33 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-71f59d4a-35a9-4061-b9f6-6bdce127fabd tempest-SnapshotDependencyTests-1314607688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e19dccf-4c30-401f-9118-06a359c90bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:52:33 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-71f59d4a-35a9-4061-b9f6-6bdce127fabd tempest-SnapshotDependencyTests-1314607688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c5d2e42-533a-4fbf-9be9-b95ff59d7842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:52:33 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-71f59d4a-35a9-4061-b9f6-6bdce127fabd tempest-SnapshotDependencyTests-1314607688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c5d2e42-533a-4fbf-9be9-b95ff59d7842) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3c7380f8-8c48-43b2-8f7c-675c467b17af', 'volume_name': 'volume-3c7380f8-8c48-43b2-8f7c-675c467b17af', 'volume_size': 1, 'snapshot_id': '8ed36f1b-6184-43dd-8924-000ea2ab83b4'}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:52:33 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-71f59d4a-35a9-4061-b9f6-6bdce127fabd tempest-SnapshotDependencyTests-1314607688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8e4fe6e-6908-4b3c-b939-4f18731a51bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:52:33 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-71f59d4a-35a9-4061-b9f6-6bdce127fabd tempest-SnapshotDependencyTests-1314607688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8e4fe6e-6908-4b3c-b939-4f18731a51bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:52:33 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-71f59d4a-35a9-4061-b9f6-6bdce127fabd tempest-SnapshotDependencyTests-1314607688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2015564-d307-4ca6-8a43-4a78606cf9a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:52:33 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-71f59d4a-35a9-4061-b9f6-6bdce127fabd tempest-SnapshotDependencyTests-1314607688 None] Volume 3c7380f8-8c48-43b2-8f7c-675c467b17af: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3c7380f8-8c48-43b2-8f7c-675c467b17af', 'volume_size': 1, 'snapshot_id': '8ed36f1b-6184-43dd-8924-000ea2ab83b4'}
Jul 09 14:52:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-71f59d4a-35a9-4061-b9f6-6bdce127fabd tempest-SnapshotDependencyTests-1314607688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:52:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-71f59d4a-35a9-4061-b9f6-6bdce127fabd tempest-SnapshotDependencyTests-1314607688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:52:33 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-71f59d4a-35a9-4061-b9f6-6bdce127fabd tempest-SnapshotDependencyTests-1314607688 None] Acquiring lock "cinder-quobyte-8ed36f1b-6184-43dd-8924-000ea2ab83b4-3c7380f8-8c48-43b2-8f7c-675c467b17af" by "_create_volume_from_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:52:33 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-71f59d4a-35a9-4061-b9f6-6bdce127fabd tempest-SnapshotDependencyTests-1314607688 None] Lock "cinder-quobyte-8ed36f1b-6184-43dd-8924-000ea2ab83b4-3c7380f8-8c48-43b2-8f7c-675c467b17af" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:52:33 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-71f59d4a-35a9-4061-b9f6-6bdce127fabd tempest-SnapshotDependencyTests-1314607688 None] Creating volume 3c7380f8-8c48-43b2-8f7c-675c467b17af from snapshot 8ed36f1b-6184-43dd-8924-000ea2ab83b4 {{(pid=87230) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 09 14:52:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-71f59d4a-35a9-4061-b9f6-6bdce127fabd tempest-SnapshotDependencyTests-1314607688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:52:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-71f59d4a-35a9-4061-b9f6-6bdce127fabd tempest-SnapshotDependencyTests-1314607688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:52:33 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-71f59d4a-35a9-4061-b9f6-6bdce127fabd tempest-SnapshotDependencyTests-1314607688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:52:33 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-71f59d4a-35a9-4061-b9f6-6bdce127fabd tempest-SnapshotDependencyTests-1314607688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:52:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-71f59d4a-35a9-4061-b9f6-6bdce127fabd tempest-SnapshotDependencyTests-1314607688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:52:33 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-71f59d4a-35a9-4061-b9f6-6bdce127fabd tempest-SnapshotDependencyTests-1314607688 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:52:33 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-71f59d4a-35a9-4061-b9f6-6bdce127fabd tempest-SnapshotDependencyTests-1314607688 None] Acquiring lock "cinder-quobyte-3c7380f8-8c48-43b2-8f7c-675c467b17af" by "_copy_volume_from_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:52:33 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-71f59d4a-35a9-4061-b9f6-6bdce127fabd tempest-SnapshotDependencyTests-1314607688 None] Lock "cinder-quobyte-3c7380f8-8c48-43b2-8f7c-675c467b17af" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:52:33 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-71f59d4a-35a9-4061-b9f6-6bdce127fabd tempest-SnapshotDependencyTests-1314607688 None] snapshot: 8ed36f1b-6184-43dd-8924-000ea2ab83b4, volume: 3c7380f8-8c48-43b2-8f7c-675c467b17af,  {{(pid=87230) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 09 14:52:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-71f59d4a-35a9-4061-b9f6-6bdce127fabd tempest-SnapshotDependencyTests-1314607688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:52:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-71f59d4a-35a9-4061-b9f6-6bdce127fabd tempest-SnapshotDependencyTests-1314607688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:52:33 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-71f59d4a-35a9-4061-b9f6-6bdce127fabd tempest-SnapshotDependencyTests-1314607688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:52:33 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-71f59d4a-35a9-4061-b9f6-6bdce127fabd tempest-SnapshotDependencyTests-1314607688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:52:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-71f59d4a-35a9-4061-b9f6-6bdce127fabd tempest-SnapshotDependencyTests-1314607688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:52:33 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[5107c6af-0d5a-4163-9f79-8c67b4169a27]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:52:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-71f59d4a-35a9-4061-b9f6-6bdce127fabd tempest-SnapshotDependencyTests-1314607688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d4b7217-f49f-4899-92ef-0a8612100a11.8ed36f1b-6184-43dd-8924-000ea2ab83b4 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:52:33 devstack sudo[105990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d4b7217-f49f-4899-92ef-0a8612100a11.8ed36f1b-6184-43dd-8924-000ea2ab83b4
Jul 09 14:52:33 devstack sudo[105990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:52:34 devstack sudo[105990]: pam_unix(sudo:session): session closed for user root
Jul 09 14:52:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-71f59d4a-35a9-4061-b9f6-6bdce127fabd tempest-SnapshotDependencyTests-1314607688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d4b7217-f49f-4899-92ef-0a8612100a11.8ed36f1b-6184-43dd-8924-000ea2ab83b4" returned: 0 in 0.727s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:52:34 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-71f59d4a-35a9-4061-b9f6-6bdce127fabd tempest-SnapshotDependencyTests-1314607688 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2d4b7217-f49f-4899-92ef-0a8612100a11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 14:52:34 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-71f59d4a-35a9-4061-b9f6-6bdce127fabd tempest-SnapshotDependencyTests-1314607688 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d4b7217-f49f-4899-92ef-0a8612100a11 {{(pid=87230) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 09 14:52:34 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-71f59d4a-35a9-4061-b9f6-6bdce127fabd tempest-SnapshotDependencyTests-1314607688 None] Creating direct copy from snapshot {{(pid=87230) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 09 14:52:34 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7954d29-c876-4a9c-8313-5757d531e67f]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:52:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-71f59d4a-35a9-4061-b9f6-6bdce127fabd tempest-SnapshotDependencyTests-1314607688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d4b7217-f49f-4899-92ef-0a8612100a11 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:52:34 devstack sudo[105995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d4b7217-f49f-4899-92ef-0a8612100a11
Jul 09 14:52:34 devstack sudo[105995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:52:35 devstack sudo[105995]: pam_unix(sudo:session): session closed for user root
Jul 09 14:52:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-71f59d4a-35a9-4061-b9f6-6bdce127fabd tempest-SnapshotDependencyTests-1314607688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d4b7217-f49f-4899-92ef-0a8612100a11" returned: 0 in 0.790s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:52:35 devstack cinder-volume[87230]: DEBUG cinder.utils [None req-71f59d4a-35a9-4061-b9f6-6bdce127fabd tempest-SnapshotDependencyTests-1314607688 None] Path /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-3c7380f8-8c48-43b2-8f7c-675c467b17af not found in is_blk_device check {{(pid=87230) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 09 14:52:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-71f59d4a-35a9-4061-b9f6-6bdce127fabd tempest-SnapshotDependencyTests-1314607688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d4b7217-f49f-4899-92ef-0a8612100a11 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-3c7380f8-8c48-43b2-8f7c-675c467b17af {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:52:35 devstack sudo[106000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d4b7217-f49f-4899-92ef-0a8612100a11 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-3c7380f8-8c48-43b2-8f7c-675c467b17af
Jul 09 14:52:35 devstack sudo[106000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:52:39 devstack sudo[106000]: pam_unix(sudo:session): session closed for user root
Jul 09 14:52:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-71f59d4a-35a9-4061-b9f6-6bdce127fabd tempest-SnapshotDependencyTests-1314607688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d4b7217-f49f-4899-92ef-0a8612100a11 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-3c7380f8-8c48-43b2-8f7c-675c467b17af" returned: 0 in 4.424s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:52:39 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c7d2e04-0f0b-4d36-896b-bf07fc925439]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:52:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-71f59d4a-35a9-4061-b9f6-6bdce127fabd tempest-SnapshotDependencyTests-1314607688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d4b7217-f49f-4899-92ef-0a8612100a11 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:52:39 devstack sudo[106013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d4b7217-f49f-4899-92ef-0a8612100a11
Jul 09 14:52:39 devstack sudo[106013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:52:40 devstack sudo[106013]: pam_unix(sudo:session): session closed for user root
Jul 09 14:52:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-71f59d4a-35a9-4061-b9f6-6bdce127fabd tempest-SnapshotDependencyTests-1314607688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d4b7217-f49f-4899-92ef-0a8612100a11" returned: 0 in 0.906s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:52:40 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-71f59d4a-35a9-4061-b9f6-6bdce127fabd tempest-SnapshotDependencyTests-1314607688 None] Image conversion details: src /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d4b7217-f49f-4899-92ef-0a8612100a11, size 1024.00 MB, duration 4.43 sec, destination /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-3c7380f8-8c48-43b2-8f7c-675c467b17af {{(pid=87230) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 09 14:52:40 devstack cinder-volume[87230]: INFO cinder.image.image_utils [None req-71f59d4a-35a9-4061-b9f6-6bdce127fabd tempest-SnapshotDependencyTests-1314607688 None] Converted 1024.00 MB image at 231.34 MB/s
Jul 09 14:52:40 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-71f59d4a-35a9-4061-b9f6-6bdce127fabd tempest-SnapshotDependencyTests-1314607688 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-3c7380f8-8c48-43b2-8f7c-675c467b17af is being set with open permissions: ugo+rw
Jul 09 14:52:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-71f59d4a-35a9-4061-b9f6-6bdce127fabd tempest-SnapshotDependencyTests-1314607688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-3c7380f8-8c48-43b2-8f7c-675c467b17af {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:52:40 devstack sudo[106018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-3c7380f8-8c48-43b2-8f7c-675c467b17af
Jul 09 14:52:40 devstack sudo[106018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:52:41 devstack sudo[106018]: pam_unix(sudo:session): session closed for user root
Jul 09 14:52:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-71f59d4a-35a9-4061-b9f6-6bdce127fabd tempest-SnapshotDependencyTests-1314607688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-3c7380f8-8c48-43b2-8f7c-675c467b17af" returned: 0 in 0.607s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:52:41 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-71f59d4a-35a9-4061-b9f6-6bdce127fabd tempest-SnapshotDependencyTests-1314607688 None] Lock "cinder-quobyte-3c7380f8-8c48-43b2-8f7c-675c467b17af" released by "_copy_volume_from_snapshot" :: held 7.585s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:52:41 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-71f59d4a-35a9-4061-b9f6-6bdce127fabd tempest-SnapshotDependencyTests-1314607688 None] Lock "cinder-quobyte-8ed36f1b-6184-43dd-8924-000ea2ab83b4-3c7380f8-8c48-43b2-8f7c-675c467b17af" released by "_create_volume_from_snapshot" :: held 7.611s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:52:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-71f59d4a-35a9-4061-b9f6-6bdce127fabd tempest-SnapshotDependencyTests-1314607688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.626s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:52:41 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-71f59d4a-35a9-4061-b9f6-6bdce127fabd tempest-SnapshotDependencyTests-1314607688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2015564-d307-4ca6-8a43-4a78606cf9a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c7380f8-8c48-43b2-8f7c-675c467b17af', 'volume_size': 1, 'snapshot_id': '8ed36f1b-6184-43dd-8924-000ea2ab83b4'}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:52:41 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-71f59d4a-35a9-4061-b9f6-6bdce127fabd tempest-SnapshotDependencyTests-1314607688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5330066c-5ec0-4af8-b510-d1def802d03a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:52:41 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-71f59d4a-35a9-4061-b9f6-6bdce127fabd tempest-SnapshotDependencyTests-1314607688 None] Volume volume-3c7380f8-8c48-43b2-8f7c-675c467b17af (3c7380f8-8c48-43b2-8f7c-675c467b17af): created successfully
Jul 09 14:52:41 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-71f59d4a-35a9-4061-b9f6-6bdce127fabd tempest-SnapshotDependencyTests-1314607688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5330066c-5ec0-4af8-b510-d1def802d03a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:52:41 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-71f59d4a-35a9-4061-b9f6-6bdce127fabd tempest-SnapshotDependencyTests-1314607688 None] Flow 'volume_create_manager' (d7dde8cc-5ed2-4d63-b4d7-c8d1c3daea6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:52:41 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-71f59d4a-35a9-4061-b9f6-6bdce127fabd tempest-SnapshotDependencyTests-1314607688 None] Created volume successfully.
Jul 09 14:52:42 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b909a796-5aab-4800-a8d6-84fbaac1aa09 tempest-SnapshotDependencyTests-1314607688 None] Acquiring lock "cinder-8ed36f1b-6184-43dd-8924-000ea2ab83b4-delete_snapshot" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:52:42 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b909a796-5aab-4800-a8d6-84fbaac1aa09 tempest-SnapshotDependencyTests-1314607688 None] Lock "cinder-8ed36f1b-6184-43dd-8924-000ea2ab83b4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:52:42 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b909a796-5aab-4800-a8d6-84fbaac1aa09 tempest-SnapshotDependencyTests-1314607688 None] Acquiring lock "cinder-quobyte-2d4b7217-f49f-4899-92ef-0a8612100a11" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:52:42 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b909a796-5aab-4800-a8d6-84fbaac1aa09 tempest-SnapshotDependencyTests-1314607688 None] Lock "cinder-quobyte-2d4b7217-f49f-4899-92ef-0a8612100a11" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:52:42 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b909a796-5aab-4800-a8d6-84fbaac1aa09 tempest-SnapshotDependencyTests-1314607688 None] Acquiring lock "cinder-quobyte-8ed36f1b-6184-43dd-8924-000ea2ab83b4" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:52:42 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b909a796-5aab-4800-a8d6-84fbaac1aa09 tempest-SnapshotDependencyTests-1314607688 None] Lock "cinder-quobyte-8ed36f1b-6184-43dd-8924-000ea2ab83b4" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:52:42 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-b909a796-5aab-4800-a8d6-84fbaac1aa09 tempest-SnapshotDependencyTests-1314607688 None] Deleting offline snapshot 8ed36f1b-6184-43dd-8924-000ea2ab83b4 of volume 2d4b7217-f49f-4899-92ef-0a8612100a11 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 14:52:42 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-b909a796-5aab-4800-a8d6-84fbaac1aa09 tempest-SnapshotDependencyTests-1314607688 None] snapshot_file for this snap is: volume-2d4b7217-f49f-4899-92ef-0a8612100a11.8ed36f1b-6184-43dd-8924-000ea2ab83b4 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 14:52:42 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aa7cbab-0079-4dbd-b230-efe9cc2f5593]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:52:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b909a796-5aab-4800-a8d6-84fbaac1aa09 tempest-SnapshotDependencyTests-1314607688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d4b7217-f49f-4899-92ef-0a8612100a11.8ed36f1b-6184-43dd-8924-000ea2ab83b4 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:52:42 devstack sudo[106022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d4b7217-f49f-4899-92ef-0a8612100a11.8ed36f1b-6184-43dd-8924-000ea2ab83b4
Jul 09 14:52:42 devstack sudo[106022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:52:42 devstack sudo[106022]: pam_unix(sudo:session): session closed for user root
Jul 09 14:52:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b909a796-5aab-4800-a8d6-84fbaac1aa09 tempest-SnapshotDependencyTests-1314607688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d4b7217-f49f-4899-92ef-0a8612100a11.8ed36f1b-6184-43dd-8924-000ea2ab83b4" returned: 0 in 0.714s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:52:42 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-b909a796-5aab-4800-a8d6-84fbaac1aa09 tempest-SnapshotDependencyTests-1314607688 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2d4b7217-f49f-4899-92ef-0a8612100a11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 14:52:43 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef9843f6-bcef-46df-ad9e-eaac7b4f2132]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:52:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b909a796-5aab-4800-a8d6-84fbaac1aa09 tempest-SnapshotDependencyTests-1314607688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d4b7217-f49f-4899-92ef-0a8612100a11 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:52:43 devstack sudo[106027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d4b7217-f49f-4899-92ef-0a8612100a11
Jul 09 14:52:43 devstack sudo[106027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:52:43 devstack sudo[106027]: pam_unix(sudo:session): session closed for user root
Jul 09 14:52:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b909a796-5aab-4800-a8d6-84fbaac1aa09 tempest-SnapshotDependencyTests-1314607688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d4b7217-f49f-4899-92ef-0a8612100a11" returned: 0 in 0.727s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:52:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b909a796-5aab-4800-a8d6-84fbaac1aa09 tempest-SnapshotDependencyTests-1314607688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d4b7217-f49f-4899-92ef-0a8612100a11.8ed36f1b-6184-43dd-8924-000ea2ab83b4 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:52:43 devstack sudo[106032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d4b7217-f49f-4899-92ef-0a8612100a11.8ed36f1b-6184-43dd-8924-000ea2ab83b4
Jul 09 14:52:43 devstack sudo[106032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:52:44 devstack sudo[106032]: pam_unix(sudo:session): session closed for user root
Jul 09 14:52:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b909a796-5aab-4800-a8d6-84fbaac1aa09 tempest-SnapshotDependencyTests-1314607688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d4b7217-f49f-4899-92ef-0a8612100a11.8ed36f1b-6184-43dd-8924-000ea2ab83b4" returned: 0 in 0.703s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:52:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b909a796-5aab-4800-a8d6-84fbaac1aa09 tempest-SnapshotDependencyTests-1314607688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d4b7217-f49f-4899-92ef-0a8612100a11.8ed36f1b-6184-43dd-8924-000ea2ab83b4 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:52:44 devstack sudo[106037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d4b7217-f49f-4899-92ef-0a8612100a11.8ed36f1b-6184-43dd-8924-000ea2ab83b4
Jul 09 14:52:44 devstack sudo[106037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:52:45 devstack sudo[106037]: pam_unix(sudo:session): session closed for user root
Jul 09 14:52:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b909a796-5aab-4800-a8d6-84fbaac1aa09 tempest-SnapshotDependencyTests-1314607688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d4b7217-f49f-4899-92ef-0a8612100a11.8ed36f1b-6184-43dd-8924-000ea2ab83b4" returned: 0 in 0.636s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:52:45 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b909a796-5aab-4800-a8d6-84fbaac1aa09 tempest-SnapshotDependencyTests-1314607688 None] Lock "cinder-quobyte-8ed36f1b-6184-43dd-8924-000ea2ab83b4" released by "_delete_snapshot" :: held 2.870s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:52:45 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b909a796-5aab-4800-a8d6-84fbaac1aa09 tempest-SnapshotDependencyTests-1314607688 None] Lock "cinder-quobyte-2d4b7217-f49f-4899-92ef-0a8612100a11" released by "delete_snapshot" :: held 2.889s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:52:45 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-b909a796-5aab-4800-a8d6-84fbaac1aa09 tempest-SnapshotDependencyTests-1314607688 None] Created reservations ['f5b4b4ed-269e-4c7d-8636-42a5b22b0010', '1bf1b1c5-f734-40b2-a977-4b2cf0f4a350', 'daf4dd7a-ca8e-4a21-b35f-111a6ee57a8b', 'd3c5fdf7-3342-448b-b529-410d292e8b14'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:52:45 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-b909a796-5aab-4800-a8d6-84fbaac1aa09 tempest-SnapshotDependencyTests-1314607688 None] Delete snapshot completed successfully.
Jul 09 14:52:45 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b909a796-5aab-4800-a8d6-84fbaac1aa09 tempest-SnapshotDependencyTests-1314607688 None] Lock "cinder-8ed36f1b-6184-43dd-8924-000ea2ab83b4-delete_snapshot" released by "delete_snapshot" :: held 3.021s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:52:45 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7c4b36ee-4a20-44d6-9d14-a4325804603c tempest-SnapshotDependencyTests-1314607688 None] Acquiring lock "cinder-2d4b7217-f49f-4899-92ef-0a8612100a11-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:52:45 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7c4b36ee-4a20-44d6-9d14-a4325804603c tempest-SnapshotDependencyTests-1314607688 None] Lock "cinder-2d4b7217-f49f-4899-92ef-0a8612100a11-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:52:45 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7c4b36ee-4a20-44d6-9d14-a4325804603c tempest-SnapshotDependencyTests-1314607688 None] Acquiring lock "cinder-quobyte-2d4b7217-f49f-4899-92ef-0a8612100a11" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:52:45 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7c4b36ee-4a20-44d6-9d14-a4325804603c tempest-SnapshotDependencyTests-1314607688 None] Lock "cinder-quobyte-2d4b7217-f49f-4899-92ef-0a8612100a11" acquired by "delete_volume" :: waited 0.013s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:52:45 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf4efe8c-fe79-42de-ab1a-ab8a2fb7c50c]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:52:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7c4b36ee-4a20-44d6-9d14-a4325804603c tempest-SnapshotDependencyTests-1314607688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d4b7217-f49f-4899-92ef-0a8612100a11 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:52:45 devstack sudo[106040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d4b7217-f49f-4899-92ef-0a8612100a11
Jul 09 14:52:45 devstack sudo[106040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:52:46 devstack sudo[106040]: pam_unix(sudo:session): session closed for user root
Jul 09 14:52:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7c4b36ee-4a20-44d6-9d14-a4325804603c tempest-SnapshotDependencyTests-1314607688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d4b7217-f49f-4899-92ef-0a8612100a11" returned: 0 in 0.728s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:52:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7c4b36ee-4a20-44d6-9d14-a4325804603c tempest-SnapshotDependencyTests-1314607688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d4b7217-f49f-4899-92ef-0a8612100a11 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:52:46 devstack sudo[106045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d4b7217-f49f-4899-92ef-0a8612100a11
Jul 09 14:52:46 devstack sudo[106045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:52:46 devstack sudo[106045]: pam_unix(sudo:session): session closed for user root
Jul 09 14:52:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7c4b36ee-4a20-44d6-9d14-a4325804603c tempest-SnapshotDependencyTests-1314607688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d4b7217-f49f-4899-92ef-0a8612100a11" returned: 0 in 0.628s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:52:46 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7c4b36ee-4a20-44d6-9d14-a4325804603c tempest-SnapshotDependencyTests-1314607688 None] Lock "cinder-quobyte-2d4b7217-f49f-4899-92ef-0a8612100a11" released by "delete_volume" :: held 1.409s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:52:46 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-7c4b36ee-4a20-44d6-9d14-a4325804603c tempest-SnapshotDependencyTests-1314607688 None] Created reservations ['fe6d77b5-447a-4e91-bbc9-0ce2ffdf8835', '3c68e1f9-8279-418b-952b-79f0ab7ccfdc', '9801f39a-1f00-4c39-bf61-23034902a031', 'bccd68e4-15db-4080-b3bc-2ff7b2f0ad86'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:52:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7c4b36ee-4a20-44d6-9d14-a4325804603c tempest-SnapshotDependencyTests-1314607688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:52:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7c4b36ee-4a20-44d6-9d14-a4325804603c tempest-SnapshotDependencyTests-1314607688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:52:46 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7c4b36ee-4a20-44d6-9d14-a4325804603c tempest-SnapshotDependencyTests-1314607688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:52:46 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7c4b36ee-4a20-44d6-9d14-a4325804603c tempest-SnapshotDependencyTests-1314607688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:52:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7c4b36ee-4a20-44d6-9d14-a4325804603c tempest-SnapshotDependencyTests-1314607688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:52:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7c4b36ee-4a20-44d6-9d14-a4325804603c tempest-SnapshotDependencyTests-1314607688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:52:46 devstack sudo[106048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:52:46 devstack sudo[106048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:52:47 devstack sudo[106048]: pam_unix(sudo:session): session closed for user root
Jul 09 14:52:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7c4b36ee-4a20-44d6-9d14-a4325804603c tempest-SnapshotDependencyTests-1314607688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.633s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:52:47 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-7c4b36ee-4a20-44d6-9d14-a4325804603c tempest-SnapshotDependencyTests-1314607688 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:52:47 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-7c4b36ee-4a20-44d6-9d14-a4325804603c tempest-SnapshotDependencyTests-1314607688 None] Deleted volume successfully.
Jul 09 14:52:47 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8c916ce3-7921-464f-91a1-f2cd74b0ad36 tempest-SnapshotDependencyTests-1314607688 None] Acquiring lock "cinder-3c7380f8-8c48-43b2-8f7c-675c467b17af-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:52:47 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7c4b36ee-4a20-44d6-9d14-a4325804603c tempest-SnapshotDependencyTests-1314607688 None] Lock "cinder-2d4b7217-f49f-4899-92ef-0a8612100a11-delete_volume" released by "delete_volume" :: held 2.242s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:52:47 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8c916ce3-7921-464f-91a1-f2cd74b0ad36 tempest-SnapshotDependencyTests-1314607688 None] Lock "cinder-3c7380f8-8c48-43b2-8f7c-675c467b17af-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:52:47 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8c916ce3-7921-464f-91a1-f2cd74b0ad36 tempest-SnapshotDependencyTests-1314607688 None] Acquiring lock "cinder-quobyte-3c7380f8-8c48-43b2-8f7c-675c467b17af" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:52:47 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8c916ce3-7921-464f-91a1-f2cd74b0ad36 tempest-SnapshotDependencyTests-1314607688 None] Lock "cinder-quobyte-3c7380f8-8c48-43b2-8f7c-675c467b17af" acquired by "delete_volume" :: waited 0.015s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:52:47 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa351f7-b1ce-45c4-8aa4-418b1c9df5b3]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:52:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8c916ce3-7921-464f-91a1-f2cd74b0ad36 tempest-SnapshotDependencyTests-1314607688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-3c7380f8-8c48-43b2-8f7c-675c467b17af {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:52:47 devstack sudo[106087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-3c7380f8-8c48-43b2-8f7c-675c467b17af
Jul 09 14:52:47 devstack sudo[106087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:52:48 devstack sudo[106087]: pam_unix(sudo:session): session closed for user root
Jul 09 14:52:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8c916ce3-7921-464f-91a1-f2cd74b0ad36 tempest-SnapshotDependencyTests-1314607688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-3c7380f8-8c48-43b2-8f7c-675c467b17af" returned: 0 in 0.734s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:52:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8c916ce3-7921-464f-91a1-f2cd74b0ad36 tempest-SnapshotDependencyTests-1314607688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-3c7380f8-8c48-43b2-8f7c-675c467b17af {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:52:48 devstack sudo[106092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-3c7380f8-8c48-43b2-8f7c-675c467b17af
Jul 09 14:52:48 devstack sudo[106092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:52:49 devstack sudo[106092]: pam_unix(sudo:session): session closed for user root
Jul 09 14:52:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8c916ce3-7921-464f-91a1-f2cd74b0ad36 tempest-SnapshotDependencyTests-1314607688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-3c7380f8-8c48-43b2-8f7c-675c467b17af" returned: 0 in 0.624s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:52:49 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8c916ce3-7921-464f-91a1-f2cd74b0ad36 tempest-SnapshotDependencyTests-1314607688 None] Lock "cinder-quobyte-3c7380f8-8c48-43b2-8f7c-675c467b17af" released by "delete_volume" :: held 1.396s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:52:49 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-8c916ce3-7921-464f-91a1-f2cd74b0ad36 tempest-SnapshotDependencyTests-1314607688 None] Created reservations ['cde921db-c4c2-4fb5-8456-dbcc0b56a590', '1789e906-3a43-4e0f-ab4d-153c23317491', 'b98070d6-60c4-47d1-a414-30a7cf312a11', 'e7ee4b96-02e9-4ef1-b322-28a94810076c'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:52:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8c916ce3-7921-464f-91a1-f2cd74b0ad36 tempest-SnapshotDependencyTests-1314607688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:52:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8c916ce3-7921-464f-91a1-f2cd74b0ad36 tempest-SnapshotDependencyTests-1314607688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:52:49 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-8c916ce3-7921-464f-91a1-f2cd74b0ad36 tempest-SnapshotDependencyTests-1314607688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:52:49 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-8c916ce3-7921-464f-91a1-f2cd74b0ad36 tempest-SnapshotDependencyTests-1314607688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:52:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8c916ce3-7921-464f-91a1-f2cd74b0ad36 tempest-SnapshotDependencyTests-1314607688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:52:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8c916ce3-7921-464f-91a1-f2cd74b0ad36 tempest-SnapshotDependencyTests-1314607688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:52:49 devstack sudo[106095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:52:49 devstack sudo[106095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:52:49 devstack sudo[106095]: pam_unix(sudo:session): session closed for user root
Jul 09 14:52:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8c916ce3-7921-464f-91a1-f2cd74b0ad36 tempest-SnapshotDependencyTests-1314607688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.631s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:52:49 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-8c916ce3-7921-464f-91a1-f2cd74b0ad36 tempest-SnapshotDependencyTests-1314607688 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:52:49 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-8c916ce3-7921-464f-91a1-f2cd74b0ad36 tempest-SnapshotDependencyTests-1314607688 None] Deleted volume successfully.
Jul 09 14:52:49 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8c916ce3-7921-464f-91a1-f2cd74b0ad36 tempest-SnapshotDependencyTests-1314607688 None] Lock "cinder-3c7380f8-8c48-43b2-8f7c-675c467b17af-delete_volume" released by "delete_volume" :: held 2.216s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:52:52 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 14:52:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:52:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:52:52 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:52:52 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:52:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:52:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:52:52 devstack sudo[106101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:52:52 devstack sudo[106101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:52:53 devstack sudo[106101]: pam_unix(sudo:session): session closed for user root
Jul 09 14:52:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.661s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:52:53 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:52:53 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Running periodic task VolumeManager._thread_info {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 14:52:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] thread count: 28 {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 09 14:52:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] thread info: [<_MainThread(MainThread, started 125388812103808)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125388713797504)>, <Thread(Thread-3 (stat_writer), started daemon 125388699995392)>, <Thread(Rabbit-heartbeat, started daemon 125388700522560)>, <Thread(Thread-5 (_runner), started daemon 125388698545216)>, <Thread(Thread-7 (_runner), started daemon 125388698611264)>, <Thread(fd_logger, started daemon 125388703020672)>, <Thread(privsep_reader, started daemon 125388696441088)>, <Thread(tpool_thread_0, started daemon 125388687943360)>, <Thread(tpool_thread_1, started daemon 125388679550656)>, <Thread(tpool_thread_2, started daemon 125388671141568)>, <Thread(tpool_thread_3, started daemon 125388662732480)>, <Thread(tpool_thread_4, started daemon 125388654323392)>, <Thread(tpool_thread_5, started daemon 125388645914304)>, <Thread(tpool_thread_6, started daemon 125388637505216)>, <Thread(tpool_thread_7, started daemon 125388629096128)>, <Thread(tpool_thread_8, started daemon 125388620687040)>, <Thread(tpool_thread_9, started daemon 125388612277952)>, <Thread(tpool_thread_10, started daemon 125388603868864)>, <Thread(tpool_thread_11, started daemon 125388595459776)>, <Thread(tpool_thread_12, started daemon 125388587050688)>, <Thread(tpool_thread_13, started daemon 125388578641600)>, <Thread(tpool_thread_14, started daemon 125388570232512)>, <Thread(tpool_thread_15, started daemon 125388561823424)>, <Thread(tpool_thread_16, started daemon 125388553414336)>, <Thread(tpool_thread_17, started daemon 125388545005248)>, <Thread(tpool_thread_18, started daemon 125388536596160)>, <Thread(tpool_thread_19, started daemon 125388528187072)>] {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 09 14:52:59 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=23,cinder:UPDATE=32,cinder:DELETE=2,cinder:INSERT=6 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 14:52:59 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:UPDATE=24,cinder:SELECT=24,cinder:INSERT=8,cinder:DELETE=3 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 14:53:08 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2550b1c-b529-486f-a976-80ed12afcdc5 tempest-CinderUnicodeTest-607122583 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:53:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d2550b1c-b529-486f-a976-80ed12afcdc5 tempest-CinderUnicodeTest-607122583 None] Flow 'volume_create_manager' (90a332dd-f194-48eb-8486-c3e500371bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:53:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d2550b1c-b529-486f-a976-80ed12afcdc5 tempest-CinderUnicodeTest-607122583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99aa8cff-3fb4-42ff-b33a-d5ba224a9c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d2550b1c-b529-486f-a976-80ed12afcdc5 tempest-CinderUnicodeTest-607122583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99aa8cff-3fb4-42ff-b33a-d5ba224a9c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:53:08Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce2327e9-5644-45ef-92b1-f2daebecb605,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24568c9523c742d89793e3dca631fda5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:53:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:53:08Z,use_quota=True,user_id='756093edf00940e48ef58afb9cacdf58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d2550b1c-b529-486f-a976-80ed12afcdc5 tempest-CinderUnicodeTest-607122583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99b0fd3d-4803-4d12-8461-85f143b3baf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d2550b1c-b529-486f-a976-80ed12afcdc5 tempest-CinderUnicodeTest-607122583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99b0fd3d-4803-4d12-8461-85f143b3baf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d2550b1c-b529-486f-a976-80ed12afcdc5 tempest-CinderUnicodeTest-607122583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ff5ffbe-3197-4e2a-9041-e8e5afbd8052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d2550b1c-b529-486f-a976-80ed12afcdc5 tempest-CinderUnicodeTest-607122583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ff5ffbe-3197-4e2a-9041-e8e5afbd8052) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce2327e9-5644-45ef-92b1-f2daebecb605', 'volume_name': 'volume-ce2327e9-5644-45ef-92b1-f2daebecb605', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d2550b1c-b529-486f-a976-80ed12afcdc5 tempest-CinderUnicodeTest-607122583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0b743a5-814c-4b7a-a887-1e816b9b8055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d2550b1c-b529-486f-a976-80ed12afcdc5 tempest-CinderUnicodeTest-607122583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0b743a5-814c-4b7a-a887-1e816b9b8055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d2550b1c-b529-486f-a976-80ed12afcdc5 tempest-CinderUnicodeTest-607122583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (371a6477-fec2-4dea-8310-d2d993651291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:08 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-d2550b1c-b529-486f-a976-80ed12afcdc5 tempest-CinderUnicodeTest-607122583 None] Volume ce2327e9-5644-45ef-92b1-f2daebecb605: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce2327e9-5644-45ef-92b1-f2daebecb605', 'volume_size': 1}
Jul 09 14:53:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d2550b1c-b529-486f-a976-80ed12afcdc5 tempest-CinderUnicodeTest-607122583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:53:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d2550b1c-b529-486f-a976-80ed12afcdc5 tempest-CinderUnicodeTest-607122583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:53:08 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-d2550b1c-b529-486f-a976-80ed12afcdc5 tempest-CinderUnicodeTest-607122583 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:53:08Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce2327e9-5644-45ef-92b1-f2daebecb605,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24568c9523c742d89793e3dca631fda5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:53:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:53:08Z,use_quota=True,user_id='756093edf00940e48ef58afb9cacdf58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:53:08 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-d2550b1c-b529-486f-a976-80ed12afcdc5 tempest-CinderUnicodeTest-607122583 None] Creating volume ce2327e9-5644-45ef-92b1-f2daebecb605 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:53:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d2550b1c-b529-486f-a976-80ed12afcdc5 tempest-CinderUnicodeTest-607122583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:53:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d2550b1c-b529-486f-a976-80ed12afcdc5 tempest-CinderUnicodeTest-607122583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:53:08 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-d2550b1c-b529-486f-a976-80ed12afcdc5 tempest-CinderUnicodeTest-607122583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:53:08 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-d2550b1c-b529-486f-a976-80ed12afcdc5 tempest-CinderUnicodeTest-607122583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:53:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d2550b1c-b529-486f-a976-80ed12afcdc5 tempest-CinderUnicodeTest-607122583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:53:08 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-d2550b1c-b529-486f-a976-80ed12afcdc5 tempest-CinderUnicodeTest-607122583 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:53:08 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-d2550b1c-b529-486f-a976-80ed12afcdc5 tempest-CinderUnicodeTest-607122583 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:53:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d2550b1c-b529-486f-a976-80ed12afcdc5 tempest-CinderUnicodeTest-607122583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ce2327e9-5644-45ef-92b1-f2daebecb605 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:08 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd225ece-feb9-48f4-be2a-1416a9e1c049 tempest-VolumeDependencyTests-127658737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:53:08 devstack sudo[106151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ce2327e9-5644-45ef-92b1-f2daebecb605 1073741824
Jul 09 14:53:08 devstack sudo[106151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dd225ece-feb9-48f4-be2a-1416a9e1c049 tempest-VolumeDependencyTests-127658737 None] Flow 'volume_create_manager' (861fe37e-8476-485d-818c-3d2bb86fff83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:53:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dd225ece-feb9-48f4-be2a-1416a9e1c049 tempest-VolumeDependencyTests-127658737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89147bb6-e6cc-4cbc-a875-2c4faf6f4c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dd225ece-feb9-48f4-be2a-1416a9e1c049 tempest-VolumeDependencyTests-127658737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89147bb6-e6cc-4cbc-a875-2c4faf6f4c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:53:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1686586501',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cda90fb-b664-43b9-b3e1-12fc01b2c2d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8591320b8114379b492d10a426cf7ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:53:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:53:08Z,use_quota=True,user_id='86ec3b49149a4df9949243e07140c294',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dd225ece-feb9-48f4-be2a-1416a9e1c049 tempest-VolumeDependencyTests-127658737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (636769fb-e4a8-466f-89b1-da263717dcbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dd225ece-feb9-48f4-be2a-1416a9e1c049 tempest-VolumeDependencyTests-127658737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (636769fb-e4a8-466f-89b1-da263717dcbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dd225ece-feb9-48f4-be2a-1416a9e1c049 tempest-VolumeDependencyTests-127658737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62ff0671-17da-4ce7-abd2-5e5ac6cbd881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dd225ece-feb9-48f4-be2a-1416a9e1c049 tempest-VolumeDependencyTests-127658737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62ff0671-17da-4ce7-abd2-5e5ac6cbd881) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cda90fb-b664-43b9-b3e1-12fc01b2c2d2', 'volume_name': 'volume-7cda90fb-b664-43b9-b3e1-12fc01b2c2d2', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dd225ece-feb9-48f4-be2a-1416a9e1c049 tempest-VolumeDependencyTests-127658737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b719994-99e8-4136-9539-e83f9056e62e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dd225ece-feb9-48f4-be2a-1416a9e1c049 tempest-VolumeDependencyTests-127658737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b719994-99e8-4136-9539-e83f9056e62e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dd225ece-feb9-48f4-be2a-1416a9e1c049 tempest-VolumeDependencyTests-127658737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36e3a615-98b3-4aa6-932e-2445a9f6c911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:08 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-dd225ece-feb9-48f4-be2a-1416a9e1c049 tempest-VolumeDependencyTests-127658737 None] Volume 7cda90fb-b664-43b9-b3e1-12fc01b2c2d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cda90fb-b664-43b9-b3e1-12fc01b2c2d2', 'volume_size': 1}
Jul 09 14:53:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-dd225ece-feb9-48f4-be2a-1416a9e1c049 tempest-VolumeDependencyTests-127658737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:53:08 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bb55e71-c207-4f85-be9b-b3cf935c493b tempest-CreateVolumesFromImageTest-1713904690 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:53:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8bb55e71-c207-4f85-be9b-b3cf935c493b tempest-CreateVolumesFromImageTest-1713904690 None] Flow 'volume_create_manager' (5daecff9-aa8b-4f33-b119-022d5b1585db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:53:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8bb55e71-c207-4f85-be9b-b3cf935c493b tempest-CreateVolumesFromImageTest-1713904690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9fabca5-38ea-40e9-bf1c-faa8ce3008f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8bb55e71-c207-4f85-be9b-b3cf935c493b tempest-CreateVolumesFromImageTest-1713904690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9fabca5-38ea-40e9-bf1c-faa8ce3008f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:53:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1324635547',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c2b479e-4f53-416a-90d4-1abf8f2e6c0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06bddb20a1b94034bb4370c73c59bd80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:53:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:53:09Z,use_quota=True,user_id='f29b90b8aebd425e928bc623c16bd4df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8bb55e71-c207-4f85-be9b-b3cf935c493b tempest-CreateVolumesFromImageTest-1713904690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfcb4ef6-9f5d-477d-8195-cc8e96ad7ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8bb55e71-c207-4f85-be9b-b3cf935c493b tempest-CreateVolumesFromImageTest-1713904690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfcb4ef6-9f5d-477d-8195-cc8e96ad7ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8bb55e71-c207-4f85-be9b-b3cf935c493b tempest-CreateVolumesFromImageTest-1713904690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4685f628-32ae-4f5e-bc97-1ecb95d00deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:09 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8bb55e71-c207-4f85-be9b-b3cf935c493b tempest-CreateVolumesFromImageTest-1713904690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4685f628-32ae-4f5e-bc97-1ecb95d00deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c2b479e-4f53-416a-90d4-1abf8f2e6c0a', 'volume_name': 'volume-7c2b479e-4f53-416a-90d4-1abf8f2e6c0a', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:09 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8bb55e71-c207-4f85-be9b-b3cf935c493b tempest-CreateVolumesFromImageTest-1713904690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44eadc76-a2dd-4ec3-ab1d-f8ea79ff4866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:09 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8bb55e71-c207-4f85-be9b-b3cf935c493b tempest-CreateVolumesFromImageTest-1713904690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44eadc76-a2dd-4ec3-ab1d-f8ea79ff4866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:09 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8bb55e71-c207-4f85-be9b-b3cf935c493b tempest-CreateVolumesFromImageTest-1713904690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40beeb6f-5509-424a-876a-13026e181b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:09 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-8bb55e71-c207-4f85-be9b-b3cf935c493b tempest-CreateVolumesFromImageTest-1713904690 None] Volume 7c2b479e-4f53-416a-90d4-1abf8f2e6c0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c2b479e-4f53-416a-90d4-1abf8f2e6c0a', 'volume_size': 1}
Jul 09 14:53:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8bb55e71-c207-4f85-be9b-b3cf935c493b tempest-CreateVolumesFromImageTest-1713904690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:53:09 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-8811e0f2-e9fd-43f0-8768-059551eb6329 tempest-CreateVolumesFromImageTest-1713904690 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:53:09 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8811e0f2-e9fd-43f0-8768-059551eb6329 tempest-CreateVolumesFromImageTest-1713904690 None] Flow 'volume_create_manager' (7baf4590-a0f7-44ea-aebb-b00338aa2f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:53:09 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8811e0f2-e9fd-43f0-8768-059551eb6329 tempest-CreateVolumesFromImageTest-1713904690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5109d040-5d8e-4ad5-8365-6c6ed2687705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:09 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8811e0f2-e9fd-43f0-8768-059551eb6329 tempest-CreateVolumesFromImageTest-1713904690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5109d040-5d8e-4ad5-8365-6c6ed2687705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:53:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-682815305',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66e5a3a3-d617-4606-b0e7-dea19fa325a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06bddb20a1b94034bb4370c73c59bd80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:53:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:53:09Z,use_quota=True,user_id='f29b90b8aebd425e928bc623c16bd4df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:09 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8811e0f2-e9fd-43f0-8768-059551eb6329 tempest-CreateVolumesFromImageTest-1713904690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (981324b8-953f-4423-adde-1815f8aff923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:09 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8811e0f2-e9fd-43f0-8768-059551eb6329 tempest-CreateVolumesFromImageTest-1713904690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (981324b8-953f-4423-adde-1815f8aff923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:09 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8811e0f2-e9fd-43f0-8768-059551eb6329 tempest-CreateVolumesFromImageTest-1713904690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6d017fe-1157-4a66-ae87-43fb7acd8181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:09 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8811e0f2-e9fd-43f0-8768-059551eb6329 tempest-CreateVolumesFromImageTest-1713904690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6d017fe-1157-4a66-ae87-43fb7acd8181) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66e5a3a3-d617-4606-b0e7-dea19fa325a5', 'volume_name': 'volume-66e5a3a3-d617-4606-b0e7-dea19fa325a5', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:09 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8811e0f2-e9fd-43f0-8768-059551eb6329 tempest-CreateVolumesFromImageTest-1713904690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d9dea3c-ec86-4d9f-94cd-9e98b9506c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:09 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8811e0f2-e9fd-43f0-8768-059551eb6329 tempest-CreateVolumesFromImageTest-1713904690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d9dea3c-ec86-4d9f-94cd-9e98b9506c4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:09 devstack sudo[106151]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:09 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8811e0f2-e9fd-43f0-8768-059551eb6329 tempest-CreateVolumesFromImageTest-1713904690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41462972-f79f-4d3b-834d-35ab8644518f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:09 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-8811e0f2-e9fd-43f0-8768-059551eb6329 tempest-CreateVolumesFromImageTest-1713904690 None] Volume 66e5a3a3-d617-4606-b0e7-dea19fa325a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66e5a3a3-d617-4606-b0e7-dea19fa325a5', 'volume_size': 1}
Jul 09 14:53:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8811e0f2-e9fd-43f0-8768-059551eb6329 tempest-CreateVolumesFromImageTest-1713904690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:53:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d2550b1c-b529-486f-a976-80ed12afcdc5 tempest-CinderUnicodeTest-607122583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ce2327e9-5644-45ef-92b1-f2daebecb605 1073741824" returned: 0 in 1.079s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d2550b1c-b529-486f-a976-80ed12afcdc5 tempest-CinderUnicodeTest-607122583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ce2327e9-5644-45ef-92b1-f2daebecb605 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:09 devstack sudo[106158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ce2327e9-5644-45ef-92b1-f2daebecb605
Jul 09 14:53:09 devstack sudo[106158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:09 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4cb3293-e0e4-467e-a98b-543425e27d17 tempest-CreateVolumesFromImageTest-1713904690 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:53:09 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c4cb3293-e0e4-467e-a98b-543425e27d17 tempest-CreateVolumesFromImageTest-1713904690 None] Flow 'volume_create_manager' (17197b9d-1b35-4a92-81b7-8464166d0b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:53:09 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c4cb3293-e0e4-467e-a98b-543425e27d17 tempest-CreateVolumesFromImageTest-1713904690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (869bbafb-4076-4841-8763-8ffec7c93663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:09 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c4cb3293-e0e4-467e-a98b-543425e27d17 tempest-CreateVolumesFromImageTest-1713904690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (869bbafb-4076-4841-8763-8ffec7c93663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:53:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1700296417',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7271dfd-55c6-4b2a-995e-a4238575a2d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06bddb20a1b94034bb4370c73c59bd80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:53:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:53:10Z,use_quota=True,user_id='f29b90b8aebd425e928bc623c16bd4df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:09 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c4cb3293-e0e4-467e-a98b-543425e27d17 tempest-CreateVolumesFromImageTest-1713904690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4a3be56-9993-446b-a38b-7afd0e7f838d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:09 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c4cb3293-e0e4-467e-a98b-543425e27d17 tempest-CreateVolumesFromImageTest-1713904690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4a3be56-9993-446b-a38b-7afd0e7f838d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:09 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c4cb3293-e0e4-467e-a98b-543425e27d17 tempest-CreateVolumesFromImageTest-1713904690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d264d4b4-d2b2-4929-b145-2640dd0cfb72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:09 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c4cb3293-e0e4-467e-a98b-543425e27d17 tempest-CreateVolumesFromImageTest-1713904690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d264d4b4-d2b2-4929-b145-2640dd0cfb72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7271dfd-55c6-4b2a-995e-a4238575a2d5', 'volume_name': 'volume-b7271dfd-55c6-4b2a-995e-a4238575a2d5', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:09 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c4cb3293-e0e4-467e-a98b-543425e27d17 tempest-CreateVolumesFromImageTest-1713904690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff3dfead-548c-4cf4-8113-6ba27b1ec538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:09 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c4cb3293-e0e4-467e-a98b-543425e27d17 tempest-CreateVolumesFromImageTest-1713904690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff3dfead-548c-4cf4-8113-6ba27b1ec538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:09 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c4cb3293-e0e4-467e-a98b-543425e27d17 tempest-CreateVolumesFromImageTest-1713904690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (433a2a62-0251-441d-8665-71bb56d49b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:09 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-c4cb3293-e0e4-467e-a98b-543425e27d17 tempest-CreateVolumesFromImageTest-1713904690 None] Volume b7271dfd-55c6-4b2a-995e-a4238575a2d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7271dfd-55c6-4b2a-995e-a4238575a2d5', 'volume_size': 1}
Jul 09 14:53:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c4cb3293-e0e4-467e-a98b-543425e27d17 tempest-CreateVolumesFromImageTest-1713904690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:53:10 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a2c66ad-e4bf-424e-9c63-7ffe59b6ae1c tempest-CreateVolumesFromImageTest-1713904690 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:53:10 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5a2c66ad-e4bf-424e-9c63-7ffe59b6ae1c tempest-CreateVolumesFromImageTest-1713904690 None] Flow 'volume_create_manager' (c2716512-03af-48a4-8dc4-c3df912e1742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:53:10 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5a2c66ad-e4bf-424e-9c63-7ffe59b6ae1c tempest-CreateVolumesFromImageTest-1713904690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8aca7bfb-d1bc-4527-b095-d5ca097926c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:10 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5a2c66ad-e4bf-424e-9c63-7ffe59b6ae1c tempest-CreateVolumesFromImageTest-1713904690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8aca7bfb-d1bc-4527-b095-d5ca097926c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:53:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1524555005',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51534b4e-e458-443c-bd83-eda491c134bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06bddb20a1b94034bb4370c73c59bd80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:53:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:53:10Z,use_quota=True,user_id='f29b90b8aebd425e928bc623c16bd4df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:10 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5a2c66ad-e4bf-424e-9c63-7ffe59b6ae1c tempest-CreateVolumesFromImageTest-1713904690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c69d2570-b2ba-4ce0-82d7-d1580a7ae2b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:10 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5a2c66ad-e4bf-424e-9c63-7ffe59b6ae1c tempest-CreateVolumesFromImageTest-1713904690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c69d2570-b2ba-4ce0-82d7-d1580a7ae2b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:10 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5a2c66ad-e4bf-424e-9c63-7ffe59b6ae1c tempest-CreateVolumesFromImageTest-1713904690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0430f4e9-b535-4178-9e60-8af297a866a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:10 devstack sudo[106158]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:10 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5a2c66ad-e4bf-424e-9c63-7ffe59b6ae1c tempest-CreateVolumesFromImageTest-1713904690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0430f4e9-b535-4178-9e60-8af297a866a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51534b4e-e458-443c-bd83-eda491c134bb', 'volume_name': 'volume-51534b4e-e458-443c-bd83-eda491c134bb', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:10 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5a2c66ad-e4bf-424e-9c63-7ffe59b6ae1c tempest-CreateVolumesFromImageTest-1713904690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf7aceb8-71ee-4c57-9bff-b5677913839e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:10 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5a2c66ad-e4bf-424e-9c63-7ffe59b6ae1c tempest-CreateVolumesFromImageTest-1713904690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf7aceb8-71ee-4c57-9bff-b5677913839e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:10 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5a2c66ad-e4bf-424e-9c63-7ffe59b6ae1c tempest-CreateVolumesFromImageTest-1713904690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ee0899e-5a43-409d-bd0b-1f67855276f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:10 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-5a2c66ad-e4bf-424e-9c63-7ffe59b6ae1c tempest-CreateVolumesFromImageTest-1713904690 None] Volume 51534b4e-e458-443c-bd83-eda491c134bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51534b4e-e458-443c-bd83-eda491c134bb', 'volume_size': 1}
Jul 09 14:53:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5a2c66ad-e4bf-424e-9c63-7ffe59b6ae1c tempest-CreateVolumesFromImageTest-1713904690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:53:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d2550b1c-b529-486f-a976-80ed12afcdc5 tempest-CinderUnicodeTest-607122583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ce2327e9-5644-45ef-92b1-f2daebecb605" returned: 0 in 0.896s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:10 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-d2550b1c-b529-486f-a976-80ed12afcdc5 tempest-CinderUnicodeTest-607122583 None] <== create_volume: return (2015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:53:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d2550b1c-b529-486f-a976-80ed12afcdc5 tempest-CinderUnicodeTest-607122583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.019s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:53:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-dd225ece-feb9-48f4-be2a-1416a9e1c049 tempest-VolumeDependencyTests-127658737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.873s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:53:10 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-dd225ece-feb9-48f4-be2a-1416a9e1c049 tempest-VolumeDependencyTests-127658737 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:53:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1686586501',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cda90fb-b664-43b9-b3e1-12fc01b2c2d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8591320b8114379b492d10a426cf7ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:53:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:53:08Z,use_quota=True,user_id='86ec3b49149a4df9949243e07140c294',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:53:10 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-dd225ece-feb9-48f4-be2a-1416a9e1c049 tempest-VolumeDependencyTests-127658737 None] Creating volume 7cda90fb-b664-43b9-b3e1-12fc01b2c2d2 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:53:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-dd225ece-feb9-48f4-be2a-1416a9e1c049 tempest-VolumeDependencyTests-127658737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:53:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-dd225ece-feb9-48f4-be2a-1416a9e1c049 tempest-VolumeDependencyTests-127658737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:53:10 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-dd225ece-feb9-48f4-be2a-1416a9e1c049 tempest-VolumeDependencyTests-127658737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:53:10 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-dd225ece-feb9-48f4-be2a-1416a9e1c049 tempest-VolumeDependencyTests-127658737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:53:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-dd225ece-feb9-48f4-be2a-1416a9e1c049 tempest-VolumeDependencyTests-127658737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:53:10 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-dd225ece-feb9-48f4-be2a-1416a9e1c049 tempest-VolumeDependencyTests-127658737 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:53:10 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-dd225ece-feb9-48f4-be2a-1416a9e1c049 tempest-VolumeDependencyTests-127658737 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:53:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dd225ece-feb9-48f4-be2a-1416a9e1c049 tempest-VolumeDependencyTests-127658737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7cda90fb-b664-43b9-b3e1-12fc01b2c2d2 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:10 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d2550b1c-b529-486f-a976-80ed12afcdc5 tempest-CinderUnicodeTest-607122583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (371a6477-fec2-4dea-8310-d2d993651291) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce2327e9-5644-45ef-92b1-f2daebecb605', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:10 devstack sudo[106161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7cda90fb-b664-43b9-b3e1-12fc01b2c2d2 1073741824
Jul 09 14:53:10 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d2550b1c-b529-486f-a976-80ed12afcdc5 tempest-CinderUnicodeTest-607122583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ca629b4-526c-4154-871a-bfde70f941c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:10 devstack sudo[106161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:10 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-d2550b1c-b529-486f-a976-80ed12afcdc5 tempest-CinderUnicodeTest-607122583 None] Volume volume-ce2327e9-5644-45ef-92b1-f2daebecb605 (ce2327e9-5644-45ef-92b1-f2daebecb605): created successfully
Jul 09 14:53:10 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d2550b1c-b529-486f-a976-80ed12afcdc5 tempest-CinderUnicodeTest-607122583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ca629b4-526c-4154-871a-bfde70f941c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:10 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d2550b1c-b529-486f-a976-80ed12afcdc5 tempest-CinderUnicodeTest-607122583 None] Flow 'volume_create_manager' (90a332dd-f194-48eb-8486-c3e500371bd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:53:10 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-d2550b1c-b529-486f-a976-80ed12afcdc5 tempest-CinderUnicodeTest-607122583 None] Created volume successfully.
Jul 09 14:53:10 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-6aea2ba8-5904-496d-8650-45430735a459 tempest-CreateVolumesFromImageTest-1713904690 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:53:10 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6aea2ba8-5904-496d-8650-45430735a459 tempest-CreateVolumesFromImageTest-1713904690 None] Flow 'volume_create_manager' (91d039b5-711f-4d76-ad60-c2ee110e19bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:53:10 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6aea2ba8-5904-496d-8650-45430735a459 tempest-CreateVolumesFromImageTest-1713904690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c79b379d-3c51-4a6f-8141-698e8fd4c809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:10 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6aea2ba8-5904-496d-8650-45430735a459 tempest-CreateVolumesFromImageTest-1713904690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c79b379d-3c51-4a6f-8141-698e8fd4c809) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:53:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-331834510',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0209ba5b-0a7c-40fc-9b05-771a8292992b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06bddb20a1b94034bb4370c73c59bd80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:53:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:53:11Z,use_quota=True,user_id='f29b90b8aebd425e928bc623c16bd4df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:10 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6aea2ba8-5904-496d-8650-45430735a459 tempest-CreateVolumesFromImageTest-1713904690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41f04e7d-387d-4d2b-a411-d207cb503909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:10 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6aea2ba8-5904-496d-8650-45430735a459 tempest-CreateVolumesFromImageTest-1713904690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41f04e7d-387d-4d2b-a411-d207cb503909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:10 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6aea2ba8-5904-496d-8650-45430735a459 tempest-CreateVolumesFromImageTest-1713904690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2d5d377-8e24-4663-bf15-ae7f3a5f8fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:10 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6aea2ba8-5904-496d-8650-45430735a459 tempest-CreateVolumesFromImageTest-1713904690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2d5d377-8e24-4663-bf15-ae7f3a5f8fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0209ba5b-0a7c-40fc-9b05-771a8292992b', 'volume_name': 'volume-0209ba5b-0a7c-40fc-9b05-771a8292992b', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:10 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6aea2ba8-5904-496d-8650-45430735a459 tempest-CreateVolumesFromImageTest-1713904690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (293de6fc-51a8-4f61-b75d-366deb3318c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:10 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6aea2ba8-5904-496d-8650-45430735a459 tempest-CreateVolumesFromImageTest-1713904690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (293de6fc-51a8-4f61-b75d-366deb3318c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:10 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6aea2ba8-5904-496d-8650-45430735a459 tempest-CreateVolumesFromImageTest-1713904690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a476895c-eefa-4cc4-a949-b8db4508a275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:10 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-6aea2ba8-5904-496d-8650-45430735a459 tempest-CreateVolumesFromImageTest-1713904690 None] Volume 0209ba5b-0a7c-40fc-9b05-771a8292992b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0209ba5b-0a7c-40fc-9b05-771a8292992b', 'volume_size': 1}
Jul 09 14:53:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6aea2ba8-5904-496d-8650-45430735a459 tempest-CreateVolumesFromImageTest-1713904690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:53:11 devstack sudo[106161]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dd225ece-feb9-48f4-be2a-1416a9e1c049 tempest-VolumeDependencyTests-127658737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7cda90fb-b664-43b9-b3e1-12fc01b2c2d2 1073741824" returned: 0 in 0.952s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dd225ece-feb9-48f4-be2a-1416a9e1c049 tempest-VolumeDependencyTests-127658737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7cda90fb-b664-43b9-b3e1-12fc01b2c2d2 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:11 devstack sudo[106168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7cda90fb-b664-43b9-b3e1-12fc01b2c2d2
Jul 09 14:53:11 devstack sudo[106168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:11 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-2116708f-da49-426d-a204-2c873a03703f tempest-CinderUnicodeTest-607122583 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:53:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2116708f-da49-426d-a204-2c873a03703f tempest-CinderUnicodeTest-607122583 None] Flow 'volume_create_manager' (59dd6126-4625-4ce5-9f73-209bc3917c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:53:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2116708f-da49-426d-a204-2c873a03703f tempest-CinderUnicodeTest-607122583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (def78331-dff2-4edc-b4d1-48e1f113a044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2116708f-da49-426d-a204-2c873a03703f tempest-CinderUnicodeTest-607122583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (def78331-dff2-4edc-b4d1-48e1f113a044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:53:12Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-544509767',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9c9cfb7-0efa-46c7-827e-00985aee96d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24568c9523c742d89793e3dca631fda5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:53:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:53:12Z,use_quota=True,user_id='756093edf00940e48ef58afb9cacdf58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2116708f-da49-426d-a204-2c873a03703f tempest-CinderUnicodeTest-607122583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00cd8ba7-d2d0-4b41-be95-823010f77963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2116708f-da49-426d-a204-2c873a03703f tempest-CinderUnicodeTest-607122583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00cd8ba7-d2d0-4b41-be95-823010f77963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2116708f-da49-426d-a204-2c873a03703f tempest-CinderUnicodeTest-607122583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (120e8b1a-b8f9-4a2a-b4fa-37c5518fb25a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2116708f-da49-426d-a204-2c873a03703f tempest-CinderUnicodeTest-607122583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (120e8b1a-b8f9-4a2a-b4fa-37c5518fb25a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9c9cfb7-0efa-46c7-827e-00985aee96d6', 'volume_name': 'volume-e9c9cfb7-0efa-46c7-827e-00985aee96d6', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2116708f-da49-426d-a204-2c873a03703f tempest-CinderUnicodeTest-607122583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c912cd2-2432-49e6-8e94-99bc91d5c077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2116708f-da49-426d-a204-2c873a03703f tempest-CinderUnicodeTest-607122583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c912cd2-2432-49e6-8e94-99bc91d5c077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2116708f-da49-426d-a204-2c873a03703f tempest-CinderUnicodeTest-607122583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41b96705-9695-442e-bcb8-e284642a52ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:12 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-2116708f-da49-426d-a204-2c873a03703f tempest-CinderUnicodeTest-607122583 None] Volume e9c9cfb7-0efa-46c7-827e-00985aee96d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9c9cfb7-0efa-46c7-827e-00985aee96d6', 'volume_size': 1}
Jul 09 14:53:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-2116708f-da49-426d-a204-2c873a03703f tempest-CinderUnicodeTest-607122583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:53:12 devstack sudo[106168]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dd225ece-feb9-48f4-be2a-1416a9e1c049 tempest-VolumeDependencyTests-127658737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7cda90fb-b664-43b9-b3e1-12fc01b2c2d2" returned: 0 in 0.775s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:12 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-dd225ece-feb9-48f4-be2a-1416a9e1c049 tempest-VolumeDependencyTests-127658737 None] <== create_volume: return (1787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:53:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-dd225ece-feb9-48f4-be2a-1416a9e1c049 tempest-VolumeDependencyTests-127658737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.790s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:53:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8bb55e71-c207-4f85-be9b-b3cf935c493b tempest-CreateVolumesFromImageTest-1713904690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.203s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:53:12 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-8bb55e71-c207-4f85-be9b-b3cf935c493b tempest-CreateVolumesFromImageTest-1713904690 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:53:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1324635547',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c2b479e-4f53-416a-90d4-1abf8f2e6c0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06bddb20a1b94034bb4370c73c59bd80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:53:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:53:09Z,use_quota=True,user_id='f29b90b8aebd425e928bc623c16bd4df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:53:12 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-8bb55e71-c207-4f85-be9b-b3cf935c493b tempest-CreateVolumesFromImageTest-1713904690 None] Creating volume 7c2b479e-4f53-416a-90d4-1abf8f2e6c0a {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:53:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8bb55e71-c207-4f85-be9b-b3cf935c493b tempest-CreateVolumesFromImageTest-1713904690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:53:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8bb55e71-c207-4f85-be9b-b3cf935c493b tempest-CreateVolumesFromImageTest-1713904690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:53:12 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-8bb55e71-c207-4f85-be9b-b3cf935c493b tempest-CreateVolumesFromImageTest-1713904690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:53:12 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-8bb55e71-c207-4f85-be9b-b3cf935c493b tempest-CreateVolumesFromImageTest-1713904690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:53:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8bb55e71-c207-4f85-be9b-b3cf935c493b tempest-CreateVolumesFromImageTest-1713904690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:53:12 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-8bb55e71-c207-4f85-be9b-b3cf935c493b tempest-CreateVolumesFromImageTest-1713904690 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:53:12 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-8bb55e71-c207-4f85-be9b-b3cf935c493b tempest-CreateVolumesFromImageTest-1713904690 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:53:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8bb55e71-c207-4f85-be9b-b3cf935c493b tempest-CreateVolumesFromImageTest-1713904690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7c2b479e-4f53-416a-90d4-1abf8f2e6c0a 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:12 devstack sudo[106171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7c2b479e-4f53-416a-90d4-1abf8f2e6c0a 1073741824
Jul 09 14:53:12 devstack sudo[106171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dd225ece-feb9-48f4-be2a-1416a9e1c049 tempest-VolumeDependencyTests-127658737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36e3a615-98b3-4aa6-932e-2445a9f6c911) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cda90fb-b664-43b9-b3e1-12fc01b2c2d2', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dd225ece-feb9-48f4-be2a-1416a9e1c049 tempest-VolumeDependencyTests-127658737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc81cc2f-49ec-4688-8cad-2cf255279609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:12 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-ceb8ace3-2997-4271-b7cd-4be2fbf90a6f tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:53:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ceb8ace3-2997-4271-b7cd-4be2fbf90a6f tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] Flow 'volume_create_manager' (368d8354-b91d-48fa-9b29-6a39011b63ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:53:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ceb8ace3-2997-4271-b7cd-4be2fbf90a6f tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3beab3fc-dca0-4c3d-8925-2f658071791b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:12 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-dd225ece-feb9-48f4-be2a-1416a9e1c049 tempest-VolumeDependencyTests-127658737 None] Volume volume-7cda90fb-b664-43b9-b3e1-12fc01b2c2d2 (7cda90fb-b664-43b9-b3e1-12fc01b2c2d2): created successfully
Jul 09 14:53:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dd225ece-feb9-48f4-be2a-1416a9e1c049 tempest-VolumeDependencyTests-127658737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc81cc2f-49ec-4688-8cad-2cf255279609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dd225ece-feb9-48f4-be2a-1416a9e1c049 tempest-VolumeDependencyTests-127658737 None] Flow 'volume_create_manager' (861fe37e-8476-485d-818c-3d2bb86fff83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:53:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ceb8ace3-2997-4271-b7cd-4be2fbf90a6f tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3beab3fc-dca0-4c3d-8925-2f658071791b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:53:12Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc0e4b6d-d47b-4b03-b243-55cf2200346b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb91c0c23721478ba70cc66bfc4d5371',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:53:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:53:12Z,use_quota=True,user_id='fbd3c79858434fe4b148942aff249141',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(526f2c5e-ffc8-4a75-92c5-9cb1b37c63c9),volume_type_id=526f2c5e-ffc8-4a75-92c5-9cb1b37c63c9)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ceb8ace3-2997-4271-b7cd-4be2fbf90a6f tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2afafcae-f802-4fda-a060-386c0ab66b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ceb8ace3-2997-4271-b7cd-4be2fbf90a6f tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2afafcae-f802-4fda-a060-386c0ab66b2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ceb8ace3-2997-4271-b7cd-4be2fbf90a6f tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d974196-bd72-45c8-983c-7e9516f6c7d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:12 devstack cinder-volume[87230]: DEBUG cinder.image.glance [None req-ceb8ace3-2997-4271-b7cd-4be2fbf90a6f tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] Creating Keystone auth plugin from conf {{(pid=87230) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 09 14:53:12 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-dd225ece-feb9-48f4-be2a-1416a9e1c049 tempest-VolumeDependencyTests-127658737 None] Created volume successfully.
Jul 09 14:53:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ceb8ace3-2997-4271-b7cd-4be2fbf90a6f tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d974196-bd72-45c8-983c-7e9516f6c7d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'dc0e4b6d-d47b-4b03-b243-55cf2200346b', 'volume_name': 'volume-dc0e4b6d-d47b-4b03-b243-55cf2200346b', 'volume_size': 1, 'image_id': '9d926e91-885e-425a-9cc2-e85a7e01ea15', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9d926e91-885e-425a-9cc2-e85a7e01ea15', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '66d61230757634401b4dfa86ce0e7a7a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bb91c0c23721478ba70cc66bfc4d5371', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '10f2980dbf80b2a32a9aff338303d7990600a889f4caf88417db7345b4c2246cba5e5edbd56ec070bb089c13668dde10efc9cb29509c07afa54fb9885eeba54a', 'id': '9d926e91-885e-425a-9cc2-e85a7e01ea15', 'created_at': datetime.datetime(2026, 7, 9, 12, 53, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 12, 53, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9d926e91-885e-425a-9cc2-e85a7e01ea15/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x720a54d61a90>}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ceb8ace3-2997-4271-b7cd-4be2fbf90a6f tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5813937-cbd4-4a1a-9b28-3c8a539119b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ceb8ace3-2997-4271-b7cd-4be2fbf90a6f tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5813937-cbd4-4a1a-9b28-3c8a539119b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ceb8ace3-2997-4271-b7cd-4be2fbf90a6f tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ae040ed-744d-47ce-8e07-55391bc773c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:12 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-ceb8ace3-2997-4271-b7cd-4be2fbf90a6f tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] Volume dc0e4b6d-d47b-4b03-b243-55cf2200346b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-dc0e4b6d-d47b-4b03-b243-55cf2200346b', 'volume_size': 1, 'image_id': '9d926e91-885e-425a-9cc2-e85a7e01ea15', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9d926e91-885e-425a-9cc2-e85a7e01ea15', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '66d61230757634401b4dfa86ce0e7a7a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bb91c0c23721478ba70cc66bfc4d5371', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '10f2980dbf80b2a32a9aff338303d7990600a889f4caf88417db7345b4c2246cba5e5edbd56ec070bb089c13668dde10efc9cb29509c07afa54fb9885eeba54a', 'id': '9d926e91-885e-425a-9cc2-e85a7e01ea15', 'created_at': datetime.datetime(2026, 7, 9, 12, 53, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 12, 53, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9d926e91-885e-425a-9cc2-e85a7e01ea15/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x720a54d61a90>}
Jul 09 14:53:12 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-ceb8ace3-2997-4271-b7cd-4be2fbf90a6f tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] Trying to clone dc0e4b6d-d47b-4b03-b243-55cf2200346b from image 9d926e91-885e-425a-9cc2-e85a7e01ea15 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9d926e91-885e-425a-9cc2-e85a7e01ea15', 'metadata': {}}]). {{(pid=87230) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 09 14:53:12 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-ceb8ace3-2997-4271-b7cd-4be2fbf90a6f tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9d926e91-885e-425a-9cc2-e85a7e01ea15_zruez0fddevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87230) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 09 14:53:12 devstack cinder-volume[87230]: INFO cinder.image.image_utils [None req-ceb8ace3-2997-4271-b7cd-4be2fbf90a6f tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] Image download 0.00 MB at 0.00 MB/s
Jul 09 14:53:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-de44e550-1a3f-4650-94c6-ad57ecf9914f tempest-VolumeDependencyTests-127658737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:53:12 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0cccc4f-541d-4f62-808a-d82a136fdf13]: (4, 'raw') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:53:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ceb8ace3-2997-4271-b7cd-4be2fbf90a6f tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9d926e91-885e-425a-9cc2-e85a7e01ea15_zruez0fddevstack@QuobyteHD {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:13 devstack sudo[106176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9d926e91-885e-425a-9cc2-e85a7e01ea15_zruez0fddevstack@QuobyteHD
Jul 09 14:53:13 devstack sudo[106176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:13 devstack sudo[106171]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8bb55e71-c207-4f85-be9b-b3cf935c493b tempest-CreateVolumesFromImageTest-1713904690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7c2b479e-4f53-416a-90d4-1abf8f2e6c0a 1073741824" returned: 0 in 0.931s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8bb55e71-c207-4f85-be9b-b3cf935c493b tempest-CreateVolumesFromImageTest-1713904690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7c2b479e-4f53-416a-90d4-1abf8f2e6c0a {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:13 devstack sudo[106179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7c2b479e-4f53-416a-90d4-1abf8f2e6c0a
Jul 09 14:53:13 devstack sudo[106179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:13 devstack sudo[106176]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ceb8ace3-2997-4271-b7cd-4be2fbf90a6f tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9d926e91-885e-425a-9cc2-e85a7e01ea15_zruez0fddevstack@QuobyteHD" returned: 0 in 0.780s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ceb8ace3-2997-4271-b7cd-4be2fbf90a6f tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9d926e91-885e-425a-9cc2-e85a7e01ea15_zruez0fddevstack@QuobyteHD {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:13 devstack sudo[106183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9d926e91-885e-425a-9cc2-e85a7e01ea15_zruez0fddevstack@QuobyteHD
Jul 09 14:53:13 devstack sudo[106183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:13 devstack sudo[106179]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8bb55e71-c207-4f85-be9b-b3cf935c493b tempest-CreateVolumesFromImageTest-1713904690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7c2b479e-4f53-416a-90d4-1abf8f2e6c0a" returned: 0 in 0.662s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:13 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-8bb55e71-c207-4f85-be9b-b3cf935c493b tempest-CreateVolumesFromImageTest-1713904690 None] <== create_volume: return (1636ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:53:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8bb55e71-c207-4f85-be9b-b3cf935c493b tempest-CreateVolumesFromImageTest-1713904690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.638s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:53:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8811e0f2-e9fd-43f0-8768-059551eb6329 tempest-CreateVolumesFromImageTest-1713904690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.370s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:53:13 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-8811e0f2-e9fd-43f0-8768-059551eb6329 tempest-CreateVolumesFromImageTest-1713904690 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:53:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-682815305',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66e5a3a3-d617-4606-b0e7-dea19fa325a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06bddb20a1b94034bb4370c73c59bd80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:53:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:53:09Z,use_quota=True,user_id='f29b90b8aebd425e928bc623c16bd4df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:53:13 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-8811e0f2-e9fd-43f0-8768-059551eb6329 tempest-CreateVolumesFromImageTest-1713904690 None] Creating volume 66e5a3a3-d617-4606-b0e7-dea19fa325a5 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:53:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8811e0f2-e9fd-43f0-8768-059551eb6329 tempest-CreateVolumesFromImageTest-1713904690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:53:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8811e0f2-e9fd-43f0-8768-059551eb6329 tempest-CreateVolumesFromImageTest-1713904690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:53:13 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-8811e0f2-e9fd-43f0-8768-059551eb6329 tempest-CreateVolumesFromImageTest-1713904690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:53:13 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-8811e0f2-e9fd-43f0-8768-059551eb6329 tempest-CreateVolumesFromImageTest-1713904690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:53:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8811e0f2-e9fd-43f0-8768-059551eb6329 tempest-CreateVolumesFromImageTest-1713904690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:53:13 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-8811e0f2-e9fd-43f0-8768-059551eb6329 tempest-CreateVolumesFromImageTest-1713904690 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:53:13 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-8811e0f2-e9fd-43f0-8768-059551eb6329 tempest-CreateVolumesFromImageTest-1713904690 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:53:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8811e0f2-e9fd-43f0-8768-059551eb6329 tempest-CreateVolumesFromImageTest-1713904690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-66e5a3a3-d617-4606-b0e7-dea19fa325a5 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:13 devstack sudo[106186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-66e5a3a3-d617-4606-b0e7-dea19fa325a5 1073741824
Jul 09 14:53:13 devstack sudo[106186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:13 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8bb55e71-c207-4f85-be9b-b3cf935c493b tempest-CreateVolumesFromImageTest-1713904690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40beeb6f-5509-424a-876a-13026e181b8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c2b479e-4f53-416a-90d4-1abf8f2e6c0a', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:13 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8bb55e71-c207-4f85-be9b-b3cf935c493b tempest-CreateVolumesFromImageTest-1713904690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd866bdb-3b63-41b2-8fd3-305a4905d41f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:13 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-8bb55e71-c207-4f85-be9b-b3cf935c493b tempest-CreateVolumesFromImageTest-1713904690 None] Volume volume-7c2b479e-4f53-416a-90d4-1abf8f2e6c0a (7c2b479e-4f53-416a-90d4-1abf8f2e6c0a): created successfully
Jul 09 14:53:13 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8bb55e71-c207-4f85-be9b-b3cf935c493b tempest-CreateVolumesFromImageTest-1713904690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd866bdb-3b63-41b2-8fd3-305a4905d41f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:13 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8bb55e71-c207-4f85-be9b-b3cf935c493b tempest-CreateVolumesFromImageTest-1713904690 None] Flow 'volume_create_manager' (5daecff9-aa8b-4f33-b119-022d5b1585db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:53:13 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-8bb55e71-c207-4f85-be9b-b3cf935c493b tempest-CreateVolumesFromImageTest-1713904690 None] Created volume successfully.
Jul 09 14:53:14 devstack sudo[106183]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ceb8ace3-2997-4271-b7cd-4be2fbf90a6f tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9d926e91-885e-425a-9cc2-e85a7e01ea15_zruez0fddevstack@QuobyteHD" returned: 1 in 0.728s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ceb8ace3-2997-4271-b7cd-4be2fbf90a6f tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9d926e91-885e-425a-9cc2-e85a7e01ea15_zruez0fddevstack@QuobyteHD' failed. Not Retrying. {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 09 14:53:14 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-ceb8ace3-2997-4271-b7cd-4be2fbf90a6f tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] Temporary image 9d926e91-885e-425a-9cc2-e85a7e01ea15 is fetched for user fbd3c79858434fe4b148942aff249141. {{(pid=87230) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 09 14:53:14 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ea88ea9-73d8-43dd-914d-e3cfdb4e57eb]: (4, 'raw') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:53:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ceb8ace3-2997-4271-b7cd-4be2fbf90a6f tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9d926e91-885e-425a-9cc2-e85a7e01ea15_zruez0fddevstack@QuobyteHD {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:14 devstack sudo[106194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9d926e91-885e-425a-9cc2-e85a7e01ea15_zruez0fddevstack@QuobyteHD
Jul 09 14:53:14 devstack sudo[106194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:14 devstack sudo[106186]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8811e0f2-e9fd-43f0-8768-059551eb6329 tempest-CreateVolumesFromImageTest-1713904690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-66e5a3a3-d617-4606-b0e7-dea19fa325a5 1073741824" returned: 0 in 0.838s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8811e0f2-e9fd-43f0-8768-059551eb6329 tempest-CreateVolumesFromImageTest-1713904690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-66e5a3a3-d617-4606-b0e7-dea19fa325a5 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:14 devstack sudo[106197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-66e5a3a3-d617-4606-b0e7-dea19fa325a5
Jul 09 14:53:14 devstack sudo[106197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:15 devstack sudo[106194]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ceb8ace3-2997-4271-b7cd-4be2fbf90a6f tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9d926e91-885e-425a-9cc2-e85a7e01ea15_zruez0fddevstack@QuobyteHD" returned: 0 in 0.737s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ceb8ace3-2997-4271-b7cd-4be2fbf90a6f tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9d926e91-885e-425a-9cc2-e85a7e01ea15_zruez0fddevstack@QuobyteHD {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:15 devstack sudo[106201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9d926e91-885e-425a-9cc2-e85a7e01ea15_zruez0fddevstack@QuobyteHD
Jul 09 14:53:15 devstack sudo[106201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:15 devstack sudo[106197]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8811e0f2-e9fd-43f0-8768-059551eb6329 tempest-CreateVolumesFromImageTest-1713904690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-66e5a3a3-d617-4606-b0e7-dea19fa325a5" returned: 0 in 0.658s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:15 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-8811e0f2-e9fd-43f0-8768-059551eb6329 tempest-CreateVolumesFromImageTest-1713904690 None] <== create_volume: return (1536ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:53:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8811e0f2-e9fd-43f0-8768-059551eb6329 tempest-CreateVolumesFromImageTest-1713904690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.538s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:53:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c4cb3293-e0e4-467e-a98b-543425e27d17 tempest-CreateVolumesFromImageTest-1713904690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.484s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:53:15 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-c4cb3293-e0e4-467e-a98b-543425e27d17 tempest-CreateVolumesFromImageTest-1713904690 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:53:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1700296417',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7271dfd-55c6-4b2a-995e-a4238575a2d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06bddb20a1b94034bb4370c73c59bd80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:53:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:53:10Z,use_quota=True,user_id='f29b90b8aebd425e928bc623c16bd4df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:53:15 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-c4cb3293-e0e4-467e-a98b-543425e27d17 tempest-CreateVolumesFromImageTest-1713904690 None] Creating volume b7271dfd-55c6-4b2a-995e-a4238575a2d5 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:53:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c4cb3293-e0e4-467e-a98b-543425e27d17 tempest-CreateVolumesFromImageTest-1713904690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:53:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c4cb3293-e0e4-467e-a98b-543425e27d17 tempest-CreateVolumesFromImageTest-1713904690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:53:15 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-c4cb3293-e0e4-467e-a98b-543425e27d17 tempest-CreateVolumesFromImageTest-1713904690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:53:15 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-c4cb3293-e0e4-467e-a98b-543425e27d17 tempest-CreateVolumesFromImageTest-1713904690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:53:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c4cb3293-e0e4-467e-a98b-543425e27d17 tempest-CreateVolumesFromImageTest-1713904690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:53:15 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-c4cb3293-e0e4-467e-a98b-543425e27d17 tempest-CreateVolumesFromImageTest-1713904690 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:53:15 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-c4cb3293-e0e4-467e-a98b-543425e27d17 tempest-CreateVolumesFromImageTest-1713904690 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:53:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c4cb3293-e0e4-467e-a98b-543425e27d17 tempest-CreateVolumesFromImageTest-1713904690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b7271dfd-55c6-4b2a-995e-a4238575a2d5 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:15 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8811e0f2-e9fd-43f0-8768-059551eb6329 tempest-CreateVolumesFromImageTest-1713904690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41462972-f79f-4d3b-834d-35ab8644518f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66e5a3a3-d617-4606-b0e7-dea19fa325a5', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:15 devstack sudo[106204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b7271dfd-55c6-4b2a-995e-a4238575a2d5 1073741824
Jul 09 14:53:15 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8811e0f2-e9fd-43f0-8768-059551eb6329 tempest-CreateVolumesFromImageTest-1713904690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c761ad0-5aab-47ea-88e8-0801a083eab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:15 devstack sudo[106204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:15 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-8811e0f2-e9fd-43f0-8768-059551eb6329 tempest-CreateVolumesFromImageTest-1713904690 None] Volume volume-66e5a3a3-d617-4606-b0e7-dea19fa325a5 (66e5a3a3-d617-4606-b0e7-dea19fa325a5): created successfully
Jul 09 14:53:15 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8811e0f2-e9fd-43f0-8768-059551eb6329 tempest-CreateVolumesFromImageTest-1713904690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c761ad0-5aab-47ea-88e8-0801a083eab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:15 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8811e0f2-e9fd-43f0-8768-059551eb6329 tempest-CreateVolumesFromImageTest-1713904690 None] Flow 'volume_create_manager' (7baf4590-a0f7-44ea-aebb-b00338aa2f95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:53:15 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-8811e0f2-e9fd-43f0-8768-059551eb6329 tempest-CreateVolumesFromImageTest-1713904690 None] Created volume successfully.
Jul 09 14:53:15 devstack sudo[106201]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ceb8ace3-2997-4271-b7cd-4be2fbf90a6f tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9d926e91-885e-425a-9cc2-e85a7e01ea15_zruez0fddevstack@QuobyteHD" returned: 1 in 0.741s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ceb8ace3-2997-4271-b7cd-4be2fbf90a6f tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9d926e91-885e-425a-9cc2-e85a7e01ea15_zruez0fddevstack@QuobyteHD' failed. Not Retrying. {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 09 14:53:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-ceb8ace3-2997-4271-b7cd-4be2fbf90a6f tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:53:16 devstack sudo[106204]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c4cb3293-e0e4-467e-a98b-543425e27d17 tempest-CreateVolumesFromImageTest-1713904690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b7271dfd-55c6-4b2a-995e-a4238575a2d5 1073741824" returned: 0 in 0.803s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c4cb3293-e0e4-467e-a98b-543425e27d17 tempest-CreateVolumesFromImageTest-1713904690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b7271dfd-55c6-4b2a-995e-a4238575a2d5 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:16 devstack sudo[106213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b7271dfd-55c6-4b2a-995e-a4238575a2d5
Jul 09 14:53:16 devstack sudo[106213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:16 devstack sudo[106213]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c4cb3293-e0e4-467e-a98b-543425e27d17 tempest-CreateVolumesFromImageTest-1713904690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b7271dfd-55c6-4b2a-995e-a4238575a2d5" returned: 0 in 0.632s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:16 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-c4cb3293-e0e4-467e-a98b-543425e27d17 tempest-CreateVolumesFromImageTest-1713904690 None] <== create_volume: return (1475ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:53:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c4cb3293-e0e4-467e-a98b-543425e27d17 tempest-CreateVolumesFromImageTest-1713904690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.478s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:53:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5a2c66ad-e4bf-424e-9c63-7ffe59b6ae1c tempest-CreateVolumesFromImageTest-1713904690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.467s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:53:16 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-5a2c66ad-e4bf-424e-9c63-7ffe59b6ae1c tempest-CreateVolumesFromImageTest-1713904690 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:53:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1524555005',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51534b4e-e458-443c-bd83-eda491c134bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06bddb20a1b94034bb4370c73c59bd80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:53:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:53:10Z,use_quota=True,user_id='f29b90b8aebd425e928bc623c16bd4df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:53:16 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-5a2c66ad-e4bf-424e-9c63-7ffe59b6ae1c tempest-CreateVolumesFromImageTest-1713904690 None] Creating volume 51534b4e-e458-443c-bd83-eda491c134bb {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:53:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5a2c66ad-e4bf-424e-9c63-7ffe59b6ae1c tempest-CreateVolumesFromImageTest-1713904690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:53:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5a2c66ad-e4bf-424e-9c63-7ffe59b6ae1c tempest-CreateVolumesFromImageTest-1713904690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:53:16 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-5a2c66ad-e4bf-424e-9c63-7ffe59b6ae1c tempest-CreateVolumesFromImageTest-1713904690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:53:16 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-5a2c66ad-e4bf-424e-9c63-7ffe59b6ae1c tempest-CreateVolumesFromImageTest-1713904690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:53:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5a2c66ad-e4bf-424e-9c63-7ffe59b6ae1c tempest-CreateVolumesFromImageTest-1713904690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:53:16 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-5a2c66ad-e4bf-424e-9c63-7ffe59b6ae1c tempest-CreateVolumesFromImageTest-1713904690 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:53:16 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-5a2c66ad-e4bf-424e-9c63-7ffe59b6ae1c tempest-CreateVolumesFromImageTest-1713904690 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:53:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5a2c66ad-e4bf-424e-9c63-7ffe59b6ae1c tempest-CreateVolumesFromImageTest-1713904690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-51534b4e-e458-443c-bd83-eda491c134bb 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:16 devstack sudo[106216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-51534b4e-e458-443c-bd83-eda491c134bb 1073741824
Jul 09 14:53:16 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c4cb3293-e0e4-467e-a98b-543425e27d17 tempest-CreateVolumesFromImageTest-1713904690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (433a2a62-0251-441d-8665-71bb56d49b4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7271dfd-55c6-4b2a-995e-a4238575a2d5', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:16 devstack sudo[106216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:16 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c4cb3293-e0e4-467e-a98b-543425e27d17 tempest-CreateVolumesFromImageTest-1713904690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78de8fd3-a543-451b-b8c4-cb8acd42e5f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:16 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-c4cb3293-e0e4-467e-a98b-543425e27d17 tempest-CreateVolumesFromImageTest-1713904690 None] Volume volume-b7271dfd-55c6-4b2a-995e-a4238575a2d5 (b7271dfd-55c6-4b2a-995e-a4238575a2d5): created successfully
Jul 09 14:53:16 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c4cb3293-e0e4-467e-a98b-543425e27d17 tempest-CreateVolumesFromImageTest-1713904690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78de8fd3-a543-451b-b8c4-cb8acd42e5f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:16 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c4cb3293-e0e4-467e-a98b-543425e27d17 tempest-CreateVolumesFromImageTest-1713904690 None] Flow 'volume_create_manager' (17197b9d-1b35-4a92-81b7-8464166d0b50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:53:16 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-c4cb3293-e0e4-467e-a98b-543425e27d17 tempest-CreateVolumesFromImageTest-1713904690 None] Created volume successfully.
Jul 09 14:53:17 devstack sudo[106216]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5a2c66ad-e4bf-424e-9c63-7ffe59b6ae1c tempest-CreateVolumesFromImageTest-1713904690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-51534b4e-e458-443c-bd83-eda491c134bb 1073741824" returned: 0 in 0.821s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5a2c66ad-e4bf-424e-9c63-7ffe59b6ae1c tempest-CreateVolumesFromImageTest-1713904690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-51534b4e-e458-443c-bd83-eda491c134bb {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:17 devstack sudo[106221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-51534b4e-e458-443c-bd83-eda491c134bb
Jul 09 14:53:17 devstack sudo[106221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:18 devstack sudo[106221]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5a2c66ad-e4bf-424e-9c63-7ffe59b6ae1c tempest-CreateVolumesFromImageTest-1713904690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-51534b4e-e458-443c-bd83-eda491c134bb" returned: 0 in 0.647s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:18 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-5a2c66ad-e4bf-424e-9c63-7ffe59b6ae1c tempest-CreateVolumesFromImageTest-1713904690 None] <== create_volume: return (1507ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:53:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5a2c66ad-e4bf-424e-9c63-7ffe59b6ae1c tempest-CreateVolumesFromImageTest-1713904690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.509s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:53:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6aea2ba8-5904-496d-8650-45430735a459 tempest-CreateVolumesFromImageTest-1713904690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.644s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:53:18 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-6aea2ba8-5904-496d-8650-45430735a459 tempest-CreateVolumesFromImageTest-1713904690 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:53:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-331834510',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0209ba5b-0a7c-40fc-9b05-771a8292992b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06bddb20a1b94034bb4370c73c59bd80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:53:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:53:11Z,use_quota=True,user_id='f29b90b8aebd425e928bc623c16bd4df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:53:18 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-6aea2ba8-5904-496d-8650-45430735a459 tempest-CreateVolumesFromImageTest-1713904690 None] Creating volume 0209ba5b-0a7c-40fc-9b05-771a8292992b {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:53:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6aea2ba8-5904-496d-8650-45430735a459 tempest-CreateVolumesFromImageTest-1713904690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:53:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6aea2ba8-5904-496d-8650-45430735a459 tempest-CreateVolumesFromImageTest-1713904690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:53:18 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-6aea2ba8-5904-496d-8650-45430735a459 tempest-CreateVolumesFromImageTest-1713904690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:53:18 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-6aea2ba8-5904-496d-8650-45430735a459 tempest-CreateVolumesFromImageTest-1713904690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:53:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6aea2ba8-5904-496d-8650-45430735a459 tempest-CreateVolumesFromImageTest-1713904690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:53:18 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-6aea2ba8-5904-496d-8650-45430735a459 tempest-CreateVolumesFromImageTest-1713904690 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:53:18 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-6aea2ba8-5904-496d-8650-45430735a459 tempest-CreateVolumesFromImageTest-1713904690 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:53:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6aea2ba8-5904-496d-8650-45430735a459 tempest-CreateVolumesFromImageTest-1713904690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0209ba5b-0a7c-40fc-9b05-771a8292992b 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:18 devstack sudo[106224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0209ba5b-0a7c-40fc-9b05-771a8292992b 1073741824
Jul 09 14:53:18 devstack sudo[106224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:18 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5a2c66ad-e4bf-424e-9c63-7ffe59b6ae1c tempest-CreateVolumesFromImageTest-1713904690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ee0899e-5a43-409d-bd0b-1f67855276f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51534b4e-e458-443c-bd83-eda491c134bb', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:18 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5a2c66ad-e4bf-424e-9c63-7ffe59b6ae1c tempest-CreateVolumesFromImageTest-1713904690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d7a0e37-9068-468b-a47d-474221914235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:18 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-5a2c66ad-e4bf-424e-9c63-7ffe59b6ae1c tempest-CreateVolumesFromImageTest-1713904690 None] Volume volume-51534b4e-e458-443c-bd83-eda491c134bb (51534b4e-e458-443c-bd83-eda491c134bb): created successfully
Jul 09 14:53:18 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5a2c66ad-e4bf-424e-9c63-7ffe59b6ae1c tempest-CreateVolumesFromImageTest-1713904690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d7a0e37-9068-468b-a47d-474221914235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:18 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5a2c66ad-e4bf-424e-9c63-7ffe59b6ae1c tempest-CreateVolumesFromImageTest-1713904690 None] Flow 'volume_create_manager' (c2716512-03af-48a4-8dc4-c3df912e1742) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:53:18 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-5a2c66ad-e4bf-424e-9c63-7ffe59b6ae1c tempest-CreateVolumesFromImageTest-1713904690 None] Created volume successfully.
Jul 09 14:53:19 devstack sudo[106224]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6aea2ba8-5904-496d-8650-45430735a459 tempest-CreateVolumesFromImageTest-1713904690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0209ba5b-0a7c-40fc-9b05-771a8292992b 1073741824" returned: 0 in 0.796s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6aea2ba8-5904-496d-8650-45430735a459 tempest-CreateVolumesFromImageTest-1713904690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0209ba5b-0a7c-40fc-9b05-771a8292992b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:19 devstack sudo[106230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0209ba5b-0a7c-40fc-9b05-771a8292992b
Jul 09 14:53:19 devstack sudo[106230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:19 devstack sudo[106230]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6aea2ba8-5904-496d-8650-45430735a459 tempest-CreateVolumesFromImageTest-1713904690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0209ba5b-0a7c-40fc-9b05-771a8292992b" returned: 0 in 0.647s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:19 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-6aea2ba8-5904-496d-8650-45430735a459 tempest-CreateVolumesFromImageTest-1713904690 None] <== create_volume: return (1484ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:53:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6aea2ba8-5904-496d-8650-45430735a459 tempest-CreateVolumesFromImageTest-1713904690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.488s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:53:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-2116708f-da49-426d-a204-2c873a03703f tempest-CinderUnicodeTest-607122583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.814s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:53:19 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-2116708f-da49-426d-a204-2c873a03703f tempest-CinderUnicodeTest-607122583 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:53:12Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-544509767',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9c9cfb7-0efa-46c7-827e-00985aee96d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24568c9523c742d89793e3dca631fda5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:53:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:53:12Z,use_quota=True,user_id='756093edf00940e48ef58afb9cacdf58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:53:19 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-2116708f-da49-426d-a204-2c873a03703f tempest-CinderUnicodeTest-607122583 None] Creating volume e9c9cfb7-0efa-46c7-827e-00985aee96d6 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:53:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-2116708f-da49-426d-a204-2c873a03703f tempest-CinderUnicodeTest-607122583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:53:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-2116708f-da49-426d-a204-2c873a03703f tempest-CinderUnicodeTest-607122583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:53:19 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-2116708f-da49-426d-a204-2c873a03703f tempest-CinderUnicodeTest-607122583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:53:19 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-2116708f-da49-426d-a204-2c873a03703f tempest-CinderUnicodeTest-607122583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:53:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-2116708f-da49-426d-a204-2c873a03703f tempest-CinderUnicodeTest-607122583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:53:19 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-2116708f-da49-426d-a204-2c873a03703f tempest-CinderUnicodeTest-607122583 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:53:19 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-2116708f-da49-426d-a204-2c873a03703f tempest-CinderUnicodeTest-607122583 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:53:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2116708f-da49-426d-a204-2c873a03703f tempest-CinderUnicodeTest-607122583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e9c9cfb7-0efa-46c7-827e-00985aee96d6 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:19 devstack sudo[106233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e9c9cfb7-0efa-46c7-827e-00985aee96d6 1073741824
Jul 09 14:53:19 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6aea2ba8-5904-496d-8650-45430735a459 tempest-CreateVolumesFromImageTest-1713904690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a476895c-eefa-4cc4-a949-b8db4508a275) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0209ba5b-0a7c-40fc-9b05-771a8292992b', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:19 devstack sudo[106233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:19 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6aea2ba8-5904-496d-8650-45430735a459 tempest-CreateVolumesFromImageTest-1713904690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b49093fd-761d-41e7-95f1-dd684d135587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:19 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-6aea2ba8-5904-496d-8650-45430735a459 tempest-CreateVolumesFromImageTest-1713904690 None] Volume volume-0209ba5b-0a7c-40fc-9b05-771a8292992b (0209ba5b-0a7c-40fc-9b05-771a8292992b): created successfully
Jul 09 14:53:19 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6aea2ba8-5904-496d-8650-45430735a459 tempest-CreateVolumesFromImageTest-1713904690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b49093fd-761d-41e7-95f1-dd684d135587) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:19 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6aea2ba8-5904-496d-8650-45430735a459 tempest-CreateVolumesFromImageTest-1713904690 None] Flow 'volume_create_manager' (91d039b5-711f-4d76-ad60-c2ee110e19bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:53:19 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-6aea2ba8-5904-496d-8650-45430735a459 tempest-CreateVolumesFromImageTest-1713904690 None] Created volume successfully.
Jul 09 14:53:20 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-412c4abf-9962-4f5b-9bed-7ffed30d09d5 tempest-CreateVolumesFromImageTest-1713904690 None] Acquiring lock "cinder-0209ba5b-0a7c-40fc-9b05-771a8292992b-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:53:20 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-412c4abf-9962-4f5b-9bed-7ffed30d09d5 tempest-CreateVolumesFromImageTest-1713904690 None] Lock "cinder-0209ba5b-0a7c-40fc-9b05-771a8292992b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:53:20 devstack sudo[106233]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2116708f-da49-426d-a204-2c873a03703f tempest-CinderUnicodeTest-607122583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e9c9cfb7-0efa-46c7-827e-00985aee96d6 1073741824" returned: 0 in 0.860s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:20 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-412c4abf-9962-4f5b-9bed-7ffed30d09d5 tempest-CreateVolumesFromImageTest-1713904690 None] Acquiring lock "cinder-quobyte-0209ba5b-0a7c-40fc-9b05-771a8292992b" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:53:20 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-412c4abf-9962-4f5b-9bed-7ffed30d09d5 tempest-CreateVolumesFromImageTest-1713904690 None] Lock "cinder-quobyte-0209ba5b-0a7c-40fc-9b05-771a8292992b" acquired by "delete_volume" :: waited 0.024s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:53:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2116708f-da49-426d-a204-2c873a03703f tempest-CinderUnicodeTest-607122583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e9c9cfb7-0efa-46c7-827e-00985aee96d6 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:20 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e1b29c-8a00-4464-a335-763189350936]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:53:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-412c4abf-9962-4f5b-9bed-7ffed30d09d5 tempest-CreateVolumesFromImageTest-1713904690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0209ba5b-0a7c-40fc-9b05-771a8292992b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:20 devstack sudo[106239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e9c9cfb7-0efa-46c7-827e-00985aee96d6
Jul 09 14:53:20 devstack sudo[106239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:20 devstack sudo[106240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0209ba5b-0a7c-40fc-9b05-771a8292992b
Jul 09 14:53:20 devstack sudo[106240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:21 devstack sudo[106239]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2116708f-da49-426d-a204-2c873a03703f tempest-CinderUnicodeTest-607122583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e9c9cfb7-0efa-46c7-827e-00985aee96d6" returned: 0 in 0.688s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:21 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-2116708f-da49-426d-a204-2c873a03703f tempest-CinderUnicodeTest-607122583 None] <== create_volume: return (1610ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:53:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-2116708f-da49-426d-a204-2c873a03703f tempest-CinderUnicodeTest-607122583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.614s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:53:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-de44e550-1a3f-4650-94c6-ad57ecf9914f tempest-VolumeDependencyTests-127658737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.662s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:53:21 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-de44e550-1a3f-4650-94c6-ad57ecf9914f tempest-VolumeDependencyTests-127658737 None] Creating offline snapshot 58d1aedc-21cd-4caa-89e8-deafb161b408 of volume 7cda90fb-b664-43b9-b3e1-12fc01b2c2d2 {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 14:53:21 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2116708f-da49-426d-a204-2c873a03703f tempest-CinderUnicodeTest-607122583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41b96705-9695-442e-bcb8-e284642a52ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9c9cfb7-0efa-46c7-827e-00985aee96d6', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:21 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2116708f-da49-426d-a204-2c873a03703f tempest-CinderUnicodeTest-607122583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f675043e-9985-424d-8b40-13feb73529ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:21 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a762d1c-f107-4731-80fe-46934cead3d3]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:53:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-de44e550-1a3f-4650-94c6-ad57ecf9914f tempest-VolumeDependencyTests-127658737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7cda90fb-b664-43b9-b3e1-12fc01b2c2d2 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:21 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-2116708f-da49-426d-a204-2c873a03703f tempest-CinderUnicodeTest-607122583 None] Volume volume-e9c9cfb7-0efa-46c7-827e-00985aee96d6 (e9c9cfb7-0efa-46c7-827e-00985aee96d6): created successfully
Jul 09 14:53:21 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2116708f-da49-426d-a204-2c873a03703f tempest-CinderUnicodeTest-607122583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f675043e-9985-424d-8b40-13feb73529ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:21 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2116708f-da49-426d-a204-2c873a03703f tempest-CinderUnicodeTest-607122583 None] Flow 'volume_create_manager' (59dd6126-4625-4ce5-9f73-209bc3917c79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:53:21 devstack sudo[106240]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-412c4abf-9962-4f5b-9bed-7ffed30d09d5 tempest-CreateVolumesFromImageTest-1713904690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0209ba5b-0a7c-40fc-9b05-771a8292992b" returned: 0 in 0.770s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-412c4abf-9962-4f5b-9bed-7ffed30d09d5 tempest-CreateVolumesFromImageTest-1713904690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0209ba5b-0a7c-40fc-9b05-771a8292992b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:21 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-2116708f-da49-426d-a204-2c873a03703f tempest-CinderUnicodeTest-607122583 None] Created volume successfully.
Jul 09 14:53:21 devstack sudo[106251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0209ba5b-0a7c-40fc-9b05-771a8292992b
Jul 09 14:53:21 devstack sudo[106251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:21 devstack sudo[106250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7cda90fb-b664-43b9-b3e1-12fc01b2c2d2
Jul 09 14:53:21 devstack sudo[106250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:22 devstack sudo[106251]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-412c4abf-9962-4f5b-9bed-7ffed30d09d5 tempest-CreateVolumesFromImageTest-1713904690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0209ba5b-0a7c-40fc-9b05-771a8292992b" returned: 0 in 0.691s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:22 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-412c4abf-9962-4f5b-9bed-7ffed30d09d5 tempest-CreateVolumesFromImageTest-1713904690 None] Lock "cinder-quobyte-0209ba5b-0a7c-40fc-9b05-771a8292992b" released by "delete_volume" :: held 1.527s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:53:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-de44e550-1a3f-4650-94c6-ad57ecf9914f tempest-VolumeDependencyTests-127658737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7cda90fb-b664-43b9-b3e1-12fc01b2c2d2" returned: 0 in 0.803s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-de44e550-1a3f-4650-94c6-ad57ecf9914f tempest-VolumeDependencyTests-127658737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7cda90fb-b664-43b9-b3e1-12fc01b2c2d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7cda90fb-b664-43b9-b3e1-12fc01b2c2d2.58d1aedc-21cd-4caa-89e8-deafb161b408 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:22 devstack sudo[106250]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:22 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-412c4abf-9962-4f5b-9bed-7ffed30d09d5 tempest-CreateVolumesFromImageTest-1713904690 None] Created reservations ['c7620f85-65a2-4d52-82d0-321dcc1b859b', '66fa520d-c4e2-402a-bdf6-088d30feed88', '73f7d174-f854-434f-a481-f06accfae9d8', '48940302-c264-4e86-ae41-0ac0de46a24b'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:53:22 devstack sudo[106260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7cda90fb-b664-43b9-b3e1-12fc01b2c2d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7cda90fb-b664-43b9-b3e1-12fc01b2c2d2.58d1aedc-21cd-4caa-89e8-deafb161b408 1G
Jul 09 14:53:22 devstack sudo[106260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-412c4abf-9962-4f5b-9bed-7ffed30d09d5 tempest-CreateVolumesFromImageTest-1713904690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:53:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-412c4abf-9962-4f5b-9bed-7ffed30d09d5 tempest-CreateVolumesFromImageTest-1713904690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:53:22 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-412c4abf-9962-4f5b-9bed-7ffed30d09d5 tempest-CreateVolumesFromImageTest-1713904690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:53:22 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-412c4abf-9962-4f5b-9bed-7ffed30d09d5 tempest-CreateVolumesFromImageTest-1713904690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:53:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-412c4abf-9962-4f5b-9bed-7ffed30d09d5 tempest-CreateVolumesFromImageTest-1713904690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:53:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-412c4abf-9962-4f5b-9bed-7ffed30d09d5 tempest-CreateVolumesFromImageTest-1713904690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:22 devstack sudo[106262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:53:22 devstack sudo[106262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c800a973-049d-423f-8f9e-659113ef2b97 tempest-CinderUnicodeTest-607122583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:53:22 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-636d9854-606e-4f0b-b60c-d524d974eb45 tempest-CreateVolumesFromImageTest-1713904690 None] Acquiring lock "cinder-51534b4e-e458-443c-bd83-eda491c134bb-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:53:22 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-636d9854-606e-4f0b-b60c-d524d974eb45 tempest-CreateVolumesFromImageTest-1713904690 None] Lock "cinder-51534b4e-e458-443c-bd83-eda491c134bb-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:53:23 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-636d9854-606e-4f0b-b60c-d524d974eb45 tempest-CreateVolumesFromImageTest-1713904690 None] Acquiring lock "cinder-quobyte-51534b4e-e458-443c-bd83-eda491c134bb" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:53:23 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-636d9854-606e-4f0b-b60c-d524d974eb45 tempest-CreateVolumesFromImageTest-1713904690 None] Lock "cinder-quobyte-51534b4e-e458-443c-bd83-eda491c134bb" acquired by "delete_volume" :: waited 0.021s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:53:23 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcfd0a68-5853-4c5a-934b-f59c8136e0af]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:53:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-636d9854-606e-4f0b-b60c-d524d974eb45 tempest-CreateVolumesFromImageTest-1713904690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-51534b4e-e458-443c-bd83-eda491c134bb {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:23 devstack sudo[106267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-51534b4e-e458-443c-bd83-eda491c134bb
Jul 09 14:53:23 devstack sudo[106267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:23 devstack sudo[106262]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-412c4abf-9962-4f5b-9bed-7ffed30d09d5 tempest-CreateVolumesFromImageTest-1713904690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.711s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:23 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-412c4abf-9962-4f5b-9bed-7ffed30d09d5 tempest-CreateVolumesFromImageTest-1713904690 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:53:23 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-412c4abf-9962-4f5b-9bed-7ffed30d09d5 tempest-CreateVolumesFromImageTest-1713904690 None] Deleted volume successfully.
Jul 09 14:53:23 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-412c4abf-9962-4f5b-9bed-7ffed30d09d5 tempest-CreateVolumesFromImageTest-1713904690 None] Lock "cinder-0209ba5b-0a7c-40fc-9b05-771a8292992b-delete_volume" released by "delete_volume" :: held 2.535s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:53:23 devstack sudo[106260]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-de44e550-1a3f-4650-94c6-ad57ecf9914f tempest-VolumeDependencyTests-127658737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7cda90fb-b664-43b9-b3e1-12fc01b2c2d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7cda90fb-b664-43b9-b3e1-12fc01b2c2d2.58d1aedc-21cd-4caa-89e8-deafb161b408 1G" returned: 0 in 0.984s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-de44e550-1a3f-4650-94c6-ad57ecf9914f tempest-VolumeDependencyTests-127658737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7cda90fb-b664-43b9-b3e1-12fc01b2c2d2 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7cda90fb-b664-43b9-b3e1-12fc01b2c2d2.58d1aedc-21cd-4caa-89e8-deafb161b408 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:23 devstack sudo[106270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7cda90fb-b664-43b9-b3e1-12fc01b2c2d2 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7cda90fb-b664-43b9-b3e1-12fc01b2c2d2.58d1aedc-21cd-4caa-89e8-deafb161b408
Jul 09 14:53:23 devstack sudo[106270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:23 devstack sudo[106267]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-636d9854-606e-4f0b-b60c-d524d974eb45 tempest-CreateVolumesFromImageTest-1713904690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-51534b4e-e458-443c-bd83-eda491c134bb" returned: 0 in 0.790s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-636d9854-606e-4f0b-b60c-d524d974eb45 tempest-CreateVolumesFromImageTest-1713904690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-51534b4e-e458-443c-bd83-eda491c134bb {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:23 devstack sudo[106275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-51534b4e-e458-443c-bd83-eda491c134bb
Jul 09 14:53:23 devstack sudo[106275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:24 devstack sudo[106270]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-de44e550-1a3f-4650-94c6-ad57ecf9914f tempest-VolumeDependencyTests-127658737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7cda90fb-b664-43b9-b3e1-12fc01b2c2d2 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7cda90fb-b664-43b9-b3e1-12fc01b2c2d2.58d1aedc-21cd-4caa-89e8-deafb161b408" returned: 0 in 0.746s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:24 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-de44e550-1a3f-4650-94c6-ad57ecf9914f tempest-VolumeDependencyTests-127658737 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7cda90fb-b664-43b9-b3e1-12fc01b2c2d2.58d1aedc-21cd-4caa-89e8-deafb161b408 is being set with open permissions: ugo+rw
Jul 09 14:53:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-de44e550-1a3f-4650-94c6-ad57ecf9914f tempest-VolumeDependencyTests-127658737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7cda90fb-b664-43b9-b3e1-12fc01b2c2d2.58d1aedc-21cd-4caa-89e8-deafb161b408 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:24 devstack sudo[106280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7cda90fb-b664-43b9-b3e1-12fc01b2c2d2.58d1aedc-21cd-4caa-89e8-deafb161b408
Jul 09 14:53:24 devstack sudo[106280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:24 devstack sudo[106275]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-636d9854-606e-4f0b-b60c-d524d974eb45 tempest-CreateVolumesFromImageTest-1713904690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-51534b4e-e458-443c-bd83-eda491c134bb" returned: 0 in 0.675s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:24 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-636d9854-606e-4f0b-b60c-d524d974eb45 tempest-CreateVolumesFromImageTest-1713904690 None] Lock "cinder-quobyte-51534b4e-e458-443c-bd83-eda491c134bb" released by "delete_volume" :: held 1.505s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:53:24 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-636d9854-606e-4f0b-b60c-d524d974eb45 tempest-CreateVolumesFromImageTest-1713904690 None] Created reservations ['bcede623-b381-4c82-b5ab-cc1946853719', 'af2aa110-2e63-433a-b036-b6ab9b44b231', '6cc7b3b9-89d8-49fb-9e0f-9a8a3a675ae8', '33b22369-b4fa-467f-a166-8059bd44bc55'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:53:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-636d9854-606e-4f0b-b60c-d524d974eb45 tempest-CreateVolumesFromImageTest-1713904690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:53:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-636d9854-606e-4f0b-b60c-d524d974eb45 tempest-CreateVolumesFromImageTest-1713904690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:53:24 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-636d9854-606e-4f0b-b60c-d524d974eb45 tempest-CreateVolumesFromImageTest-1713904690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:53:24 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-636d9854-606e-4f0b-b60c-d524d974eb45 tempest-CreateVolumesFromImageTest-1713904690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:53:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-636d9854-606e-4f0b-b60c-d524d974eb45 tempest-CreateVolumesFromImageTest-1713904690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:53:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-636d9854-606e-4f0b-b60c-d524d974eb45 tempest-CreateVolumesFromImageTest-1713904690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:24 devstack sudo[106284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:53:24 devstack sudo[106284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:24 devstack sudo[106280]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-de44e550-1a3f-4650-94c6-ad57ecf9914f tempest-VolumeDependencyTests-127658737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7cda90fb-b664-43b9-b3e1-12fc01b2c2d2.58d1aedc-21cd-4caa-89e8-deafb161b408" returned: 0 in 0.663s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-de44e550-1a3f-4650-94c6-ad57ecf9914f tempest-VolumeDependencyTests-127658737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7cda90fb-b664-43b9-b3e1-12fc01b2c2d2.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:24 devstack sudo[106286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7cda90fb-b664-43b9-b3e1-12fc01b2c2d2.info
Jul 09 14:53:24 devstack sudo[106286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:25 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-01d3dde7-a57d-4adb-af48-62a2e19a7d66 tempest-CreateVolumesFromImageTest-1713904690 None] Acquiring lock "cinder-b7271dfd-55c6-4b2a-995e-a4238575a2d5-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:53:25 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-01d3dde7-a57d-4adb-af48-62a2e19a7d66 tempest-CreateVolumesFromImageTest-1713904690 None] Lock "cinder-b7271dfd-55c6-4b2a-995e-a4238575a2d5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:53:25 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-01d3dde7-a57d-4adb-af48-62a2e19a7d66 tempest-CreateVolumesFromImageTest-1713904690 None] Acquiring lock "cinder-quobyte-b7271dfd-55c6-4b2a-995e-a4238575a2d5" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:53:25 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-01d3dde7-a57d-4adb-af48-62a2e19a7d66 tempest-CreateVolumesFromImageTest-1713904690 None] Lock "cinder-quobyte-b7271dfd-55c6-4b2a-995e-a4238575a2d5" acquired by "delete_volume" :: waited 0.020s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:53:25 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dbef339-535d-408a-9786-77d1ab4cd603]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:53:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-01d3dde7-a57d-4adb-af48-62a2e19a7d66 tempest-CreateVolumesFromImageTest-1713904690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b7271dfd-55c6-4b2a-995e-a4238575a2d5 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:25 devstack sudo[106284]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-636d9854-606e-4f0b-b60c-d524d974eb45 tempest-CreateVolumesFromImageTest-1713904690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.706s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:25 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-636d9854-606e-4f0b-b60c-d524d974eb45 tempest-CreateVolumesFromImageTest-1713904690 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:53:25 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-636d9854-606e-4f0b-b60c-d524d974eb45 tempest-CreateVolumesFromImageTest-1713904690 None] Deleted volume successfully.
Jul 09 14:53:25 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-636d9854-606e-4f0b-b60c-d524d974eb45 tempest-CreateVolumesFromImageTest-1713904690 None] Lock "cinder-51534b4e-e458-443c-bd83-eda491c134bb-delete_volume" released by "delete_volume" :: held 2.448s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:53:25 devstack sudo[106289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b7271dfd-55c6-4b2a-995e-a4238575a2d5
Jul 09 14:53:25 devstack sudo[106289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:25 devstack sudo[106286]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-de44e550-1a3f-4650-94c6-ad57ecf9914f tempest-VolumeDependencyTests-127658737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7cda90fb-b664-43b9-b3e1-12fc01b2c2d2.info" returned: 0 in 0.726s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:25 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-de44e550-1a3f-4650-94c6-ad57ecf9914f tempest-VolumeDependencyTests-127658737 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7cda90fb-b664-43b9-b3e1-12fc01b2c2d2.info is being set with open permissions: ugo+rw
Jul 09 14:53:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-de44e550-1a3f-4650-94c6-ad57ecf9914f tempest-VolumeDependencyTests-127658737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7cda90fb-b664-43b9-b3e1-12fc01b2c2d2.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:25 devstack sudo[106292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7cda90fb-b664-43b9-b3e1-12fc01b2c2d2.info
Jul 09 14:53:25 devstack sudo[106292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:26 devstack sudo[106289]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-01d3dde7-a57d-4adb-af48-62a2e19a7d66 tempest-CreateVolumesFromImageTest-1713904690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b7271dfd-55c6-4b2a-995e-a4238575a2d5" returned: 0 in 0.803s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-01d3dde7-a57d-4adb-af48-62a2e19a7d66 tempest-CreateVolumesFromImageTest-1713904690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b7271dfd-55c6-4b2a-995e-a4238575a2d5 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:26 devstack sudo[106298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b7271dfd-55c6-4b2a-995e-a4238575a2d5
Jul 09 14:53:26 devstack sudo[106298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:26 devstack sudo[106292]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-de44e550-1a3f-4650-94c6-ad57ecf9914f tempest-VolumeDependencyTests-127658737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7cda90fb-b664-43b9-b3e1-12fc01b2c2d2.info" returned: 0 in 0.663s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-de44e550-1a3f-4650-94c6-ad57ecf9914f tempest-VolumeDependencyTests-127658737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.691s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:53:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-ceb8ace3-2997-4271-b7cd-4be2fbf90a6f tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.270s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:53:26 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-ceb8ace3-2997-4271-b7cd-4be2fbf90a6f tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:53:12Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc0e4b6d-d47b-4b03-b243-55cf2200346b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb91c0c23721478ba70cc66bfc4d5371',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:53:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:53:12Z,use_quota=True,user_id='fbd3c79858434fe4b148942aff249141',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(526f2c5e-ffc8-4a75-92c5-9cb1b37c63c9),volume_type_id=526f2c5e-ffc8-4a75-92c5-9cb1b37c63c9)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:53:26 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-ceb8ace3-2997-4271-b7cd-4be2fbf90a6f tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] Creating volume dc0e4b6d-d47b-4b03-b243-55cf2200346b {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:53:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-ceb8ace3-2997-4271-b7cd-4be2fbf90a6f tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:53:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-ceb8ace3-2997-4271-b7cd-4be2fbf90a6f tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:53:26 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-ceb8ace3-2997-4271-b7cd-4be2fbf90a6f tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:53:26 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-ceb8ace3-2997-4271-b7cd-4be2fbf90a6f tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:53:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-ceb8ace3-2997-4271-b7cd-4be2fbf90a6f tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:53:26 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-ceb8ace3-2997-4271-b7cd-4be2fbf90a6f tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:53:26 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-ceb8ace3-2997-4271-b7cd-4be2fbf90a6f tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:53:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ceb8ace3-2997-4271-b7cd-4be2fbf90a6f tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-dc0e4b6d-d47b-4b03-b243-55cf2200346b 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:26 devstack sudo[106300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-dc0e4b6d-d47b-4b03-b243-55cf2200346b 1073741824
Jul 09 14:53:26 devstack sudo[106300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:26 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-de44e550-1a3f-4650-94c6-ad57ecf9914f tempest-VolumeDependencyTests-127658737 None] Create snapshot completed successfully
Jul 09 14:53:26 devstack sudo[106298]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-01d3dde7-a57d-4adb-af48-62a2e19a7d66 tempest-CreateVolumesFromImageTest-1713904690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b7271dfd-55c6-4b2a-995e-a4238575a2d5" returned: 0 in 0.703s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:26 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-01d3dde7-a57d-4adb-af48-62a2e19a7d66 tempest-CreateVolumesFromImageTest-1713904690 None] Lock "cinder-quobyte-b7271dfd-55c6-4b2a-995e-a4238575a2d5" released by "delete_volume" :: held 1.543s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:53:26 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-01d3dde7-a57d-4adb-af48-62a2e19a7d66 tempest-CreateVolumesFromImageTest-1713904690 None] Created reservations ['6584877e-d8ca-4ab5-9bcd-9c670d652a58', 'a4d7b8a1-c189-4d40-b83f-d0f1b9cef249', 'ddb80adb-fca6-4d23-8912-2a91dc06e513', 'f3181866-a58c-4a2d-8252-1e10f1b283fb'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:53:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-01d3dde7-a57d-4adb-af48-62a2e19a7d66 tempest-CreateVolumesFromImageTest-1713904690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:53:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-01d3dde7-a57d-4adb-af48-62a2e19a7d66 tempest-CreateVolumesFromImageTest-1713904690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:53:26 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-01d3dde7-a57d-4adb-af48-62a2e19a7d66 tempest-CreateVolumesFromImageTest-1713904690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:53:26 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-01d3dde7-a57d-4adb-af48-62a2e19a7d66 tempest-CreateVolumesFromImageTest-1713904690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:53:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-01d3dde7-a57d-4adb-af48-62a2e19a7d66 tempest-CreateVolumesFromImageTest-1713904690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:53:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-01d3dde7-a57d-4adb-af48-62a2e19a7d66 tempest-CreateVolumesFromImageTest-1713904690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:27 devstack sudo[106307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:53:27 devstack sudo[106307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:27 devstack sudo[106300]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ceb8ace3-2997-4271-b7cd-4be2fbf90a6f tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-dc0e4b6d-d47b-4b03-b243-55cf2200346b 1073741824" returned: 0 in 0.897s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ceb8ace3-2997-4271-b7cd-4be2fbf90a6f tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-dc0e4b6d-d47b-4b03-b243-55cf2200346b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:27 devstack sudo[106309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-dc0e4b6d-d47b-4b03-b243-55cf2200346b
Jul 09 14:53:27 devstack sudo[106309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:27 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-fd07bf7b-922d-4ef6-9189-0fac82d69f78 tempest-CreateVolumesFromImageTest-1713904690 None] Acquiring lock "cinder-66e5a3a3-d617-4606-b0e7-dea19fa325a5-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:53:27 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-fd07bf7b-922d-4ef6-9189-0fac82d69f78 tempest-CreateVolumesFromImageTest-1713904690 None] Lock "cinder-66e5a3a3-d617-4606-b0e7-dea19fa325a5-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:53:27 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-fd07bf7b-922d-4ef6-9189-0fac82d69f78 tempest-CreateVolumesFromImageTest-1713904690 None] Acquiring lock "cinder-quobyte-66e5a3a3-d617-4606-b0e7-dea19fa325a5" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:53:27 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-fd07bf7b-922d-4ef6-9189-0fac82d69f78 tempest-CreateVolumesFromImageTest-1713904690 None] Lock "cinder-quobyte-66e5a3a3-d617-4606-b0e7-dea19fa325a5" acquired by "delete_volume" :: waited 0.022s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:53:27 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9256d6e-69a7-4867-ae6d-6f3c93f16161]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:53:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fd07bf7b-922d-4ef6-9189-0fac82d69f78 tempest-CreateVolumesFromImageTest-1713904690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-66e5a3a3-d617-4606-b0e7-dea19fa325a5 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:27 devstack sudo[106307]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-01d3dde7-a57d-4adb-af48-62a2e19a7d66 tempest-CreateVolumesFromImageTest-1713904690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.712s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:27 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-01d3dde7-a57d-4adb-af48-62a2e19a7d66 tempest-CreateVolumesFromImageTest-1713904690 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:53:27 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-01d3dde7-a57d-4adb-af48-62a2e19a7d66 tempest-CreateVolumesFromImageTest-1713904690 None] Deleted volume successfully.
Jul 09 14:53:27 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-01d3dde7-a57d-4adb-af48-62a2e19a7d66 tempest-CreateVolumesFromImageTest-1713904690 None] Lock "cinder-b7271dfd-55c6-4b2a-995e-a4238575a2d5-delete_volume" released by "delete_volume" :: held 2.513s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:53:27 devstack sudo[106312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-66e5a3a3-d617-4606-b0e7-dea19fa325a5
Jul 09 14:53:27 devstack sudo[106312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:27 devstack sudo[106309]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ceb8ace3-2997-4271-b7cd-4be2fbf90a6f tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-dc0e4b6d-d47b-4b03-b243-55cf2200346b" returned: 0 in 0.835s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:27 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-ceb8ace3-2997-4271-b7cd-4be2fbf90a6f tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] <== create_volume: return (1770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:53:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-ceb8ace3-2997-4271-b7cd-4be2fbf90a6f tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.774s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:53:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c800a973-049d-423f-8f9e-659113ef2b97 tempest-CinderUnicodeTest-607122583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.133s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:53:28 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-c800a973-049d-423f-8f9e-659113ef2b97 tempest-CinderUnicodeTest-607122583 None] Creating offline snapshot 42721a07-3271-4220-9f99-ccff6395549d of volume e9c9cfb7-0efa-46c7-827e-00985aee96d6 {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 14:53:28 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-5618e0cc-a969-4f68-ab94-f991c1cfb313 tempest-VolumeDependencyTests-127658737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:53:28 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdea43db-8ee4-460c-b378-3e002c30428a]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:53:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c800a973-049d-423f-8f9e-659113ef2b97 tempest-CinderUnicodeTest-607122583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e9c9cfb7-0efa-46c7-827e-00985aee96d6 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:28 devstack cinder-volume[87230]: DEBUG cinder.volume.volume_utils [None req-ceb8ace3-2997-4271-b7cd-4be2fbf90a6f tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] Attempting download of 9d926e91-885e-425a-9cc2-e85a7e01ea15 ((None, [{'url': 'file:///opt/stack/data/glance/images/9d926e91-885e-425a-9cc2-e85a7e01ea15', 'metadata': {}}])) to volume dc0e4b6d-d47b-4b03-b243-55cf2200346b. {{(pid=87230) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 09 14:53:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5618e0cc-a969-4f68-ab94-f991c1cfb313 tempest-VolumeDependencyTests-127658737 None] Flow 'volume_create_manager' (2eafdefe-e1a1-4b5e-84ce-25ad6688fcd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:53:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5618e0cc-a969-4f68-ab94-f991c1cfb313 tempest-VolumeDependencyTests-127658737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b7e5ed2-4e9c-40fd-ba2d-52ff4c68c6e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5618e0cc-a969-4f68-ab94-f991c1cfb313 tempest-VolumeDependencyTests-127658737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b7e5ed2-4e9c-40fd-ba2d-52ff4c68c6e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:53:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2004723067',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=141a3fff-e7f9-4be9-85a1-cf9f82481a29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8591320b8114379b492d10a426cf7ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:53:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=58d1aedc-21cd-4caa-89e8-deafb161b408,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:53:28Z,use_quota=True,user_id='86ec3b49149a4df9949243e07140c294',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5618e0cc-a969-4f68-ab94-f991c1cfb313 tempest-VolumeDependencyTests-127658737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f64c3a7c-c0d7-4e53-a14e-797f08337f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5618e0cc-a969-4f68-ab94-f991c1cfb313 tempest-VolumeDependencyTests-127658737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f64c3a7c-c0d7-4e53-a14e-797f08337f0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5618e0cc-a969-4f68-ab94-f991c1cfb313 tempest-VolumeDependencyTests-127658737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57774782-01ce-4c81-afa6-45d7c3d3e711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5618e0cc-a969-4f68-ab94-f991c1cfb313 tempest-VolumeDependencyTests-127658737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57774782-01ce-4c81-afa6-45d7c3d3e711) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '141a3fff-e7f9-4be9-85a1-cf9f82481a29', 'volume_name': 'volume-141a3fff-e7f9-4be9-85a1-cf9f82481a29', 'volume_size': 1, 'snapshot_id': '58d1aedc-21cd-4caa-89e8-deafb161b408'}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5618e0cc-a969-4f68-ab94-f991c1cfb313 tempest-VolumeDependencyTests-127658737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c15ee6dd-dd2d-4ab8-9f81-43cbed16064e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5618e0cc-a969-4f68-ab94-f991c1cfb313 tempest-VolumeDependencyTests-127658737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c15ee6dd-dd2d-4ab8-9f81-43cbed16064e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5618e0cc-a969-4f68-ab94-f991c1cfb313 tempest-VolumeDependencyTests-127658737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9afc449-67cc-4152-abfc-1606e163f56d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:28 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-5618e0cc-a969-4f68-ab94-f991c1cfb313 tempest-VolumeDependencyTests-127658737 None] Volume 141a3fff-e7f9-4be9-85a1-cf9f82481a29: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-141a3fff-e7f9-4be9-85a1-cf9f82481a29', 'volume_size': 1, 'snapshot_id': '58d1aedc-21cd-4caa-89e8-deafb161b408'}
Jul 09 14:53:28 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b18e2f1-70bd-4c8c-963c-d7c03e1a093d]: (4, 'raw') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:53:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ceb8ace3-2997-4271-b7cd-4be2fbf90a6f tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9d926e91-885e-425a-9cc2-e85a7e01ea15_q75f81yx {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:28 devstack sudo[106315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e9c9cfb7-0efa-46c7-827e-00985aee96d6
Jul 09 14:53:28 devstack sudo[106315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5618e0cc-a969-4f68-ab94-f991c1cfb313 tempest-VolumeDependencyTests-127658737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:53:28 devstack sudo[106317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9d926e91-885e-425a-9cc2-e85a7e01ea15_q75f81yx
Jul 09 14:53:28 devstack sudo[106317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:28 devstack sudo[106312]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fd07bf7b-922d-4ef6-9189-0fac82d69f78 tempest-CreateVolumesFromImageTest-1713904690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-66e5a3a3-d617-4606-b0e7-dea19fa325a5" returned: 0 in 0.838s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fd07bf7b-922d-4ef6-9189-0fac82d69f78 tempest-CreateVolumesFromImageTest-1713904690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-66e5a3a3-d617-4606-b0e7-dea19fa325a5 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:28 devstack sudo[106322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-66e5a3a3-d617-4606-b0e7-dea19fa325a5
Jul 09 14:53:28 devstack sudo[106322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:28 devstack sudo[106315]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c800a973-049d-423f-8f9e-659113ef2b97 tempest-CinderUnicodeTest-607122583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e9c9cfb7-0efa-46c7-827e-00985aee96d6" returned: 0 in 0.830s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c800a973-049d-423f-8f9e-659113ef2b97 tempest-CinderUnicodeTest-607122583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e9c9cfb7-0efa-46c7-827e-00985aee96d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e9c9cfb7-0efa-46c7-827e-00985aee96d6.42721a07-3271-4220-9f99-ccff6395549d 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:28 devstack sudo[106330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e9c9cfb7-0efa-46c7-827e-00985aee96d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e9c9cfb7-0efa-46c7-827e-00985aee96d6.42721a07-3271-4220-9f99-ccff6395549d 1G
Jul 09 14:53:28 devstack sudo[106330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:28 devstack sudo[106317]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ceb8ace3-2997-4271-b7cd-4be2fbf90a6f tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9d926e91-885e-425a-9cc2-e85a7e01ea15_q75f81yx" returned: 0 in 0.789s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ceb8ace3-2997-4271-b7cd-4be2fbf90a6f tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9d926e91-885e-425a-9cc2-e85a7e01ea15_q75f81yx {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:29 devstack sudo[106332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9d926e91-885e-425a-9cc2-e85a7e01ea15_q75f81yx
Jul 09 14:53:29 devstack sudo[106332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:29 devstack sudo[106322]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fd07bf7b-922d-4ef6-9189-0fac82d69f78 tempest-CreateVolumesFromImageTest-1713904690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-66e5a3a3-d617-4606-b0e7-dea19fa325a5" returned: 0 in 0.685s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:29 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-fd07bf7b-922d-4ef6-9189-0fac82d69f78 tempest-CreateVolumesFromImageTest-1713904690 None] Lock "cinder-quobyte-66e5a3a3-d617-4606-b0e7-dea19fa325a5" released by "delete_volume" :: held 1.591s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:53:29 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-fd07bf7b-922d-4ef6-9189-0fac82d69f78 tempest-CreateVolumesFromImageTest-1713904690 None] Created reservations ['fb9c7c37-7c8f-4aa6-9538-276467e7dfd9', '1320858e-8563-4e97-bdd9-b3150327cfdf', 'b87ad179-b3a5-474a-9aba-cb6facdd4208', '4d0c3c02-97d2-41a0-aa46-ccd4a4300559'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:53:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-fd07bf7b-922d-4ef6-9189-0fac82d69f78 tempest-CreateVolumesFromImageTest-1713904690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:53:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-fd07bf7b-922d-4ef6-9189-0fac82d69f78 tempest-CreateVolumesFromImageTest-1713904690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:53:29 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-fd07bf7b-922d-4ef6-9189-0fac82d69f78 tempest-CreateVolumesFromImageTest-1713904690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:53:29 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-fd07bf7b-922d-4ef6-9189-0fac82d69f78 tempest-CreateVolumesFromImageTest-1713904690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:53:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-fd07bf7b-922d-4ef6-9189-0fac82d69f78 tempest-CreateVolumesFromImageTest-1713904690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:53:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fd07bf7b-922d-4ef6-9189-0fac82d69f78 tempest-CreateVolumesFromImageTest-1713904690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:29 devstack sudo[106335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:53:29 devstack sudo[106335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:29 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-56f1950c-9036-4fa7-aa92-9de014fb154b tempest-CreateVolumesFromImageTest-1713904690 None] Acquiring lock "cinder-7c2b479e-4f53-416a-90d4-1abf8f2e6c0a-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:53:29 devstack sudo[106330]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c800a973-049d-423f-8f9e-659113ef2b97 tempest-CinderUnicodeTest-607122583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e9c9cfb7-0efa-46c7-827e-00985aee96d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e9c9cfb7-0efa-46c7-827e-00985aee96d6.42721a07-3271-4220-9f99-ccff6395549d 1G" returned: 0 in 0.887s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c800a973-049d-423f-8f9e-659113ef2b97 tempest-CinderUnicodeTest-607122583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9c9cfb7-0efa-46c7-827e-00985aee96d6 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e9c9cfb7-0efa-46c7-827e-00985aee96d6.42721a07-3271-4220-9f99-ccff6395549d {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:29 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-56f1950c-9036-4fa7-aa92-9de014fb154b tempest-CreateVolumesFromImageTest-1713904690 None] Lock "cinder-7c2b479e-4f53-416a-90d4-1abf8f2e6c0a-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:53:29 devstack sudo[106342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9c9cfb7-0efa-46c7-827e-00985aee96d6 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e9c9cfb7-0efa-46c7-827e-00985aee96d6.42721a07-3271-4220-9f99-ccff6395549d
Jul 09 14:53:29 devstack sudo[106342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:29 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-56f1950c-9036-4fa7-aa92-9de014fb154b tempest-CreateVolumesFromImageTest-1713904690 None] Acquiring lock "cinder-quobyte-7c2b479e-4f53-416a-90d4-1abf8f2e6c0a" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:53:29 devstack sudo[106332]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ceb8ace3-2997-4271-b7cd-4be2fbf90a6f tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9d926e91-885e-425a-9cc2-e85a7e01ea15_q75f81yx" returned: 1 in 0.868s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ceb8ace3-2997-4271-b7cd-4be2fbf90a6f tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9d926e91-885e-425a-9cc2-e85a7e01ea15_q75f81yx' failed. Not Retrying. {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 09 14:53:29 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb1b91a6-316e-45cf-984e-974db0b42050]: (4, 'raw') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:53:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ceb8ace3-2997-4271-b7cd-4be2fbf90a6f tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9d926e91-885e-425a-9cc2-e85a7e01ea15_zruez0fddevstack@QuobyteHD {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:29 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-56f1950c-9036-4fa7-aa92-9de014fb154b tempest-CreateVolumesFromImageTest-1713904690 None] Lock "cinder-quobyte-7c2b479e-4f53-416a-90d4-1abf8f2e6c0a" acquired by "delete_volume" :: waited 0.029s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:53:29 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f7070cd-2770-4caf-9bbc-05316357fbec]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:53:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-56f1950c-9036-4fa7-aa92-9de014fb154b tempest-CreateVolumesFromImageTest-1713904690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7c2b479e-4f53-416a-90d4-1abf8f2e6c0a {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:29 devstack sudo[106344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9d926e91-885e-425a-9cc2-e85a7e01ea15_zruez0fddevstack@QuobyteHD
Jul 09 14:53:29 devstack sudo[106344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:30 devstack sudo[106335]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:30 devstack sudo[106346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7c2b479e-4f53-416a-90d4-1abf8f2e6c0a
Jul 09 14:53:30 devstack sudo[106346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fd07bf7b-922d-4ef6-9189-0fac82d69f78 tempest-CreateVolumesFromImageTest-1713904690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.725s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:30 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-fd07bf7b-922d-4ef6-9189-0fac82d69f78 tempest-CreateVolumesFromImageTest-1713904690 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:53:30 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-fd07bf7b-922d-4ef6-9189-0fac82d69f78 tempest-CreateVolumesFromImageTest-1713904690 None] Deleted volume successfully.
Jul 09 14:53:30 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-fd07bf7b-922d-4ef6-9189-0fac82d69f78 tempest-CreateVolumesFromImageTest-1713904690 None] Lock "cinder-66e5a3a3-d617-4606-b0e7-dea19fa325a5-delete_volume" released by "delete_volume" :: held 2.567s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:53:30 devstack sudo[106342]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c800a973-049d-423f-8f9e-659113ef2b97 tempest-CinderUnicodeTest-607122583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9c9cfb7-0efa-46c7-827e-00985aee96d6 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e9c9cfb7-0efa-46c7-827e-00985aee96d6.42721a07-3271-4220-9f99-ccff6395549d" returned: 0 in 0.868s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:30 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-c800a973-049d-423f-8f9e-659113ef2b97 tempest-CinderUnicodeTest-607122583 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e9c9cfb7-0efa-46c7-827e-00985aee96d6.42721a07-3271-4220-9f99-ccff6395549d is being set with open permissions: ugo+rw
Jul 09 14:53:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c800a973-049d-423f-8f9e-659113ef2b97 tempest-CinderUnicodeTest-607122583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e9c9cfb7-0efa-46c7-827e-00985aee96d6.42721a07-3271-4220-9f99-ccff6395549d {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:30 devstack sudo[106344]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ceb8ace3-2997-4271-b7cd-4be2fbf90a6f tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9d926e91-885e-425a-9cc2-e85a7e01ea15_zruez0fddevstack@QuobyteHD" returned: 0 in 0.803s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ceb8ace3-2997-4271-b7cd-4be2fbf90a6f tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9d926e91-885e-425a-9cc2-e85a7e01ea15_zruez0fddevstack@QuobyteHD {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:30 devstack sudo[106358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e9c9cfb7-0efa-46c7-827e-00985aee96d6.42721a07-3271-4220-9f99-ccff6395549d
Jul 09 14:53:30 devstack sudo[106358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:30 devstack sudo[106346]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-56f1950c-9036-4fa7-aa92-9de014fb154b tempest-CreateVolumesFromImageTest-1713904690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7c2b479e-4f53-416a-90d4-1abf8f2e6c0a" returned: 0 in 0.814s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-56f1950c-9036-4fa7-aa92-9de014fb154b tempest-CreateVolumesFromImageTest-1713904690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7c2b479e-4f53-416a-90d4-1abf8f2e6c0a {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:30 devstack sudo[106361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7c2b479e-4f53-416a-90d4-1abf8f2e6c0a
Jul 09 14:53:30 devstack sudo[106361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:30 devstack sudo[106360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9d926e91-885e-425a-9cc2-e85a7e01ea15_zruez0fddevstack@QuobyteHD
Jul 09 14:53:30 devstack sudo[106360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:31 devstack sudo[106358]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c800a973-049d-423f-8f9e-659113ef2b97 tempest-CinderUnicodeTest-607122583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e9c9cfb7-0efa-46c7-827e-00985aee96d6.42721a07-3271-4220-9f99-ccff6395549d" returned: 0 in 0.676s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c800a973-049d-423f-8f9e-659113ef2b97 tempest-CinderUnicodeTest-607122583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e9c9cfb7-0efa-46c7-827e-00985aee96d6.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:31 devstack sudo[106370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e9c9cfb7-0efa-46c7-827e-00985aee96d6.info
Jul 09 14:53:31 devstack sudo[106370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:31 devstack sudo[106361]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-56f1950c-9036-4fa7-aa92-9de014fb154b tempest-CreateVolumesFromImageTest-1713904690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7c2b479e-4f53-416a-90d4-1abf8f2e6c0a" returned: 0 in 0.691s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:31 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-56f1950c-9036-4fa7-aa92-9de014fb154b tempest-CreateVolumesFromImageTest-1713904690 None] Lock "cinder-quobyte-7c2b479e-4f53-416a-90d4-1abf8f2e6c0a" released by "delete_volume" :: held 1.558s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:53:31 devstack sudo[106360]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ceb8ace3-2997-4271-b7cd-4be2fbf90a6f tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9d926e91-885e-425a-9cc2-e85a7e01ea15_zruez0fddevstack@QuobyteHD" returned: 1 in 0.774s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ceb8ace3-2997-4271-b7cd-4be2fbf90a6f tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9d926e91-885e-425a-9cc2-e85a7e01ea15_zruez0fddevstack@QuobyteHD' failed. Not Retrying. {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 09 14:53:31 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-ceb8ace3-2997-4271-b7cd-4be2fbf90a6f tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] 9d926e91-885e-425a-9cc2-e85a7e01ea15 was raw, converting to raw {{(pid=87230) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 09 14:53:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ceb8ace3-2997-4271-b7cd-4be2fbf90a6f tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_9d926e91-885e-425a-9cc2-e85a7e01ea15_zruez0fddevstack@QuobyteHD /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-dc0e4b6d-d47b-4b03-b243-55cf2200346b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:31 devstack sudo[106372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_9d926e91-885e-425a-9cc2-e85a7e01ea15_zruez0fddevstack@QuobyteHD /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-dc0e4b6d-d47b-4b03-b243-55cf2200346b
Jul 09 14:53:31 devstack sudo[106372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:31 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-56f1950c-9036-4fa7-aa92-9de014fb154b tempest-CreateVolumesFromImageTest-1713904690 None] Created reservations ['7e848599-af11-440c-a522-6f09f3d4a79e', '5bc9a9a5-b24a-4f12-8cfd-224c74d97b30', '750d0a92-47ca-4025-b86d-c2f75b05b7f6', '5ddbf2f8-af92-4125-b5c1-92867bf90fcb'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:53:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-56f1950c-9036-4fa7-aa92-9de014fb154b tempest-CreateVolumesFromImageTest-1713904690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:53:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-56f1950c-9036-4fa7-aa92-9de014fb154b tempest-CreateVolumesFromImageTest-1713904690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:53:31 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-56f1950c-9036-4fa7-aa92-9de014fb154b tempest-CreateVolumesFromImageTest-1713904690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:53:31 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-56f1950c-9036-4fa7-aa92-9de014fb154b tempest-CreateVolumesFromImageTest-1713904690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:53:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-56f1950c-9036-4fa7-aa92-9de014fb154b tempest-CreateVolumesFromImageTest-1713904690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:53:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-56f1950c-9036-4fa7-aa92-9de014fb154b tempest-CreateVolumesFromImageTest-1713904690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:31 devstack sudo[106374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:53:31 devstack sudo[106374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:32 devstack sudo[106370]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c800a973-049d-423f-8f9e-659113ef2b97 tempest-CinderUnicodeTest-607122583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e9c9cfb7-0efa-46c7-827e-00985aee96d6.info" returned: 0 in 0.694s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:32 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-c800a973-049d-423f-8f9e-659113ef2b97 tempest-CinderUnicodeTest-607122583 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e9c9cfb7-0efa-46c7-827e-00985aee96d6.info is being set with open permissions: ugo+rw
Jul 09 14:53:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c800a973-049d-423f-8f9e-659113ef2b97 tempest-CinderUnicodeTest-607122583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e9c9cfb7-0efa-46c7-827e-00985aee96d6.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:32 devstack sudo[106379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e9c9cfb7-0efa-46c7-827e-00985aee96d6.info
Jul 09 14:53:32 devstack sudo[106379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:32 devstack sudo[106372]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ceb8ace3-2997-4271-b7cd-4be2fbf90a6f tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_9d926e91-885e-425a-9cc2-e85a7e01ea15_zruez0fddevstack@QuobyteHD /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-dc0e4b6d-d47b-4b03-b243-55cf2200346b" returned: 0 in 0.855s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:32 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-ceb8ace3-2997-4271-b7cd-4be2fbf90a6f tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9d926e91-885e-425a-9cc2-e85a7e01ea15_zruez0fddevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-dc0e4b6d-d47b-4b03-b243-55cf2200346b {{(pid=87230) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 09 14:53:32 devstack cinder-volume[87230]: INFO cinder.image.image_utils [None req-ceb8ace3-2997-4271-b7cd-4be2fbf90a6f tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] Converted 0.00 MB image at 0.00 MB/s
Jul 09 14:53:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ceb8ace3-2997-4271-b7cd-4be2fbf90a6f tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-dc0e4b6d-d47b-4b03-b243-55cf2200346b 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:32 devstack sudo[106374]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-56f1950c-9036-4fa7-aa92-9de014fb154b tempest-CreateVolumesFromImageTest-1713904690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.736s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:32 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-56f1950c-9036-4fa7-aa92-9de014fb154b tempest-CreateVolumesFromImageTest-1713904690 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:53:32 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-56f1950c-9036-4fa7-aa92-9de014fb154b tempest-CreateVolumesFromImageTest-1713904690 None] Deleted volume successfully.
Jul 09 14:53:32 devstack sudo[106383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-dc0e4b6d-d47b-4b03-b243-55cf2200346b 1G
Jul 09 14:53:32 devstack sudo[106383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:32 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-56f1950c-9036-4fa7-aa92-9de014fb154b tempest-CreateVolumesFromImageTest-1713904690 None] Lock "cinder-7c2b479e-4f53-416a-90d4-1abf8f2e6c0a-delete_volume" released by "delete_volume" :: held 2.587s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:53:32 devstack sudo[106379]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c800a973-049d-423f-8f9e-659113ef2b97 tempest-CinderUnicodeTest-607122583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e9c9cfb7-0efa-46c7-827e-00985aee96d6.info" returned: 0 in 0.790s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c800a973-049d-423f-8f9e-659113ef2b97 tempest-CinderUnicodeTest-607122583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.861s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:53:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5618e0cc-a969-4f68-ab94-f991c1cfb313 tempest-VolumeDependencyTests-127658737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.646s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:53:32 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-5618e0cc-a969-4f68-ab94-f991c1cfb313 tempest-VolumeDependencyTests-127658737 None] Acquiring lock "cinder-quobyte-58d1aedc-21cd-4caa-89e8-deafb161b408-141a3fff-e7f9-4be9-85a1-cf9f82481a29" by "_create_volume_from_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:53:32 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-5618e0cc-a969-4f68-ab94-f991c1cfb313 tempest-VolumeDependencyTests-127658737 None] Lock "cinder-quobyte-58d1aedc-21cd-4caa-89e8-deafb161b408-141a3fff-e7f9-4be9-85a1-cf9f82481a29" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:53:32 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-5618e0cc-a969-4f68-ab94-f991c1cfb313 tempest-VolumeDependencyTests-127658737 None] Creating volume 141a3fff-e7f9-4be9-85a1-cf9f82481a29 from snapshot 58d1aedc-21cd-4caa-89e8-deafb161b408 {{(pid=87230) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 09 14:53:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5618e0cc-a969-4f68-ab94-f991c1cfb313 tempest-VolumeDependencyTests-127658737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:53:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5618e0cc-a969-4f68-ab94-f991c1cfb313 tempest-VolumeDependencyTests-127658737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:53:32 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-5618e0cc-a969-4f68-ab94-f991c1cfb313 tempest-VolumeDependencyTests-127658737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:53:32 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-5618e0cc-a969-4f68-ab94-f991c1cfb313 tempest-VolumeDependencyTests-127658737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:53:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5618e0cc-a969-4f68-ab94-f991c1cfb313 tempest-VolumeDependencyTests-127658737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:53:32 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-5618e0cc-a969-4f68-ab94-f991c1cfb313 tempest-VolumeDependencyTests-127658737 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:53:32 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-5618e0cc-a969-4f68-ab94-f991c1cfb313 tempest-VolumeDependencyTests-127658737 None] Acquiring lock "cinder-quobyte-141a3fff-e7f9-4be9-85a1-cf9f82481a29" by "_copy_volume_from_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:53:32 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-c800a973-049d-423f-8f9e-659113ef2b97 tempest-CinderUnicodeTest-607122583 None] Create snapshot completed successfully
Jul 09 14:53:32 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-5618e0cc-a969-4f68-ab94-f991c1cfb313 tempest-VolumeDependencyTests-127658737 None] Lock "cinder-quobyte-141a3fff-e7f9-4be9-85a1-cf9f82481a29" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:53:32 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-5618e0cc-a969-4f68-ab94-f991c1cfb313 tempest-VolumeDependencyTests-127658737 None] snapshot: 58d1aedc-21cd-4caa-89e8-deafb161b408, volume: 141a3fff-e7f9-4be9-85a1-cf9f82481a29,  {{(pid=87230) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 09 14:53:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5618e0cc-a969-4f68-ab94-f991c1cfb313 tempest-VolumeDependencyTests-127658737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:53:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5618e0cc-a969-4f68-ab94-f991c1cfb313 tempest-VolumeDependencyTests-127658737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:53:32 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-5618e0cc-a969-4f68-ab94-f991c1cfb313 tempest-VolumeDependencyTests-127658737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:53:32 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-5618e0cc-a969-4f68-ab94-f991c1cfb313 tempest-VolumeDependencyTests-127658737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:53:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5618e0cc-a969-4f68-ab94-f991c1cfb313 tempest-VolumeDependencyTests-127658737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:53:32 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[e432d0fa-7856-4cd8-8232-39f92aee0522]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:53:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5618e0cc-a969-4f68-ab94-f991c1cfb313 tempest-VolumeDependencyTests-127658737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7cda90fb-b664-43b9-b3e1-12fc01b2c2d2.58d1aedc-21cd-4caa-89e8-deafb161b408 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:33 devstack sudo[106383]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ceb8ace3-2997-4271-b7cd-4be2fbf90a6f tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-dc0e4b6d-d47b-4b03-b243-55cf2200346b 1G" returned: 0 in 0.755s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:33 devstack sudo[106389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7cda90fb-b664-43b9-b3e1-12fc01b2c2d2.58d1aedc-21cd-4caa-89e8-deafb161b408
Jul 09 14:53:33 devstack sudo[106389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:33 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a2d48fb-3893-4b8f-9c51-78fcef600ae5]: (4, 'raw') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:53:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ceb8ace3-2997-4271-b7cd-4be2fbf90a6f tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-dc0e4b6d-d47b-4b03-b243-55cf2200346b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:33 devstack sudo[106391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-dc0e4b6d-d47b-4b03-b243-55cf2200346b
Jul 09 14:53:33 devstack sudo[106391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:33 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-246e7d55-16b0-4ca7-a4a7-4f2267ddd135 tempest-CinderUnicodeTest-607122583 None] Acquiring lock "cinder-42721a07-3271-4220-9f99-ccff6395549d-delete_snapshot" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:53:33 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-246e7d55-16b0-4ca7-a4a7-4f2267ddd135 tempest-CinderUnicodeTest-607122583 None] Lock "cinder-42721a07-3271-4220-9f99-ccff6395549d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:53:33 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-246e7d55-16b0-4ca7-a4a7-4f2267ddd135 tempest-CinderUnicodeTest-607122583 None] Acquiring lock "cinder-quobyte-e9c9cfb7-0efa-46c7-827e-00985aee96d6" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:53:33 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-246e7d55-16b0-4ca7-a4a7-4f2267ddd135 tempest-CinderUnicodeTest-607122583 None] Lock "cinder-quobyte-e9c9cfb7-0efa-46c7-827e-00985aee96d6" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:53:33 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-246e7d55-16b0-4ca7-a4a7-4f2267ddd135 tempest-CinderUnicodeTest-607122583 None] Acquiring lock "cinder-quobyte-42721a07-3271-4220-9f99-ccff6395549d" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:53:33 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-246e7d55-16b0-4ca7-a4a7-4f2267ddd135 tempest-CinderUnicodeTest-607122583 None] Lock "cinder-quobyte-42721a07-3271-4220-9f99-ccff6395549d" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:53:33 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-246e7d55-16b0-4ca7-a4a7-4f2267ddd135 tempest-CinderUnicodeTest-607122583 None] Deleting offline snapshot 42721a07-3271-4220-9f99-ccff6395549d of volume e9c9cfb7-0efa-46c7-827e-00985aee96d6 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 14:53:33 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-246e7d55-16b0-4ca7-a4a7-4f2267ddd135 tempest-CinderUnicodeTest-607122583 None] snapshot_file for this snap is: volume-e9c9cfb7-0efa-46c7-827e-00985aee96d6.42721a07-3271-4220-9f99-ccff6395549d {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 14:53:33 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[857d1aff-d824-4c2a-9685-433e674259a8]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:53:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-246e7d55-16b0-4ca7-a4a7-4f2267ddd135 tempest-CinderUnicodeTest-607122583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e9c9cfb7-0efa-46c7-827e-00985aee96d6.42721a07-3271-4220-9f99-ccff6395549d {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:33 devstack sudo[106393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e9c9cfb7-0efa-46c7-827e-00985aee96d6.42721a07-3271-4220-9f99-ccff6395549d
Jul 09 14:53:33 devstack sudo[106393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:33 devstack sudo[106389]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5618e0cc-a969-4f68-ab94-f991c1cfb313 tempest-VolumeDependencyTests-127658737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7cda90fb-b664-43b9-b3e1-12fc01b2c2d2.58d1aedc-21cd-4caa-89e8-deafb161b408" returned: 0 in 0.981s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:33 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-5618e0cc-a969-4f68-ab94-f991c1cfb313 tempest-VolumeDependencyTests-127658737 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7cda90fb-b664-43b9-b3e1-12fc01b2c2d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 14:53:33 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-5618e0cc-a969-4f68-ab94-f991c1cfb313 tempest-VolumeDependencyTests-127658737 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7cda90fb-b664-43b9-b3e1-12fc01b2c2d2 {{(pid=87230) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 09 14:53:33 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-5618e0cc-a969-4f68-ab94-f991c1cfb313 tempest-VolumeDependencyTests-127658737 None] Creating direct copy from snapshot {{(pid=87230) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 09 14:53:33 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f471bbc-860a-45d1-8830-e47e90425feb]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:53:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5618e0cc-a969-4f68-ab94-f991c1cfb313 tempest-VolumeDependencyTests-127658737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7cda90fb-b664-43b9-b3e1-12fc01b2c2d2 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:34 devstack sudo[106391]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ceb8ace3-2997-4271-b7cd-4be2fbf90a6f tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-dc0e4b6d-d47b-4b03-b243-55cf2200346b" returned: 0 in 0.971s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ceb8ace3-2997-4271-b7cd-4be2fbf90a6f tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-dc0e4b6d-d47b-4b03-b243-55cf2200346b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:34 devstack sudo[106402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7cda90fb-b664-43b9-b3e1-12fc01b2c2d2
Jul 09 14:53:34 devstack sudo[106402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:34 devstack sudo[106403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-dc0e4b6d-d47b-4b03-b243-55cf2200346b
Jul 09 14:53:34 devstack sudo[106403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:34 devstack sudo[106393]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-246e7d55-16b0-4ca7-a4a7-4f2267ddd135 tempest-CinderUnicodeTest-607122583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e9c9cfb7-0efa-46c7-827e-00985aee96d6.42721a07-3271-4220-9f99-ccff6395549d" returned: 0 in 0.949s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:34 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-246e7d55-16b0-4ca7-a4a7-4f2267ddd135 tempest-CinderUnicodeTest-607122583 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e9c9cfb7-0efa-46c7-827e-00985aee96d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 14:53:34 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4303eb0-3972-48b3-a74e-95a102b7e836]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:53:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-246e7d55-16b0-4ca7-a4a7-4f2267ddd135 tempest-CinderUnicodeTest-607122583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e9c9cfb7-0efa-46c7-827e-00985aee96d6 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:34 devstack sudo[106409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e9c9cfb7-0efa-46c7-827e-00985aee96d6
Jul 09 14:53:34 devstack sudo[106409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:34 devstack sudo[106402]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5618e0cc-a969-4f68-ab94-f991c1cfb313 tempest-VolumeDependencyTests-127658737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7cda90fb-b664-43b9-b3e1-12fc01b2c2d2" returned: 0 in 0.952s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:34 devstack cinder-volume[87230]: DEBUG cinder.utils [None req-5618e0cc-a969-4f68-ab94-f991c1cfb313 tempest-VolumeDependencyTests-127658737 None] Path /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-141a3fff-e7f9-4be9-85a1-cf9f82481a29 not found in is_blk_device check {{(pid=87230) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 09 14:53:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5618e0cc-a969-4f68-ab94-f991c1cfb313 tempest-VolumeDependencyTests-127658737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7cda90fb-b664-43b9-b3e1-12fc01b2c2d2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-141a3fff-e7f9-4be9-85a1-cf9f82481a29 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:34 devstack sudo[106418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7cda90fb-b664-43b9-b3e1-12fc01b2c2d2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-141a3fff-e7f9-4be9-85a1-cf9f82481a29
Jul 09 14:53:34 devstack sudo[106418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:35 devstack sudo[106403]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ceb8ace3-2997-4271-b7cd-4be2fbf90a6f tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-dc0e4b6d-d47b-4b03-b243-55cf2200346b" returned: 1 in 0.962s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ceb8ace3-2997-4271-b7cd-4be2fbf90a6f tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-dc0e4b6d-d47b-4b03-b243-55cf2200346b' failed. Not Retrying. {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 09 14:53:35 devstack cinder-volume[87230]: DEBUG cinder.volume.volume_utils [None req-ceb8ace3-2997-4271-b7cd-4be2fbf90a6f tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] Downloaded image 9d926e91-885e-425a-9cc2-e85a7e01ea15 ((None, [{'url': 'file:///opt/stack/data/glance/images/9d926e91-885e-425a-9cc2-e85a7e01ea15', 'metadata': {}}])) to volume dc0e4b6d-d47b-4b03-b243-55cf2200346b successfully. {{(pid=87230) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 09 14:53:35 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-ceb8ace3-2997-4271-b7cd-4be2fbf90a6f tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] Temporary image 9d926e91-885e-425a-9cc2-e85a7e01ea15 for user fbd3c79858434fe4b148942aff249141 is deleted. {{(pid=87230) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 09 14:53:35 devstack cinder-volume[87230]: DEBUG cinder.volume.volume_utils [None req-ceb8ace3-2997-4271-b7cd-4be2fbf90a6f tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] Marking volume dc0e4b6d-d47b-4b03-b243-55cf2200346b as bootable. {{(pid=87230) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 09 14:53:35 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-ceb8ace3-2997-4271-b7cd-4be2fbf90a6f tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] Copying metadata from image 9d926e91-885e-425a-9cc2-e85a7e01ea15 to dc0e4b6d-d47b-4b03-b243-55cf2200346b. {{(pid=87230) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 09 14:53:35 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-ceb8ace3-2997-4271-b7cd-4be2fbf90a6f tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] Creating volume glance metadata for volume dc0e4b6d-d47b-4b03-b243-55cf2200346b backed by image 9d926e91-885e-425a-9cc2-e85a7e01ea15 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '9d926e91-885e-425a-9cc2-e85a7e01ea15', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '66d61230757634401b4dfa86ce0e7a7a', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87230) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 09 14:53:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ceb8ace3-2997-4271-b7cd-4be2fbf90a6f tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ae040ed-744d-47ce-8e07-55391bc773c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc0e4b6d-d47b-4b03-b243-55cf2200346b', 'volume_size': 1, 'image_id': '9d926e91-885e-425a-9cc2-e85a7e01ea15', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9d926e91-885e-425a-9cc2-e85a7e01ea15', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '66d61230757634401b4dfa86ce0e7a7a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bb91c0c23721478ba70cc66bfc4d5371', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '10f2980dbf80b2a32a9aff338303d7990600a889f4caf88417db7345b4c2246cba5e5edbd56ec070bb089c13668dde10efc9cb29509c07afa54fb9885eeba54a', 'id': '9d926e91-885e-425a-9cc2-e85a7e01ea15', 'created_at': datetime.datetime(2026, 7, 9, 12, 53, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 12, 53, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9d926e91-885e-425a-9cc2-e85a7e01ea15/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x720a54d61a90>}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ceb8ace3-2997-4271-b7cd-4be2fbf90a6f tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (371190bb-f549-4a69-aa3e-5323a72fb9d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:35 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-ceb8ace3-2997-4271-b7cd-4be2fbf90a6f tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] Volume volume-dc0e4b6d-d47b-4b03-b243-55cf2200346b (dc0e4b6d-d47b-4b03-b243-55cf2200346b): created successfully
Jul 09 14:53:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ceb8ace3-2997-4271-b7cd-4be2fbf90a6f tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (371190bb-f549-4a69-aa3e-5323a72fb9d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ceb8ace3-2997-4271-b7cd-4be2fbf90a6f tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] Flow 'volume_create_manager' (368d8354-b91d-48fa-9b29-6a39011b63ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:53:35 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-ceb8ace3-2997-4271-b7cd-4be2fbf90a6f tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] Created volume successfully.
Jul 09 14:53:35 devstack sudo[106409]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-246e7d55-16b0-4ca7-a4a7-4f2267ddd135 tempest-CinderUnicodeTest-607122583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e9c9cfb7-0efa-46c7-827e-00985aee96d6" returned: 0 in 0.909s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-246e7d55-16b0-4ca7-a4a7-4f2267ddd135 tempest-CinderUnicodeTest-607122583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e9c9cfb7-0efa-46c7-827e-00985aee96d6.42721a07-3271-4220-9f99-ccff6395549d {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:35 devstack sudo[106424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e9c9cfb7-0efa-46c7-827e-00985aee96d6.42721a07-3271-4220-9f99-ccff6395549d
Jul 09 14:53:35 devstack sudo[106424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:35 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-054d4e16-de8e-4a8a-b617-ffd0858385ac tempest-CreateVolumesFromSnapshotTest-303675828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:53:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-054d4e16-de8e-4a8a-b617-ffd0858385ac tempest-CreateVolumesFromSnapshotTest-303675828 None] Flow 'volume_create_manager' (db8b397f-ea65-4250-b2d7-073becbd6b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:53:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-054d4e16-de8e-4a8a-b617-ffd0858385ac tempest-CreateVolumesFromSnapshotTest-303675828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5a7be89-7b34-4046-9935-11d1e8a78ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-054d4e16-de8e-4a8a-b617-ffd0858385ac tempest-CreateVolumesFromSnapshotTest-303675828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5a7be89-7b34-4046-9935-11d1e8a78ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:53:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1453751430',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac7156ee-f183-4cff-9c09-a0bb86fac1f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bdfa284f5f6481594efaef07327b635',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:53:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:53:36Z,use_quota=True,user_id='36176575013d49d9a0b32ee854b6efea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-054d4e16-de8e-4a8a-b617-ffd0858385ac tempest-CreateVolumesFromSnapshotTest-303675828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32004f24-b4bb-4338-bf6f-fad05b91e642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-054d4e16-de8e-4a8a-b617-ffd0858385ac tempest-CreateVolumesFromSnapshotTest-303675828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32004f24-b4bb-4338-bf6f-fad05b91e642) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-054d4e16-de8e-4a8a-b617-ffd0858385ac tempest-CreateVolumesFromSnapshotTest-303675828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7c57c20-aef4-4cb6-8fee-4fba3e1339e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-054d4e16-de8e-4a8a-b617-ffd0858385ac tempest-CreateVolumesFromSnapshotTest-303675828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7c57c20-aef4-4cb6-8fee-4fba3e1339e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac7156ee-f183-4cff-9c09-a0bb86fac1f7', 'volume_name': 'volume-ac7156ee-f183-4cff-9c09-a0bb86fac1f7', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-054d4e16-de8e-4a8a-b617-ffd0858385ac tempest-CreateVolumesFromSnapshotTest-303675828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9fcbd86-80e0-46c5-be69-a53528c771b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-054d4e16-de8e-4a8a-b617-ffd0858385ac tempest-CreateVolumesFromSnapshotTest-303675828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9fcbd86-80e0-46c5-be69-a53528c771b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-054d4e16-de8e-4a8a-b617-ffd0858385ac tempest-CreateVolumesFromSnapshotTest-303675828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f0d5b72-6c65-4bcd-8ce8-fc3631eef572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:35 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-054d4e16-de8e-4a8a-b617-ffd0858385ac tempest-CreateVolumesFromSnapshotTest-303675828 None] Volume ac7156ee-f183-4cff-9c09-a0bb86fac1f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac7156ee-f183-4cff-9c09-a0bb86fac1f7', 'volume_size': 1}
Jul 09 14:53:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-054d4e16-de8e-4a8a-b617-ffd0858385ac tempest-CreateVolumesFromSnapshotTest-303675828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:53:35 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-9f62d5d7-0e2a-40c6-8291-19ba76532345 tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] Acquiring lock "cinder-dc0e4b6d-d47b-4b03-b243-55cf2200346b-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:53:35 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-9f62d5d7-0e2a-40c6-8291-19ba76532345 tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] Lock "cinder-dc0e4b6d-d47b-4b03-b243-55cf2200346b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:53:35 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-9f62d5d7-0e2a-40c6-8291-19ba76532345 tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] Acquiring lock "cinder-quobyte-dc0e4b6d-d47b-4b03-b243-55cf2200346b" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:53:35 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-9f62d5d7-0e2a-40c6-8291-19ba76532345 tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] Lock "cinder-quobyte-dc0e4b6d-d47b-4b03-b243-55cf2200346b" acquired by "delete_volume" :: waited 0.045s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:53:36 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e3664f-a1d8-498f-81f8-ba62dc4ea955]: (4, 'raw') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:53:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9f62d5d7-0e2a-40c6-8291-19ba76532345 tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-dc0e4b6d-d47b-4b03-b243-55cf2200346b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:36 devstack sudo[106436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-dc0e4b6d-d47b-4b03-b243-55cf2200346b
Jul 09 14:53:36 devstack sudo[106436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:36 devstack sudo[106424]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-246e7d55-16b0-4ca7-a4a7-4f2267ddd135 tempest-CinderUnicodeTest-607122583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e9c9cfb7-0efa-46c7-827e-00985aee96d6.42721a07-3271-4220-9f99-ccff6395549d" returned: 0 in 1.336s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-246e7d55-16b0-4ca7-a4a7-4f2267ddd135 tempest-CinderUnicodeTest-607122583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e9c9cfb7-0efa-46c7-827e-00985aee96d6.42721a07-3271-4220-9f99-ccff6395549d {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:36 devstack sudo[106442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e9c9cfb7-0efa-46c7-827e-00985aee96d6.42721a07-3271-4220-9f99-ccff6395549d
Jul 09 14:53:36 devstack sudo[106442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:37 devstack sudo[106436]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9f62d5d7-0e2a-40c6-8291-19ba76532345 tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-dc0e4b6d-d47b-4b03-b243-55cf2200346b" returned: 0 in 1.434s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9f62d5d7-0e2a-40c6-8291-19ba76532345 tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-dc0e4b6d-d47b-4b03-b243-55cf2200346b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:37 devstack sudo[106446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-dc0e4b6d-d47b-4b03-b243-55cf2200346b
Jul 09 14:53:37 devstack sudo[106446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:38 devstack sudo[106442]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-246e7d55-16b0-4ca7-a4a7-4f2267ddd135 tempest-CinderUnicodeTest-607122583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e9c9cfb7-0efa-46c7-827e-00985aee96d6.42721a07-3271-4220-9f99-ccff6395549d" returned: 0 in 1.746s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:38 devstack sudo[106446]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9f62d5d7-0e2a-40c6-8291-19ba76532345 tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-dc0e4b6d-d47b-4b03-b243-55cf2200346b" returned: 1 in 1.249s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9f62d5d7-0e2a-40c6-8291-19ba76532345 tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-dc0e4b6d-d47b-4b03-b243-55cf2200346b' failed. Not Retrying. {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 09 14:53:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9f62d5d7-0e2a-40c6-8291-19ba76532345 tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-dc0e4b6d-d47b-4b03-b243-55cf2200346b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:38 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-246e7d55-16b0-4ca7-a4a7-4f2267ddd135 tempest-CinderUnicodeTest-607122583 None] Lock "cinder-quobyte-42721a07-3271-4220-9f99-ccff6395549d" released by "_delete_snapshot" :: held 5.240s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:53:38 devstack sudo[106452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-dc0e4b6d-d47b-4b03-b243-55cf2200346b
Jul 09 14:53:38 devstack sudo[106452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:38 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-246e7d55-16b0-4ca7-a4a7-4f2267ddd135 tempest-CinderUnicodeTest-607122583 None] Lock "cinder-quobyte-e9c9cfb7-0efa-46c7-827e-00985aee96d6" released by "delete_snapshot" :: held 5.308s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:53:39 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-246e7d55-16b0-4ca7-a4a7-4f2267ddd135 tempest-CinderUnicodeTest-607122583 None] Created reservations ['ad860bdd-15ac-413c-b068-87353377da1a', '4fa75240-af47-4062-b1bb-b5784c4fddba', 'b1facb9e-ffdc-42be-9ce5-2c9177141d4b', 'abb1d802-978b-467d-b72e-e404a0d5549d'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:53:39 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-246e7d55-16b0-4ca7-a4a7-4f2267ddd135 tempest-CinderUnicodeTest-607122583 None] Delete snapshot completed successfully.
Jul 09 14:53:39 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-246e7d55-16b0-4ca7-a4a7-4f2267ddd135 tempest-CinderUnicodeTest-607122583 None] Lock "cinder-42721a07-3271-4220-9f99-ccff6395549d-delete_snapshot" released by "delete_snapshot" :: held 5.833s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:53:39 devstack sudo[106452]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9f62d5d7-0e2a-40c6-8291-19ba76532345 tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-dc0e4b6d-d47b-4b03-b243-55cf2200346b" returned: 0 in 1.173s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:39 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-9f62d5d7-0e2a-40c6-8291-19ba76532345 tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] Lock "cinder-quobyte-dc0e4b6d-d47b-4b03-b243-55cf2200346b" released by "delete_volume" :: held 4.018s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:53:40 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-9f62d5d7-0e2a-40c6-8291-19ba76532345 tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] Created reservations ['b1c1dec6-e3fe-460f-b509-aba4478012ef', '32719078-2fe7-4b25-b995-aa0e26c76d11', 'a97e4208-9e7d-4487-a69c-b1da9364e7bc', '531b9b15-609c-4320-9c09-ed564ad06aad'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:53:40 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7e1b715c-06ed-40e2-ab11-7c284cb0f3a8 tempest-CinderUnicodeTest-607122583 None] Acquiring lock "cinder-e9c9cfb7-0efa-46c7-827e-00985aee96d6-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:53:40 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7e1b715c-06ed-40e2-ab11-7c284cb0f3a8 tempest-CinderUnicodeTest-607122583 None] Lock "cinder-e9c9cfb7-0efa-46c7-827e-00985aee96d6-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:53:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9f62d5d7-0e2a-40c6-8291-19ba76532345 tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:53:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9f62d5d7-0e2a-40c6-8291-19ba76532345 tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:53:40 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9f62d5d7-0e2a-40c6-8291-19ba76532345 tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:53:40 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9f62d5d7-0e2a-40c6-8291-19ba76532345 tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:53:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9f62d5d7-0e2a-40c6-8291-19ba76532345 tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:53:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9f62d5d7-0e2a-40c6-8291-19ba76532345 tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:40 devstack sudo[106455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:53:40 devstack sudo[106455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:40 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7e1b715c-06ed-40e2-ab11-7c284cb0f3a8 tempest-CinderUnicodeTest-607122583 None] Acquiring lock "cinder-quobyte-e9c9cfb7-0efa-46c7-827e-00985aee96d6" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:53:40 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7e1b715c-06ed-40e2-ab11-7c284cb0f3a8 tempest-CinderUnicodeTest-607122583 None] Lock "cinder-quobyte-e9c9cfb7-0efa-46c7-827e-00985aee96d6" acquired by "delete_volume" :: waited 0.053s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:53:40 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[0014e25e-c5d5-4821-aa87-67e55d8ec908]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:53:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7e1b715c-06ed-40e2-ab11-7c284cb0f3a8 tempest-CinderUnicodeTest-607122583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e9c9cfb7-0efa-46c7-827e-00985aee96d6 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:40 devstack sudo[106457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e9c9cfb7-0efa-46c7-827e-00985aee96d6
Jul 09 14:53:40 devstack sudo[106457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:41 devstack sudo[106418]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5618e0cc-a969-4f68-ab94-f991c1cfb313 tempest-VolumeDependencyTests-127658737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7cda90fb-b664-43b9-b3e1-12fc01b2c2d2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-141a3fff-e7f9-4be9-85a1-cf9f82481a29" returned: 0 in 6.067s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:41 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f8cd58-aa0e-4f3e-8969-09a149d39f4c]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:53:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5618e0cc-a969-4f68-ab94-f991c1cfb313 tempest-VolumeDependencyTests-127658737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7cda90fb-b664-43b9-b3e1-12fc01b2c2d2 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:41 devstack sudo[106460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7cda90fb-b664-43b9-b3e1-12fc01b2c2d2
Jul 09 14:53:41 devstack sudo[106460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:41 devstack sudo[106455]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9f62d5d7-0e2a-40c6-8291-19ba76532345 tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.951s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:41 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-9f62d5d7-0e2a-40c6-8291-19ba76532345 tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:53:41 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-9f62d5d7-0e2a-40c6-8291-19ba76532345 tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] Deleted volume successfully.
Jul 09 14:53:41 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-9f62d5d7-0e2a-40c6-8291-19ba76532345 tempest-VolumeAndVolumeTypeFromImageTest-1233119232 None] Lock "cinder-dc0e4b6d-d47b-4b03-b243-55cf2200346b-delete_volume" released by "delete_volume" :: held 5.596s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:53:41 devstack sudo[106457]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7e1b715c-06ed-40e2-ab11-7c284cb0f3a8 tempest-CinderUnicodeTest-607122583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e9c9cfb7-0efa-46c7-827e-00985aee96d6" returned: 0 in 0.975s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7e1b715c-06ed-40e2-ab11-7c284cb0f3a8 tempest-CinderUnicodeTest-607122583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e9c9cfb7-0efa-46c7-827e-00985aee96d6 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:41 devstack sudo[106467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e9c9cfb7-0efa-46c7-827e-00985aee96d6
Jul 09 14:53:41 devstack sudo[106467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:42 devstack sudo[106460]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5618e0cc-a969-4f68-ab94-f991c1cfb313 tempest-VolumeDependencyTests-127658737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7cda90fb-b664-43b9-b3e1-12fc01b2c2d2" returned: 0 in 1.103s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:42 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-5618e0cc-a969-4f68-ab94-f991c1cfb313 tempest-VolumeDependencyTests-127658737 None] Image conversion details: src /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7cda90fb-b664-43b9-b3e1-12fc01b2c2d2, size 1024.00 MB, duration 6.07 sec, destination /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-141a3fff-e7f9-4be9-85a1-cf9f82481a29 {{(pid=87230) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 09 14:53:42 devstack cinder-volume[87230]: INFO cinder.image.image_utils [None req-5618e0cc-a969-4f68-ab94-f991c1cfb313 tempest-VolumeDependencyTests-127658737 None] Converted 1024.00 MB image at 168.73 MB/s
Jul 09 14:53:42 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-5618e0cc-a969-4f68-ab94-f991c1cfb313 tempest-VolumeDependencyTests-127658737 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-141a3fff-e7f9-4be9-85a1-cf9f82481a29 is being set with open permissions: ugo+rw
Jul 09 14:53:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5618e0cc-a969-4f68-ab94-f991c1cfb313 tempest-VolumeDependencyTests-127658737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-141a3fff-e7f9-4be9-85a1-cf9f82481a29 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:42 devstack sudo[106472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-141a3fff-e7f9-4be9-85a1-cf9f82481a29
Jul 09 14:53:42 devstack sudo[106472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:42 devstack sudo[106467]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7e1b715c-06ed-40e2-ab11-7c284cb0f3a8 tempest-CinderUnicodeTest-607122583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e9c9cfb7-0efa-46c7-827e-00985aee96d6" returned: 0 in 0.733s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:42 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7e1b715c-06ed-40e2-ab11-7c284cb0f3a8 tempest-CinderUnicodeTest-607122583 None] Lock "cinder-quobyte-e9c9cfb7-0efa-46c7-827e-00985aee96d6" released by "delete_volume" :: held 1.871s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:53:42 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-7e1b715c-06ed-40e2-ab11-7c284cb0f3a8 tempest-CinderUnicodeTest-607122583 None] Created reservations ['ac67ad06-b354-4c47-8d53-63571d409235', '786fbf4a-6b8e-450f-8356-50509a8f7a53', 'c167506f-0119-458a-a71a-e6690ed802c4', '5a8b387e-be1e-4710-9de6-9dfba9dd8dac'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:53:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7e1b715c-06ed-40e2-ab11-7c284cb0f3a8 tempest-CinderUnicodeTest-607122583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:53:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7e1b715c-06ed-40e2-ab11-7c284cb0f3a8 tempest-CinderUnicodeTest-607122583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:53:42 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7e1b715c-06ed-40e2-ab11-7c284cb0f3a8 tempest-CinderUnicodeTest-607122583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:53:42 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7e1b715c-06ed-40e2-ab11-7c284cb0f3a8 tempest-CinderUnicodeTest-607122583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:53:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7e1b715c-06ed-40e2-ab11-7c284cb0f3a8 tempest-CinderUnicodeTest-607122583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:53:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7e1b715c-06ed-40e2-ab11-7c284cb0f3a8 tempest-CinderUnicodeTest-607122583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:42 devstack sudo[106475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:53:42 devstack sudo[106475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:42 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d7670f35-27c3-48fc-99dc-0547ca160c44 tempest-CinderUnicodeTest-607122583 None] Acquiring lock "cinder-ce2327e9-5644-45ef-92b1-f2daebecb605-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:53:42 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d7670f35-27c3-48fc-99dc-0547ca160c44 tempest-CinderUnicodeTest-607122583 None] Lock "cinder-ce2327e9-5644-45ef-92b1-f2daebecb605-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:53:42 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d7670f35-27c3-48fc-99dc-0547ca160c44 tempest-CinderUnicodeTest-607122583 None] Acquiring lock "cinder-quobyte-ce2327e9-5644-45ef-92b1-f2daebecb605" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:53:42 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d7670f35-27c3-48fc-99dc-0547ca160c44 tempest-CinderUnicodeTest-607122583 None] Lock "cinder-quobyte-ce2327e9-5644-45ef-92b1-f2daebecb605" acquired by "delete_volume" :: waited 0.018s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:53:42 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a90e02-e4b3-4e42-9521-f34400948e1e]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:53:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d7670f35-27c3-48fc-99dc-0547ca160c44 tempest-CinderUnicodeTest-607122583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ce2327e9-5644-45ef-92b1-f2daebecb605 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:42 devstack sudo[106472]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5618e0cc-a969-4f68-ab94-f991c1cfb313 tempest-VolumeDependencyTests-127658737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-141a3fff-e7f9-4be9-85a1-cf9f82481a29" returned: 0 in 0.776s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:42 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-5618e0cc-a969-4f68-ab94-f991c1cfb313 tempest-VolumeDependencyTests-127658737 None] Lock "cinder-quobyte-141a3fff-e7f9-4be9-85a1-cf9f82481a29" released by "_copy_volume_from_snapshot" :: held 10.005s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:53:42 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-5618e0cc-a969-4f68-ab94-f991c1cfb313 tempest-VolumeDependencyTests-127658737 None] Lock "cinder-quobyte-58d1aedc-21cd-4caa-89e8-deafb161b408-141a3fff-e7f9-4be9-85a1-cf9f82481a29" released by "_create_volume_from_snapshot" :: held 10.051s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:53:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5618e0cc-a969-4f68-ab94-f991c1cfb313 tempest-VolumeDependencyTests-127658737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.075s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:53:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-054d4e16-de8e-4a8a-b617-ffd0858385ac tempest-CreateVolumesFromSnapshotTest-303675828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.176s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:53:42 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-054d4e16-de8e-4a8a-b617-ffd0858385ac tempest-CreateVolumesFromSnapshotTest-303675828 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:53:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1453751430',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac7156ee-f183-4cff-9c09-a0bb86fac1f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bdfa284f5f6481594efaef07327b635',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:53:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:53:36Z,use_quota=True,user_id='36176575013d49d9a0b32ee854b6efea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:53:42 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-054d4e16-de8e-4a8a-b617-ffd0858385ac tempest-CreateVolumesFromSnapshotTest-303675828 None] Creating volume ac7156ee-f183-4cff-9c09-a0bb86fac1f7 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:53:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-054d4e16-de8e-4a8a-b617-ffd0858385ac tempest-CreateVolumesFromSnapshotTest-303675828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:53:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-054d4e16-de8e-4a8a-b617-ffd0858385ac tempest-CreateVolumesFromSnapshotTest-303675828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:53:42 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-054d4e16-de8e-4a8a-b617-ffd0858385ac tempest-CreateVolumesFromSnapshotTest-303675828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:53:42 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-054d4e16-de8e-4a8a-b617-ffd0858385ac tempest-CreateVolumesFromSnapshotTest-303675828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:53:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-054d4e16-de8e-4a8a-b617-ffd0858385ac tempest-CreateVolumesFromSnapshotTest-303675828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:53:42 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-054d4e16-de8e-4a8a-b617-ffd0858385ac tempest-CreateVolumesFromSnapshotTest-303675828 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:53:42 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-054d4e16-de8e-4a8a-b617-ffd0858385ac tempest-CreateVolumesFromSnapshotTest-303675828 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:53:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-054d4e16-de8e-4a8a-b617-ffd0858385ac tempest-CreateVolumesFromSnapshotTest-303675828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ac7156ee-f183-4cff-9c09-a0bb86fac1f7 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:42 devstack sudo[106479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ac7156ee-f183-4cff-9c09-a0bb86fac1f7 1073741824
Jul 09 14:53:42 devstack sudo[106479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:43 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5618e0cc-a969-4f68-ab94-f991c1cfb313 tempest-VolumeDependencyTests-127658737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9afc449-67cc-4152-abfc-1606e163f56d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-141a3fff-e7f9-4be9-85a1-cf9f82481a29', 'volume_size': 1, 'snapshot_id': '58d1aedc-21cd-4caa-89e8-deafb161b408'}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:43 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5618e0cc-a969-4f68-ab94-f991c1cfb313 tempest-VolumeDependencyTests-127658737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e1a4da4-8afa-457f-bbf4-1c9ac2a9c825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:43 devstack sudo[106478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ce2327e9-5644-45ef-92b1-f2daebecb605
Jul 09 14:53:43 devstack sudo[106478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:43 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-5618e0cc-a969-4f68-ab94-f991c1cfb313 tempest-VolumeDependencyTests-127658737 None] Volume volume-141a3fff-e7f9-4be9-85a1-cf9f82481a29 (141a3fff-e7f9-4be9-85a1-cf9f82481a29): created successfully
Jul 09 14:53:43 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5618e0cc-a969-4f68-ab94-f991c1cfb313 tempest-VolumeDependencyTests-127658737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e1a4da4-8afa-457f-bbf4-1c9ac2a9c825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:43 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5618e0cc-a969-4f68-ab94-f991c1cfb313 tempest-VolumeDependencyTests-127658737 None] Flow 'volume_create_manager' (2eafdefe-e1a1-4b5e-84ce-25ad6688fcd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:53:43 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-5618e0cc-a969-4f68-ab94-f991c1cfb313 tempest-VolumeDependencyTests-127658737 None] Created volume successfully.
Jul 09 14:53:43 devstack sudo[106475]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7e1b715c-06ed-40e2-ab11-7c284cb0f3a8 tempest-CinderUnicodeTest-607122583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.738s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:43 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-7e1b715c-06ed-40e2-ab11-7c284cb0f3a8 tempest-CinderUnicodeTest-607122583 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:53:43 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-7e1b715c-06ed-40e2-ab11-7c284cb0f3a8 tempest-CinderUnicodeTest-607122583 None] Deleted volume successfully.
Jul 09 14:53:43 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7e1b715c-06ed-40e2-ab11-7c284cb0f3a8 tempest-CinderUnicodeTest-607122583 None] Lock "cinder-e9c9cfb7-0efa-46c7-827e-00985aee96d6-delete_volume" released by "delete_volume" :: held 3.111s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:53:43 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-ae4f5e7d-0d14-4da3-b55a-edf526552ff9 tempest-VolumeDependencyTests-127658737 None] Acquiring lock "cinder-58d1aedc-21cd-4caa-89e8-deafb161b408-delete_snapshot" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:53:43 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-ae4f5e7d-0d14-4da3-b55a-edf526552ff9 tempest-VolumeDependencyTests-127658737 None] Lock "cinder-58d1aedc-21cd-4caa-89e8-deafb161b408-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:53:43 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-ae4f5e7d-0d14-4da3-b55a-edf526552ff9 tempest-VolumeDependencyTests-127658737 None] Acquiring lock "cinder-quobyte-7cda90fb-b664-43b9-b3e1-12fc01b2c2d2" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:53:43 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-ae4f5e7d-0d14-4da3-b55a-edf526552ff9 tempest-VolumeDependencyTests-127658737 None] Lock "cinder-quobyte-7cda90fb-b664-43b9-b3e1-12fc01b2c2d2" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:53:43 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-ae4f5e7d-0d14-4da3-b55a-edf526552ff9 tempest-VolumeDependencyTests-127658737 None] Acquiring lock "cinder-quobyte-58d1aedc-21cd-4caa-89e8-deafb161b408" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:53:43 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-ae4f5e7d-0d14-4da3-b55a-edf526552ff9 tempest-VolumeDependencyTests-127658737 None] Lock "cinder-quobyte-58d1aedc-21cd-4caa-89e8-deafb161b408" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:53:43 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-ae4f5e7d-0d14-4da3-b55a-edf526552ff9 tempest-VolumeDependencyTests-127658737 None] Deleting offline snapshot 58d1aedc-21cd-4caa-89e8-deafb161b408 of volume 7cda90fb-b664-43b9-b3e1-12fc01b2c2d2 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 14:53:43 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-ae4f5e7d-0d14-4da3-b55a-edf526552ff9 tempest-VolumeDependencyTests-127658737 None] snapshot_file for this snap is: volume-7cda90fb-b664-43b9-b3e1-12fc01b2c2d2.58d1aedc-21cd-4caa-89e8-deafb161b408 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 14:53:43 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e624878-5fff-41f3-808a-0552c7d12f43]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:53:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ae4f5e7d-0d14-4da3-b55a-edf526552ff9 tempest-VolumeDependencyTests-127658737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7cda90fb-b664-43b9-b3e1-12fc01b2c2d2.58d1aedc-21cd-4caa-89e8-deafb161b408 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:43 devstack sudo[106483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7cda90fb-b664-43b9-b3e1-12fc01b2c2d2.58d1aedc-21cd-4caa-89e8-deafb161b408
Jul 09 14:53:43 devstack sudo[106483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:43 devstack sudo[106478]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d7670f35-27c3-48fc-99dc-0547ca160c44 tempest-CinderUnicodeTest-607122583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ce2327e9-5644-45ef-92b1-f2daebecb605" returned: 0 in 1.096s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d7670f35-27c3-48fc-99dc-0547ca160c44 tempest-CinderUnicodeTest-607122583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ce2327e9-5644-45ef-92b1-f2daebecb605 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:44 devstack sudo[106493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ce2327e9-5644-45ef-92b1-f2daebecb605
Jul 09 14:53:44 devstack sudo[106493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:44 devstack sudo[106479]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-054d4e16-de8e-4a8a-b617-ffd0858385ac tempest-CreateVolumesFromSnapshotTest-303675828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ac7156ee-f183-4cff-9c09-a0bb86fac1f7 1073741824" returned: 0 in 1.197s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-054d4e16-de8e-4a8a-b617-ffd0858385ac tempest-CreateVolumesFromSnapshotTest-303675828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ac7156ee-f183-4cff-9c09-a0bb86fac1f7 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:44 devstack sudo[106495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ac7156ee-f183-4cff-9c09-a0bb86fac1f7
Jul 09 14:53:44 devstack sudo[106495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:44 devstack sudo[106483]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ae4f5e7d-0d14-4da3-b55a-edf526552ff9 tempest-VolumeDependencyTests-127658737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7cda90fb-b664-43b9-b3e1-12fc01b2c2d2.58d1aedc-21cd-4caa-89e8-deafb161b408" returned: 0 in 1.008s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:44 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-ae4f5e7d-0d14-4da3-b55a-edf526552ff9 tempest-VolumeDependencyTests-127658737 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7cda90fb-b664-43b9-b3e1-12fc01b2c2d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 14:53:44 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[5602fcec-503b-4cb6-b9ec-2a0c4a0e0f7a]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:53:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ae4f5e7d-0d14-4da3-b55a-edf526552ff9 tempest-VolumeDependencyTests-127658737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7cda90fb-b664-43b9-b3e1-12fc01b2c2d2 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:44 devstack sudo[106493]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d7670f35-27c3-48fc-99dc-0547ca160c44 tempest-CinderUnicodeTest-607122583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ce2327e9-5644-45ef-92b1-f2daebecb605" returned: 0 in 0.764s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:44 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d7670f35-27c3-48fc-99dc-0547ca160c44 tempest-CinderUnicodeTest-607122583 None] Lock "cinder-quobyte-ce2327e9-5644-45ef-92b1-f2daebecb605" released by "delete_volume" :: held 1.914s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:53:44 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-d7670f35-27c3-48fc-99dc-0547ca160c44 tempest-CinderUnicodeTest-607122583 None] Created reservations ['8be000a9-9013-4a7c-83b6-4bd8d9d79991', 'f74cf3c0-e72c-4499-8d67-37cb1b3cac0f', 'd7b632c2-e292-4f53-8047-7f189c3b5cc7', '69f575ca-2ab7-472f-af5a-282e737240c6'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:53:44 devstack sudo[106501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7cda90fb-b664-43b9-b3e1-12fc01b2c2d2
Jul 09 14:53:44 devstack sudo[106501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d7670f35-27c3-48fc-99dc-0547ca160c44 tempest-CinderUnicodeTest-607122583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:53:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d7670f35-27c3-48fc-99dc-0547ca160c44 tempest-CinderUnicodeTest-607122583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:53:44 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-d7670f35-27c3-48fc-99dc-0547ca160c44 tempest-CinderUnicodeTest-607122583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:53:44 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-d7670f35-27c3-48fc-99dc-0547ca160c44 tempest-CinderUnicodeTest-607122583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:53:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d7670f35-27c3-48fc-99dc-0547ca160c44 tempest-CinderUnicodeTest-607122583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:53:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d7670f35-27c3-48fc-99dc-0547ca160c44 tempest-CinderUnicodeTest-607122583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:44 devstack sudo[106495]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-054d4e16-de8e-4a8a-b617-ffd0858385ac tempest-CreateVolumesFromSnapshotTest-303675828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ac7156ee-f183-4cff-9c09-a0bb86fac1f7" returned: 0 in 0.770s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:44 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-054d4e16-de8e-4a8a-b617-ffd0858385ac tempest-CreateVolumesFromSnapshotTest-303675828 None] <== create_volume: return (2015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:53:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-054d4e16-de8e-4a8a-b617-ffd0858385ac tempest-CreateVolumesFromSnapshotTest-303675828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.018s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:53:44 devstack sudo[106504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:53:44 devstack sudo[106504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:44 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-054d4e16-de8e-4a8a-b617-ffd0858385ac tempest-CreateVolumesFromSnapshotTest-303675828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f0d5b72-6c65-4bcd-8ce8-fc3631eef572) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac7156ee-f183-4cff-9c09-a0bb86fac1f7', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:44 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-054d4e16-de8e-4a8a-b617-ffd0858385ac tempest-CreateVolumesFromSnapshotTest-303675828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fe4939c-402d-441b-804c-54cb80c3ed78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:45 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-054d4e16-de8e-4a8a-b617-ffd0858385ac tempest-CreateVolumesFromSnapshotTest-303675828 None] Volume volume-ac7156ee-f183-4cff-9c09-a0bb86fac1f7 (ac7156ee-f183-4cff-9c09-a0bb86fac1f7): created successfully
Jul 09 14:53:45 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-054d4e16-de8e-4a8a-b617-ffd0858385ac tempest-CreateVolumesFromSnapshotTest-303675828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fe4939c-402d-441b-804c-54cb80c3ed78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:45 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-054d4e16-de8e-4a8a-b617-ffd0858385ac tempest-CreateVolumesFromSnapshotTest-303675828 None] Flow 'volume_create_manager' (db8b397f-ea65-4250-b2d7-073becbd6b81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:53:45 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-054d4e16-de8e-4a8a-b617-ffd0858385ac tempest-CreateVolumesFromSnapshotTest-303675828 None] Created volume successfully.
Jul 09 14:53:45 devstack sudo[106501]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ae4f5e7d-0d14-4da3-b55a-edf526552ff9 tempest-VolumeDependencyTests-127658737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7cda90fb-b664-43b9-b3e1-12fc01b2c2d2" returned: 0 in 0.971s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ae4f5e7d-0d14-4da3-b55a-edf526552ff9 tempest-VolumeDependencyTests-127658737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7cda90fb-b664-43b9-b3e1-12fc01b2c2d2.58d1aedc-21cd-4caa-89e8-deafb161b408 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:45 devstack sudo[106511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7cda90fb-b664-43b9-b3e1-12fc01b2c2d2.58d1aedc-21cd-4caa-89e8-deafb161b408
Jul 09 14:53:45 devstack sudo[106511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:45 devstack sudo[106504]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d7670f35-27c3-48fc-99dc-0547ca160c44 tempest-CinderUnicodeTest-607122583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.828s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:45 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-d7670f35-27c3-48fc-99dc-0547ca160c44 tempest-CinderUnicodeTest-607122583 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:53:45 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-d7670f35-27c3-48fc-99dc-0547ca160c44 tempest-CinderUnicodeTest-607122583 None] Deleted volume successfully.
Jul 09 14:53:45 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d7670f35-27c3-48fc-99dc-0547ca160c44 tempest-CinderUnicodeTest-607122583 None] Lock "cinder-ce2327e9-5644-45ef-92b1-f2daebecb605-delete_volume" released by "delete_volume" :: held 3.036s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:53:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-28141861-84cf-4ad0-9aba-20fb21fc9ae0 tempest-CreateVolumesFromSnapshotTest-303675828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:53:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-28141861-84cf-4ad0-9aba-20fb21fc9ae0 tempest-CreateVolumesFromSnapshotTest-303675828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:53:45 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-28141861-84cf-4ad0-9aba-20fb21fc9ae0 tempest-CreateVolumesFromSnapshotTest-303675828 None] Creating offline snapshot b830e671-a102-4b4a-bc78-0d890c99499a of volume ac7156ee-f183-4cff-9c09-a0bb86fac1f7 {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 14:53:45 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[feac2b51-25f5-44e6-b465-2af147243d45]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:53:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-28141861-84cf-4ad0-9aba-20fb21fc9ae0 tempest-CreateVolumesFromSnapshotTest-303675828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ac7156ee-f183-4cff-9c09-a0bb86fac1f7 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:46 devstack sudo[106513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ac7156ee-f183-4cff-9c09-a0bb86fac1f7
Jul 09 14:53:46 devstack sudo[106513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:46 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-86cead98-d956-40b1-9d43-83e17440db60 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:53:46 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-86cead98-d956-40b1-9d43-83e17440db60 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Flow 'volume_create_manager' (33a5d8c5-4ade-4d98-a7d0-1d59d8305cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:53:46 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-86cead98-d956-40b1-9d43-83e17440db60 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d1fc310-a271-4b32-a26e-011397b3fc7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:46 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-86cead98-d956-40b1-9d43-83e17440db60 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d1fc310-a271-4b32-a26e-011397b3fc7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:53:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-930784541',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c532d40d-dabb-4ed6-a47c-368185b6317f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ad4a5cc37f94ad5abb2eafd2cd071b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:53:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:53:46Z,use_quota=True,user_id='1d08e24ebf894fd1b7aa2249b1f75848',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:46 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-86cead98-d956-40b1-9d43-83e17440db60 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (216e8737-a635-4374-a0bc-6b089f7d43bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:46 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-86cead98-d956-40b1-9d43-83e17440db60 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (216e8737-a635-4374-a0bc-6b089f7d43bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:46 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-86cead98-d956-40b1-9d43-83e17440db60 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18453f4f-97ab-4e7b-8800-e7b4013d4989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:46 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-86cead98-d956-40b1-9d43-83e17440db60 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18453f4f-97ab-4e7b-8800-e7b4013d4989) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c532d40d-dabb-4ed6-a47c-368185b6317f', 'volume_name': 'volume-c532d40d-dabb-4ed6-a47c-368185b6317f', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:46 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-86cead98-d956-40b1-9d43-83e17440db60 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a9dd4e4-1360-4c40-804a-7fba058f20df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:46 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-86cead98-d956-40b1-9d43-83e17440db60 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a9dd4e4-1360-4c40-804a-7fba058f20df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:46 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-86cead98-d956-40b1-9d43-83e17440db60 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7412818e-145e-4be0-8fdf-a4f05c66e50f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:46 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-86cead98-d956-40b1-9d43-83e17440db60 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Volume c532d40d-dabb-4ed6-a47c-368185b6317f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c532d40d-dabb-4ed6-a47c-368185b6317f', 'volume_size': 1}
Jul 09 14:53:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-86cead98-d956-40b1-9d43-83e17440db60 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:53:46 devstack sudo[106511]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ae4f5e7d-0d14-4da3-b55a-edf526552ff9 tempest-VolumeDependencyTests-127658737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7cda90fb-b664-43b9-b3e1-12fc01b2c2d2.58d1aedc-21cd-4caa-89e8-deafb161b408" returned: 0 in 0.963s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ae4f5e7d-0d14-4da3-b55a-edf526552ff9 tempest-VolumeDependencyTests-127658737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7cda90fb-b664-43b9-b3e1-12fc01b2c2d2.58d1aedc-21cd-4caa-89e8-deafb161b408 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:46 devstack sudo[106519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7cda90fb-b664-43b9-b3e1-12fc01b2c2d2.58d1aedc-21cd-4caa-89e8-deafb161b408
Jul 09 14:53:46 devstack sudo[106519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:46 devstack sudo[106513]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-28141861-84cf-4ad0-9aba-20fb21fc9ae0 tempest-CreateVolumesFromSnapshotTest-303675828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ac7156ee-f183-4cff-9c09-a0bb86fac1f7" returned: 0 in 0.916s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-28141861-84cf-4ad0-9aba-20fb21fc9ae0 tempest-CreateVolumesFromSnapshotTest-303675828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ac7156ee-f183-4cff-9c09-a0bb86fac1f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ac7156ee-f183-4cff-9c09-a0bb86fac1f7.b830e671-a102-4b4a-bc78-0d890c99499a 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:46 devstack sudo[106525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ac7156ee-f183-4cff-9c09-a0bb86fac1f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ac7156ee-f183-4cff-9c09-a0bb86fac1f7.b830e671-a102-4b4a-bc78-0d890c99499a 1G
Jul 09 14:53:46 devstack sudo[106525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:47 devstack sudo[106519]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ae4f5e7d-0d14-4da3-b55a-edf526552ff9 tempest-VolumeDependencyTests-127658737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7cda90fb-b664-43b9-b3e1-12fc01b2c2d2.58d1aedc-21cd-4caa-89e8-deafb161b408" returned: 0 in 0.711s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:47 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-ae4f5e7d-0d14-4da3-b55a-edf526552ff9 tempest-VolumeDependencyTests-127658737 None] Lock "cinder-quobyte-58d1aedc-21cd-4caa-89e8-deafb161b408" released by "_delete_snapshot" :: held 3.796s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:53:47 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-ae4f5e7d-0d14-4da3-b55a-edf526552ff9 tempest-VolumeDependencyTests-127658737 None] Lock "cinder-quobyte-7cda90fb-b664-43b9-b3e1-12fc01b2c2d2" released by "delete_snapshot" :: held 3.834s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:53:47 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-ae4f5e7d-0d14-4da3-b55a-edf526552ff9 tempest-VolumeDependencyTests-127658737 None] Created reservations ['bc7b0035-8899-4807-85e1-9b67defd0ccb', 'c702a71b-93a4-40c0-a0e0-c542f00d7b3b', '61777777-fc8f-40b6-95f7-2f201c0a18f1', '3937d72f-79e5-494a-8abb-3a5176b69672'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:53:47 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-ae4f5e7d-0d14-4da3-b55a-edf526552ff9 tempest-VolumeDependencyTests-127658737 None] Delete snapshot completed successfully.
Jul 09 14:53:47 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-ae4f5e7d-0d14-4da3-b55a-edf526552ff9 tempest-VolumeDependencyTests-127658737 None] Lock "cinder-58d1aedc-21cd-4caa-89e8-deafb161b408-delete_snapshot" released by "delete_snapshot" :: held 4.008s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:53:47 devstack sudo[106525]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-28141861-84cf-4ad0-9aba-20fb21fc9ae0 tempest-CreateVolumesFromSnapshotTest-303675828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ac7156ee-f183-4cff-9c09-a0bb86fac1f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ac7156ee-f183-4cff-9c09-a0bb86fac1f7.b830e671-a102-4b4a-bc78-0d890c99499a 1G" returned: 0 in 0.929s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-28141861-84cf-4ad0-9aba-20fb21fc9ae0 tempest-CreateVolumesFromSnapshotTest-303675828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac7156ee-f183-4cff-9c09-a0bb86fac1f7 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ac7156ee-f183-4cff-9c09-a0bb86fac1f7.b830e671-a102-4b4a-bc78-0d890c99499a {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:47 devstack sudo[106566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac7156ee-f183-4cff-9c09-a0bb86fac1f7 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ac7156ee-f183-4cff-9c09-a0bb86fac1f7.b830e671-a102-4b4a-bc78-0d890c99499a
Jul 09 14:53:47 devstack sudo[106566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:48 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b4fa858e-7b49-41df-9992-f297daa221c0 tempest-VolumeDependencyTests-127658737 None] Acquiring lock "cinder-7cda90fb-b664-43b9-b3e1-12fc01b2c2d2-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:53:48 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b4fa858e-7b49-41df-9992-f297daa221c0 tempest-VolumeDependencyTests-127658737 None] Lock "cinder-7cda90fb-b664-43b9-b3e1-12fc01b2c2d2-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:53:48 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b4fa858e-7b49-41df-9992-f297daa221c0 tempest-VolumeDependencyTests-127658737 None] Acquiring lock "cinder-quobyte-7cda90fb-b664-43b9-b3e1-12fc01b2c2d2" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:53:48 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b4fa858e-7b49-41df-9992-f297daa221c0 tempest-VolumeDependencyTests-127658737 None] Lock "cinder-quobyte-7cda90fb-b664-43b9-b3e1-12fc01b2c2d2" acquired by "delete_volume" :: waited 0.017s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:53:48 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a9649c3-b7f7-4b52-aa15-29fe4497ae71]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:53:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b4fa858e-7b49-41df-9992-f297daa221c0 tempest-VolumeDependencyTests-127658737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7cda90fb-b664-43b9-b3e1-12fc01b2c2d2 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:48 devstack sudo[106570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7cda90fb-b664-43b9-b3e1-12fc01b2c2d2
Jul 09 14:53:48 devstack sudo[106570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:48 devstack sudo[106566]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-28141861-84cf-4ad0-9aba-20fb21fc9ae0 tempest-CreateVolumesFromSnapshotTest-303675828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac7156ee-f183-4cff-9c09-a0bb86fac1f7 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ac7156ee-f183-4cff-9c09-a0bb86fac1f7.b830e671-a102-4b4a-bc78-0d890c99499a" returned: 0 in 0.789s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:48 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-28141861-84cf-4ad0-9aba-20fb21fc9ae0 tempest-CreateVolumesFromSnapshotTest-303675828 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ac7156ee-f183-4cff-9c09-a0bb86fac1f7.b830e671-a102-4b4a-bc78-0d890c99499a is being set with open permissions: ugo+rw
Jul 09 14:53:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-28141861-84cf-4ad0-9aba-20fb21fc9ae0 tempest-CreateVolumesFromSnapshotTest-303675828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ac7156ee-f183-4cff-9c09-a0bb86fac1f7.b830e671-a102-4b4a-bc78-0d890c99499a {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:48 devstack sudo[106575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ac7156ee-f183-4cff-9c09-a0bb86fac1f7.b830e671-a102-4b4a-bc78-0d890c99499a
Jul 09 14:53:48 devstack sudo[106575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:48 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a615717-e116-4966-a980-2c6896851410 tempest-ProjectMemberTests-1092548551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:53:48 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4a615717-e116-4966-a980-2c6896851410 tempest-ProjectMemberTests-1092548551 None] Flow 'volume_create_manager' (a6b3fd9a-3f2b-46d7-8976-0d6ad05cb13d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:53:48 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4a615717-e116-4966-a980-2c6896851410 tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23584934-f74e-4af2-b247-482d6e3e3404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:48 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4a615717-e116-4966-a980-2c6896851410 tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23584934-f74e-4af2-b247-482d6e3e3404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:53:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2014661475',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d876a82-8240-4308-8dc7-24e4ca80208c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53e3a7b509634eeda7e218e1577efd89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:53:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:53:49Z,use_quota=True,user_id='6f31a0c3fe3e49ccabfa9bdf47df92af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:48 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4a615717-e116-4966-a980-2c6896851410 tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (229df516-d389-4bb6-9272-d863da8968b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:48 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4a615717-e116-4966-a980-2c6896851410 tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (229df516-d389-4bb6-9272-d863da8968b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:48 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4a615717-e116-4966-a980-2c6896851410 tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b58b483a-be76-44c0-8a76-e111d0d1fbb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:48 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4a615717-e116-4966-a980-2c6896851410 tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b58b483a-be76-44c0-8a76-e111d0d1fbb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d876a82-8240-4308-8dc7-24e4ca80208c', 'volume_name': 'volume-2d876a82-8240-4308-8dc7-24e4ca80208c', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:48 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4a615717-e116-4966-a980-2c6896851410 tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e724234-7f98-4950-9989-0b81c0fc821a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:48 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4a615717-e116-4966-a980-2c6896851410 tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e724234-7f98-4950-9989-0b81c0fc821a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:48 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4a615717-e116-4966-a980-2c6896851410 tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11a418b9-ec0a-4b91-8d76-90f14f2ba1ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:48 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-4a615717-e116-4966-a980-2c6896851410 tempest-ProjectMemberTests-1092548551 None] Volume 2d876a82-8240-4308-8dc7-24e4ca80208c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d876a82-8240-4308-8dc7-24e4ca80208c', 'volume_size': 1}
Jul 09 14:53:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-4a615717-e116-4966-a980-2c6896851410 tempest-ProjectMemberTests-1092548551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:53:49 devstack sudo[106570]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b4fa858e-7b49-41df-9992-f297daa221c0 tempest-VolumeDependencyTests-127658737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7cda90fb-b664-43b9-b3e1-12fc01b2c2d2" returned: 0 in 0.841s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b4fa858e-7b49-41df-9992-f297daa221c0 tempest-VolumeDependencyTests-127658737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7cda90fb-b664-43b9-b3e1-12fc01b2c2d2 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:49 devstack sudo[106580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7cda90fb-b664-43b9-b3e1-12fc01b2c2d2
Jul 09 14:53:49 devstack sudo[106580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:49 devstack sudo[106575]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-28141861-84cf-4ad0-9aba-20fb21fc9ae0 tempest-CreateVolumesFromSnapshotTest-303675828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ac7156ee-f183-4cff-9c09-a0bb86fac1f7.b830e671-a102-4b4a-bc78-0d890c99499a" returned: 0 in 0.670s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-28141861-84cf-4ad0-9aba-20fb21fc9ae0 tempest-CreateVolumesFromSnapshotTest-303675828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ac7156ee-f183-4cff-9c09-a0bb86fac1f7.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:49 devstack sudo[106583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ac7156ee-f183-4cff-9c09-a0bb86fac1f7.info
Jul 09 14:53:49 devstack sudo[106583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:49 devstack sudo[106580]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b4fa858e-7b49-41df-9992-f297daa221c0 tempest-VolumeDependencyTests-127658737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-7cda90fb-b664-43b9-b3e1-12fc01b2c2d2" returned: 0 in 0.690s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:49 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b4fa858e-7b49-41df-9992-f297daa221c0 tempest-VolumeDependencyTests-127658737 None] Lock "cinder-quobyte-7cda90fb-b664-43b9-b3e1-12fc01b2c2d2" released by "delete_volume" :: held 1.609s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:53:49 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-b4fa858e-7b49-41df-9992-f297daa221c0 tempest-VolumeDependencyTests-127658737 None] Created reservations ['d9f91465-7119-4f51-9f6f-7faf44c042ad', 'bccad4ed-5085-4de8-a38b-fc79caef8055', '2fe47c34-2b12-4d2d-b4dd-4b4f6f689a0f', 'dc2e1cc1-0ea1-40c6-8fb7-e94d8d098dad'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:53:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b4fa858e-7b49-41df-9992-f297daa221c0 tempest-VolumeDependencyTests-127658737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:53:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b4fa858e-7b49-41df-9992-f297daa221c0 tempest-VolumeDependencyTests-127658737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:53:49 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b4fa858e-7b49-41df-9992-f297daa221c0 tempest-VolumeDependencyTests-127658737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:53:49 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b4fa858e-7b49-41df-9992-f297daa221c0 tempest-VolumeDependencyTests-127658737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:53:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b4fa858e-7b49-41df-9992-f297daa221c0 tempest-VolumeDependencyTests-127658737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:53:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b4fa858e-7b49-41df-9992-f297daa221c0 tempest-VolumeDependencyTests-127658737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:49 devstack sudo[106587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:53:49 devstack sudo[106587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:50 devstack sudo[106583]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-28141861-84cf-4ad0-9aba-20fb21fc9ae0 tempest-CreateVolumesFromSnapshotTest-303675828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ac7156ee-f183-4cff-9c09-a0bb86fac1f7.info" returned: 0 in 0.690s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:50 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-28141861-84cf-4ad0-9aba-20fb21fc9ae0 tempest-CreateVolumesFromSnapshotTest-303675828 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ac7156ee-f183-4cff-9c09-a0bb86fac1f7.info is being set with open permissions: ugo+rw
Jul 09 14:53:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-28141861-84cf-4ad0-9aba-20fb21fc9ae0 tempest-CreateVolumesFromSnapshotTest-303675828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ac7156ee-f183-4cff-9c09-a0bb86fac1f7.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:50 devstack sudo[106589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ac7156ee-f183-4cff-9c09-a0bb86fac1f7.info
Jul 09 14:53:50 devstack sudo[106589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:50 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b4136892-333f-40f7-9543-1fc8236556f3 tempest-VolumeDependencyTests-127658737 None] Acquiring lock "cinder-141a3fff-e7f9-4be9-85a1-cf9f82481a29-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:53:50 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b4136892-333f-40f7-9543-1fc8236556f3 tempest-VolumeDependencyTests-127658737 None] Lock "cinder-141a3fff-e7f9-4be9-85a1-cf9f82481a29-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:53:50 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b4136892-333f-40f7-9543-1fc8236556f3 tempest-VolumeDependencyTests-127658737 None] Acquiring lock "cinder-quobyte-141a3fff-e7f9-4be9-85a1-cf9f82481a29" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:53:50 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b4136892-333f-40f7-9543-1fc8236556f3 tempest-VolumeDependencyTests-127658737 None] Lock "cinder-quobyte-141a3fff-e7f9-4be9-85a1-cf9f82481a29" acquired by "delete_volume" :: waited 0.016s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:53:50 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc11525d-d59f-4bbe-b897-1e41d56b8bb1]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:53:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b4136892-333f-40f7-9543-1fc8236556f3 tempest-VolumeDependencyTests-127658737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-141a3fff-e7f9-4be9-85a1-cf9f82481a29 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:50 devstack sudo[106591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-141a3fff-e7f9-4be9-85a1-cf9f82481a29
Jul 09 14:53:50 devstack sudo[106591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:50 devstack sudo[106587]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b4fa858e-7b49-41df-9992-f297daa221c0 tempest-VolumeDependencyTests-127658737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.691s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:50 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-b4fa858e-7b49-41df-9992-f297daa221c0 tempest-VolumeDependencyTests-127658737 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:53:50 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-b4fa858e-7b49-41df-9992-f297daa221c0 tempest-VolumeDependencyTests-127658737 None] Deleted volume successfully.
Jul 09 14:53:50 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b4fa858e-7b49-41df-9992-f297daa221c0 tempest-VolumeDependencyTests-127658737 None] Lock "cinder-7cda90fb-b664-43b9-b3e1-12fc01b2c2d2-delete_volume" released by "delete_volume" :: held 2.547s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:53:50 devstack sudo[106589]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-28141861-84cf-4ad0-9aba-20fb21fc9ae0 tempest-CreateVolumesFromSnapshotTest-303675828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ac7156ee-f183-4cff-9c09-a0bb86fac1f7.info" returned: 0 in 0.723s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-28141861-84cf-4ad0-9aba-20fb21fc9ae0 tempest-CreateVolumesFromSnapshotTest-303675828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.822s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:53:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-86cead98-d956-40b1-9d43-83e17440db60 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.374s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:53:50 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-86cead98-d956-40b1-9d43-83e17440db60 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:53:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-930784541',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c532d40d-dabb-4ed6-a47c-368185b6317f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ad4a5cc37f94ad5abb2eafd2cd071b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:53:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:53:46Z,use_quota=True,user_id='1d08e24ebf894fd1b7aa2249b1f75848',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:53:50 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-86cead98-d956-40b1-9d43-83e17440db60 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Creating volume c532d40d-dabb-4ed6-a47c-368185b6317f {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:53:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-86cead98-d956-40b1-9d43-83e17440db60 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:53:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-86cead98-d956-40b1-9d43-83e17440db60 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:53:50 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-86cead98-d956-40b1-9d43-83e17440db60 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:53:50 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-86cead98-d956-40b1-9d43-83e17440db60 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:53:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-86cead98-d956-40b1-9d43-83e17440db60 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:53:50 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-86cead98-d956-40b1-9d43-83e17440db60 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:53:50 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-86cead98-d956-40b1-9d43-83e17440db60 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:53:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-86cead98-d956-40b1-9d43-83e17440db60 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-c532d40d-dabb-4ed6-a47c-368185b6317f 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:50 devstack sudo[106595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-c532d40d-dabb-4ed6-a47c-368185b6317f 1073741824
Jul 09 14:53:50 devstack sudo[106595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:50 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-28141861-84cf-4ad0-9aba-20fb21fc9ae0 tempest-CreateVolumesFromSnapshotTest-303675828 None] Create snapshot completed successfully
Jul 09 14:53:51 devstack sudo[106591]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b4136892-333f-40f7-9543-1fc8236556f3 tempest-VolumeDependencyTests-127658737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-141a3fff-e7f9-4be9-85a1-cf9f82481a29" returned: 0 in 0.807s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b4136892-333f-40f7-9543-1fc8236556f3 tempest-VolumeDependencyTests-127658737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-141a3fff-e7f9-4be9-85a1-cf9f82481a29 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:51 devstack sudo[106602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-141a3fff-e7f9-4be9-85a1-cf9f82481a29
Jul 09 14:53:51 devstack sudo[106602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:51 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-01eabb6d-0166-4014-9b44-1b71f67fb73c tempest-CreateVolumesFromSnapshotTest-303675828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:53:51 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-01eabb6d-0166-4014-9b44-1b71f67fb73c tempest-CreateVolumesFromSnapshotTest-303675828 None] Flow 'volume_create_manager' (a6dada30-b70a-43f2-9665-60b26fc34515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:53:51 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-01eabb6d-0166-4014-9b44-1b71f67fb73c tempest-CreateVolumesFromSnapshotTest-303675828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e43d418-d33f-4f06-b774-1cda9fa50294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:51 devstack sudo[106595]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-86cead98-d956-40b1-9d43-83e17440db60 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-c532d40d-dabb-4ed6-a47c-368185b6317f 1073741824" returned: 0 in 0.964s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:51 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-01eabb6d-0166-4014-9b44-1b71f67fb73c tempest-CreateVolumesFromSnapshotTest-303675828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e43d418-d33f-4f06-b774-1cda9fa50294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:53:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-286595114',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc6875a7-da44-4794-9a22-f0fec9e0912d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bdfa284f5f6481594efaef07327b635',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:53:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:53:52Z,use_quota=True,user_id='36176575013d49d9a0b32ee854b6efea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:51 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-01eabb6d-0166-4014-9b44-1b71f67fb73c tempest-CreateVolumesFromSnapshotTest-303675828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f12d1764-8d7e-4559-80f1-490d6a842a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:51 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-01eabb6d-0166-4014-9b44-1b71f67fb73c tempest-CreateVolumesFromSnapshotTest-303675828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f12d1764-8d7e-4559-80f1-490d6a842a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:51 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-01eabb6d-0166-4014-9b44-1b71f67fb73c tempest-CreateVolumesFromSnapshotTest-303675828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (787410b6-bd2a-4abe-919a-8e83b2d5a07d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:51 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-01eabb6d-0166-4014-9b44-1b71f67fb73c tempest-CreateVolumesFromSnapshotTest-303675828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (787410b6-bd2a-4abe-919a-8e83b2d5a07d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc6875a7-da44-4794-9a22-f0fec9e0912d', 'volume_name': 'volume-fc6875a7-da44-4794-9a22-f0fec9e0912d', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:51 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-01eabb6d-0166-4014-9b44-1b71f67fb73c tempest-CreateVolumesFromSnapshotTest-303675828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3013e0bb-66b9-4c19-a509-5b0bbc124b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:51 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-01eabb6d-0166-4014-9b44-1b71f67fb73c tempest-CreateVolumesFromSnapshotTest-303675828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3013e0bb-66b9-4c19-a509-5b0bbc124b87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:51 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-01eabb6d-0166-4014-9b44-1b71f67fb73c tempest-CreateVolumesFromSnapshotTest-303675828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64e9312d-532a-49b4-8fd3-a7312a3a2d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:51 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-01eabb6d-0166-4014-9b44-1b71f67fb73c tempest-CreateVolumesFromSnapshotTest-303675828 None] Volume fc6875a7-da44-4794-9a22-f0fec9e0912d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc6875a7-da44-4794-9a22-f0fec9e0912d', 'volume_size': 1}
Jul 09 14:53:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-01eabb6d-0166-4014-9b44-1b71f67fb73c tempest-CreateVolumesFromSnapshotTest-303675828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:53:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-86cead98-d956-40b1-9d43-83e17440db60 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-c532d40d-dabb-4ed6-a47c-368185b6317f {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:51 devstack sudo[106607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-c532d40d-dabb-4ed6-a47c-368185b6317f
Jul 09 14:53:51 devstack sudo[106607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:52 devstack sudo[106602]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b4136892-333f-40f7-9543-1fc8236556f3 tempest-VolumeDependencyTests-127658737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-141a3fff-e7f9-4be9-85a1-cf9f82481a29" returned: 0 in 0.799s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:52 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b4136892-333f-40f7-9543-1fc8236556f3 tempest-VolumeDependencyTests-127658737 None] Lock "cinder-quobyte-141a3fff-e7f9-4be9-85a1-cf9f82481a29" released by "delete_volume" :: held 1.656s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:53:52 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-29e6c2af-7624-4545-9da0-5399824ae4f0 tempest-CreateVolumesFromSnapshotTest-303675828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:53:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-29e6c2af-7624-4545-9da0-5399824ae4f0 tempest-CreateVolumesFromSnapshotTest-303675828 None] Flow 'volume_create_manager' (f7c50571-f842-4302-ba1f-ce23fc91b234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:53:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-29e6c2af-7624-4545-9da0-5399824ae4f0 tempest-CreateVolumesFromSnapshotTest-303675828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a464e642-daaa-4890-a23c-9795d601a89a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-29e6c2af-7624-4545-9da0-5399824ae4f0 tempest-CreateVolumesFromSnapshotTest-303675828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a464e642-daaa-4890-a23c-9795d601a89a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:53:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-829273126',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad99f449-3ec8-4a59-a0cd-01a21f787538,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bdfa284f5f6481594efaef07327b635',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:53:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:53:52Z,use_quota=True,user_id='36176575013d49d9a0b32ee854b6efea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-29e6c2af-7624-4545-9da0-5399824ae4f0 tempest-CreateVolumesFromSnapshotTest-303675828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0173a01d-aceb-4c82-b8d7-922001d50985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-29e6c2af-7624-4545-9da0-5399824ae4f0 tempest-CreateVolumesFromSnapshotTest-303675828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0173a01d-aceb-4c82-b8d7-922001d50985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-29e6c2af-7624-4545-9da0-5399824ae4f0 tempest-CreateVolumesFromSnapshotTest-303675828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ead12bd0-e037-4c1a-a7f6-32002e945563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-29e6c2af-7624-4545-9da0-5399824ae4f0 tempest-CreateVolumesFromSnapshotTest-303675828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ead12bd0-e037-4c1a-a7f6-32002e945563) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad99f449-3ec8-4a59-a0cd-01a21f787538', 'volume_name': 'volume-ad99f449-3ec8-4a59-a0cd-01a21f787538', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-29e6c2af-7624-4545-9da0-5399824ae4f0 tempest-CreateVolumesFromSnapshotTest-303675828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f53c847-76e7-450c-86f7-bb33bfd890fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-29e6c2af-7624-4545-9da0-5399824ae4f0 tempest-CreateVolumesFromSnapshotTest-303675828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f53c847-76e7-450c-86f7-bb33bfd890fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-29e6c2af-7624-4545-9da0-5399824ae4f0 tempest-CreateVolumesFromSnapshotTest-303675828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59baefb4-20ec-4c4d-948e-2321ef0541f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:52 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-29e6c2af-7624-4545-9da0-5399824ae4f0 tempest-CreateVolumesFromSnapshotTest-303675828 None] Volume ad99f449-3ec8-4a59-a0cd-01a21f787538: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad99f449-3ec8-4a59-a0cd-01a21f787538', 'volume_size': 1}
Jul 09 14:53:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-29e6c2af-7624-4545-9da0-5399824ae4f0 tempest-CreateVolumesFromSnapshotTest-303675828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:53:52 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-b4136892-333f-40f7-9543-1fc8236556f3 tempest-VolumeDependencyTests-127658737 None] Created reservations ['637b548b-22cb-4998-81e2-f1b3b05ec508', '01c38d23-c166-4190-9b94-b3daac35d34f', 'efb93635-5b50-4f57-a61e-ade26b0c4bf6', '91aec636-cad3-448e-a36e-6162d459768d'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:53:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b4136892-333f-40f7-9543-1fc8236556f3 tempest-VolumeDependencyTests-127658737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:53:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b4136892-333f-40f7-9543-1fc8236556f3 tempest-VolumeDependencyTests-127658737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:53:52 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b4136892-333f-40f7-9543-1fc8236556f3 tempest-VolumeDependencyTests-127658737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:53:52 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b4136892-333f-40f7-9543-1fc8236556f3 tempest-VolumeDependencyTests-127658737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:53:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b4136892-333f-40f7-9543-1fc8236556f3 tempest-VolumeDependencyTests-127658737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:53:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b4136892-333f-40f7-9543-1fc8236556f3 tempest-VolumeDependencyTests-127658737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:52 devstack sudo[106610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:53:52 devstack sudo[106610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:52 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 14:53:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:53:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:53:52 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:53:52 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:53:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:53:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:52 devstack sudo[106612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:53:52 devstack sudo[106612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:52 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-da7aa60a-b098-4827-bc89-7cdb2691ecd1 tempest-CreateVolumesFromSnapshotTest-303675828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:53:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-da7aa60a-b098-4827-bc89-7cdb2691ecd1 tempest-CreateVolumesFromSnapshotTest-303675828 None] Flow 'volume_create_manager' (5ef3b7ba-40b6-490f-89e7-4804213ecbce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:53:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-da7aa60a-b098-4827-bc89-7cdb2691ecd1 tempest-CreateVolumesFromSnapshotTest-303675828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2be7cf1a-6db7-4602-afa8-289d218c75e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-da7aa60a-b098-4827-bc89-7cdb2691ecd1 tempest-CreateVolumesFromSnapshotTest-303675828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2be7cf1a-6db7-4602-afa8-289d218c75e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:53:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1997510177',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97987746-5eba-4ba3-92be-4765847de99b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bdfa284f5f6481594efaef07327b635',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:53:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:53:52Z,use_quota=True,user_id='36176575013d49d9a0b32ee854b6efea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-da7aa60a-b098-4827-bc89-7cdb2691ecd1 tempest-CreateVolumesFromSnapshotTest-303675828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd51decc-47f5-4d34-87ae-c63b031f3305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-da7aa60a-b098-4827-bc89-7cdb2691ecd1 tempest-CreateVolumesFromSnapshotTest-303675828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd51decc-47f5-4d34-87ae-c63b031f3305) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-da7aa60a-b098-4827-bc89-7cdb2691ecd1 tempest-CreateVolumesFromSnapshotTest-303675828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23f4e9b8-be06-46c9-b395-6a90e81dce27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-da7aa60a-b098-4827-bc89-7cdb2691ecd1 tempest-CreateVolumesFromSnapshotTest-303675828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23f4e9b8-be06-46c9-b395-6a90e81dce27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97987746-5eba-4ba3-92be-4765847de99b', 'volume_name': 'volume-97987746-5eba-4ba3-92be-4765847de99b', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-da7aa60a-b098-4827-bc89-7cdb2691ecd1 tempest-CreateVolumesFromSnapshotTest-303675828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05cb7577-85e2-4e19-8758-bb33b53f4573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-da7aa60a-b098-4827-bc89-7cdb2691ecd1 tempest-CreateVolumesFromSnapshotTest-303675828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05cb7577-85e2-4e19-8758-bb33b53f4573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-da7aa60a-b098-4827-bc89-7cdb2691ecd1 tempest-CreateVolumesFromSnapshotTest-303675828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b0b14ba-e559-49ef-a956-7b6871e0f176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:52 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-da7aa60a-b098-4827-bc89-7cdb2691ecd1 tempest-CreateVolumesFromSnapshotTest-303675828 None] Volume 97987746-5eba-4ba3-92be-4765847de99b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97987746-5eba-4ba3-92be-4765847de99b', 'volume_size': 1}
Jul 09 14:53:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-da7aa60a-b098-4827-bc89-7cdb2691ecd1 tempest-CreateVolumesFromSnapshotTest-303675828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:53:52 devstack sudo[106607]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-86cead98-d956-40b1-9d43-83e17440db60 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-c532d40d-dabb-4ed6-a47c-368185b6317f" returned: 0 in 0.870s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:52 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-86cead98-d956-40b1-9d43-83e17440db60 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] <== create_volume: return (1927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:53:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-86cead98-d956-40b1-9d43-83e17440db60 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.930s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:53:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-4a615717-e116-4966-a980-2c6896851410 tempest-ProjectMemberTests-1092548551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.709s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:53:52 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-4a615717-e116-4966-a980-2c6896851410 tempest-ProjectMemberTests-1092548551 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:53:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2014661475',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d876a82-8240-4308-8dc7-24e4ca80208c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53e3a7b509634eeda7e218e1577efd89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:53:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:53:49Z,use_quota=True,user_id='6f31a0c3fe3e49ccabfa9bdf47df92af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:53:52 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-4a615717-e116-4966-a980-2c6896851410 tempest-ProjectMemberTests-1092548551 None] Creating volume 2d876a82-8240-4308-8dc7-24e4ca80208c {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:53:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-4a615717-e116-4966-a980-2c6896851410 tempest-ProjectMemberTests-1092548551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:53:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-4a615717-e116-4966-a980-2c6896851410 tempest-ProjectMemberTests-1092548551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:53:52 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-4a615717-e116-4966-a980-2c6896851410 tempest-ProjectMemberTests-1092548551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:53:52 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-4a615717-e116-4966-a980-2c6896851410 tempest-ProjectMemberTests-1092548551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:53:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-4a615717-e116-4966-a980-2c6896851410 tempest-ProjectMemberTests-1092548551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:53:52 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-4a615717-e116-4966-a980-2c6896851410 tempest-ProjectMemberTests-1092548551 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:53:52 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-4a615717-e116-4966-a980-2c6896851410 tempest-ProjectMemberTests-1092548551 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:53:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4a615717-e116-4966-a980-2c6896851410 tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d876a82-8240-4308-8dc7-24e4ca80208c 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:52 devstack sudo[106615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d876a82-8240-4308-8dc7-24e4ca80208c 1073741824
Jul 09 14:53:52 devstack sudo[106615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-86cead98-d956-40b1-9d43-83e17440db60 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7412818e-145e-4be0-8fdf-a4f05c66e50f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c532d40d-dabb-4ed6-a47c-368185b6317f', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-86cead98-d956-40b1-9d43-83e17440db60 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25fd96e0-e62f-45a3-a259-4bd7928615bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:52 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-86cead98-d956-40b1-9d43-83e17440db60 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Volume volume-c532d40d-dabb-4ed6-a47c-368185b6317f (c532d40d-dabb-4ed6-a47c-368185b6317f): created successfully
Jul 09 14:53:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-86cead98-d956-40b1-9d43-83e17440db60 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25fd96e0-e62f-45a3-a259-4bd7928615bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-86cead98-d956-40b1-9d43-83e17440db60 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Flow 'volume_create_manager' (33a5d8c5-4ade-4d98-a7d0-1d59d8305cfa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:53:52 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-86cead98-d956-40b1-9d43-83e17440db60 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Created volume successfully.
Jul 09 14:53:53 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e805967-4edf-4467-9531-b14940590ee6 tempest-CreateVolumesFromSnapshotTest-303675828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:53:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0e805967-4edf-4467-9531-b14940590ee6 tempest-CreateVolumesFromSnapshotTest-303675828 None] Flow 'volume_create_manager' (a39aeac4-a612-4bf3-aec7-1a175dc92df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:53:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0e805967-4edf-4467-9531-b14940590ee6 tempest-CreateVolumesFromSnapshotTest-303675828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fac1f707-d124-44fa-aae7-39032670bfca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0e805967-4edf-4467-9531-b14940590ee6 tempest-CreateVolumesFromSnapshotTest-303675828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fac1f707-d124-44fa-aae7-39032670bfca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:53:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1623187749',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1586047b-5cf7-469c-a65c-a5996921dc42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bdfa284f5f6481594efaef07327b635',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:53:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:53:53Z,use_quota=True,user_id='36176575013d49d9a0b32ee854b6efea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0e805967-4edf-4467-9531-b14940590ee6 tempest-CreateVolumesFromSnapshotTest-303675828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35012e27-7dc1-45fc-b737-99a3c560fae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0e805967-4edf-4467-9531-b14940590ee6 tempest-CreateVolumesFromSnapshotTest-303675828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35012e27-7dc1-45fc-b737-99a3c560fae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0e805967-4edf-4467-9531-b14940590ee6 tempest-CreateVolumesFromSnapshotTest-303675828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad69d2f6-6e84-4de3-8b6a-ac5b608a9de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0e805967-4edf-4467-9531-b14940590ee6 tempest-CreateVolumesFromSnapshotTest-303675828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad69d2f6-6e84-4de3-8b6a-ac5b608a9de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1586047b-5cf7-469c-a65c-a5996921dc42', 'volume_name': 'volume-1586047b-5cf7-469c-a65c-a5996921dc42', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0e805967-4edf-4467-9531-b14940590ee6 tempest-CreateVolumesFromSnapshotTest-303675828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9e522bc-4e43-4a1a-894a-2cdf0fda0e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0e805967-4edf-4467-9531-b14940590ee6 tempest-CreateVolumesFromSnapshotTest-303675828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9e522bc-4e43-4a1a-894a-2cdf0fda0e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0e805967-4edf-4467-9531-b14940590ee6 tempest-CreateVolumesFromSnapshotTest-303675828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67787b26-2588-4a7a-a6ba-c1bd205a0d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:53 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-0e805967-4edf-4467-9531-b14940590ee6 tempest-CreateVolumesFromSnapshotTest-303675828 None] Volume 1586047b-5cf7-469c-a65c-a5996921dc42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1586047b-5cf7-469c-a65c-a5996921dc42', 'volume_size': 1}
Jul 09 14:53:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0e805967-4edf-4467-9531-b14940590ee6 tempest-CreateVolumesFromSnapshotTest-303675828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:53:53 devstack sudo[106610]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b4136892-333f-40f7-9543-1fc8236556f3 tempest-VolumeDependencyTests-127658737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 1.157s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:53 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-b4136892-333f-40f7-9543-1fc8236556f3 tempest-VolumeDependencyTests-127658737 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:53:53 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-b4136892-333f-40f7-9543-1fc8236556f3 tempest-VolumeDependencyTests-127658737 None] Deleted volume successfully.
Jul 09 14:53:53 devstack sudo[106612]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:53 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b4136892-333f-40f7-9543-1fc8236556f3 tempest-VolumeDependencyTests-127658737 None] Lock "cinder-141a3fff-e7f9-4be9-85a1-cf9f82481a29-delete_volume" released by "delete_volume" :: held 3.172s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:53:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 1.082s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:53 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:53:53 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Running periodic task VolumeManager._thread_info {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 14:53:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] thread count: 28 {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 09 14:53:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] thread info: [<_MainThread(MainThread, started 125388812103808)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125388713797504)>, <Thread(Thread-3 (stat_writer), started daemon 125388699995392)>, <Thread(Rabbit-heartbeat, started daemon 125388700522560)>, <Thread(Thread-5 (_runner), started daemon 125388698545216)>, <Thread(Thread-7 (_runner), started daemon 125388698611264)>, <Thread(fd_logger, started daemon 125388703020672)>, <Thread(privsep_reader, started daemon 125388696441088)>, <Thread(tpool_thread_0, started daemon 125388687943360)>, <Thread(tpool_thread_1, started daemon 125388679550656)>, <Thread(tpool_thread_2, started daemon 125388671141568)>, <Thread(tpool_thread_3, started daemon 125388662732480)>, <Thread(tpool_thread_4, started daemon 125388654323392)>, <Thread(tpool_thread_5, started daemon 125388645914304)>, <Thread(tpool_thread_6, started daemon 125388637505216)>, <Thread(tpool_thread_7, started daemon 125388629096128)>, <Thread(tpool_thread_8, started daemon 125388620687040)>, <Thread(tpool_thread_9, started daemon 125388612277952)>, <Thread(tpool_thread_10, started daemon 125388603868864)>, <Thread(tpool_thread_11, started daemon 125388595459776)>, <Thread(tpool_thread_12, started daemon 125388587050688)>, <Thread(tpool_thread_13, started daemon 125388578641600)>, <Thread(tpool_thread_14, started daemon 125388570232512)>, <Thread(tpool_thread_15, started daemon 125388561823424)>, <Thread(tpool_thread_16, started daemon 125388553414336)>, <Thread(tpool_thread_17, started daemon 125388545005248)>, <Thread(tpool_thread_18, started daemon 125388536596160)>, <Thread(tpool_thread_19, started daemon 125388528187072)>] {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 09 14:53:53 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ba715bd-1d54-4d5b-ba18-92ab198d1627 tempest-CreateVolumesFromSnapshotTest-303675828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:53:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9ba715bd-1d54-4d5b-ba18-92ab198d1627 tempest-CreateVolumesFromSnapshotTest-303675828 None] Flow 'volume_create_manager' (c6e9e7a0-71f9-46a8-9d14-951f4d92ed22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:53:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9ba715bd-1d54-4d5b-ba18-92ab198d1627 tempest-CreateVolumesFromSnapshotTest-303675828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d3cad4e-0b4a-4a87-8941-44d82840f5c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9ba715bd-1d54-4d5b-ba18-92ab198d1627 tempest-CreateVolumesFromSnapshotTest-303675828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d3cad4e-0b4a-4a87-8941-44d82840f5c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:53:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-148141273',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77c619ff-2c0d-4e50-9e76-17b8c4f320f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bdfa284f5f6481594efaef07327b635',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:53:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:53:54Z,use_quota=True,user_id='36176575013d49d9a0b32ee854b6efea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9ba715bd-1d54-4d5b-ba18-92ab198d1627 tempest-CreateVolumesFromSnapshotTest-303675828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b3a7f54-ee58-461c-8907-c8e81d522415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9ba715bd-1d54-4d5b-ba18-92ab198d1627 tempest-CreateVolumesFromSnapshotTest-303675828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b3a7f54-ee58-461c-8907-c8e81d522415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9ba715bd-1d54-4d5b-ba18-92ab198d1627 tempest-CreateVolumesFromSnapshotTest-303675828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cee2044e-4dbe-48d2-81de-4a21c0c5d3e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9ba715bd-1d54-4d5b-ba18-92ab198d1627 tempest-CreateVolumesFromSnapshotTest-303675828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cee2044e-4dbe-48d2-81de-4a21c0c5d3e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77c619ff-2c0d-4e50-9e76-17b8c4f320f7', 'volume_name': 'volume-77c619ff-2c0d-4e50-9e76-17b8c4f320f7', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9ba715bd-1d54-4d5b-ba18-92ab198d1627 tempest-CreateVolumesFromSnapshotTest-303675828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fee66752-a91a-414d-a366-668ae904d9c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9ba715bd-1d54-4d5b-ba18-92ab198d1627 tempest-CreateVolumesFromSnapshotTest-303675828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fee66752-a91a-414d-a366-668ae904d9c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9ba715bd-1d54-4d5b-ba18-92ab198d1627 tempest-CreateVolumesFromSnapshotTest-303675828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3fb971d-dc46-4cb8-9325-dc360f25ab3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:53 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-9ba715bd-1d54-4d5b-ba18-92ab198d1627 tempest-CreateVolumesFromSnapshotTest-303675828 None] Volume 77c619ff-2c0d-4e50-9e76-17b8c4f320f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77c619ff-2c0d-4e50-9e76-17b8c4f320f7', 'volume_size': 1}
Jul 09 14:53:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9ba715bd-1d54-4d5b-ba18-92ab198d1627 tempest-CreateVolumesFromSnapshotTest-303675828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:53:54 devstack sudo[106615]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4a615717-e116-4966-a980-2c6896851410 tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d876a82-8240-4308-8dc7-24e4ca80208c 1073741824" returned: 0 in 1.468s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4a615717-e116-4966-a980-2c6896851410 tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d876a82-8240-4308-8dc7-24e4ca80208c {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:54 devstack sudo[106623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d876a82-8240-4308-8dc7-24e4ca80208c
Jul 09 14:53:54 devstack sudo[106623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:54 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-83b47563-a4b5-4f99-b1a2-17c23cf6795a tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:53:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-83b47563-a4b5-4f99-b1a2-17c23cf6795a tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Flow 'volume_create_manager' (6a93f4f3-5d43-4f8d-ad17-5c8c2f5a6d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:53:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-83b47563-a4b5-4f99-b1a2-17c23cf6795a tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef45d12a-04bb-45f3-9ef6-900e299af57f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-83b47563-a4b5-4f99-b1a2-17c23cf6795a tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef45d12a-04bb-45f3-9ef6-900e299af57f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:53:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-111397788',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd335abf-2533-46b8-bae0-d13f2958194b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ad4a5cc37f94ad5abb2eafd2cd071b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:53:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:53:54Z,use_quota=True,user_id='1d08e24ebf894fd1b7aa2249b1f75848',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-83b47563-a4b5-4f99-b1a2-17c23cf6795a tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d495f70c-a18c-4335-965c-51fbd50905ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-83b47563-a4b5-4f99-b1a2-17c23cf6795a tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d495f70c-a18c-4335-965c-51fbd50905ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-83b47563-a4b5-4f99-b1a2-17c23cf6795a tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcda343b-4e1e-4bb1-a81d-40a7e4174532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-83b47563-a4b5-4f99-b1a2-17c23cf6795a tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcda343b-4e1e-4bb1-a81d-40a7e4174532) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd335abf-2533-46b8-bae0-d13f2958194b', 'volume_name': 'volume-bd335abf-2533-46b8-bae0-d13f2958194b', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-83b47563-a4b5-4f99-b1a2-17c23cf6795a tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01297899-3f99-4ac4-9ed7-d6d74a20f9cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-83b47563-a4b5-4f99-b1a2-17c23cf6795a tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01297899-3f99-4ac4-9ed7-d6d74a20f9cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-83b47563-a4b5-4f99-b1a2-17c23cf6795a tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40ef7eb6-1311-4eda-9129-2c8a8c17269f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:54 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-83b47563-a4b5-4f99-b1a2-17c23cf6795a tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Volume bd335abf-2533-46b8-bae0-d13f2958194b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd335abf-2533-46b8-bae0-d13f2958194b', 'volume_size': 1}
Jul 09 14:53:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-83b47563-a4b5-4f99-b1a2-17c23cf6795a tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:53:54 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a18b156-6454-417e-a437-4ac963369767 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:53:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6a18b156-6454-417e-a437-4ac963369767 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Flow 'volume_create_manager' (9469dc05-026e-458e-83d7-77ebac8ab0e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:53:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6a18b156-6454-417e-a437-4ac963369767 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a0dbd78-c796-40a9-acb6-395782e82aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6a18b156-6454-417e-a437-4ac963369767 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a0dbd78-c796-40a9-acb6-395782e82aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:53:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-298937859',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0090248a-074d-4949-b9ab-21c802096ad3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ad4a5cc37f94ad5abb2eafd2cd071b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:53:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:53:55Z,use_quota=True,user_id='1d08e24ebf894fd1b7aa2249b1f75848',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6a18b156-6454-417e-a437-4ac963369767 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e89790e3-03af-4be3-bda9-229e0d19911c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6a18b156-6454-417e-a437-4ac963369767 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e89790e3-03af-4be3-bda9-229e0d19911c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6a18b156-6454-417e-a437-4ac963369767 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddd6ee09-01b3-4f54-855d-a9dd0cec70e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6a18b156-6454-417e-a437-4ac963369767 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddd6ee09-01b3-4f54-855d-a9dd0cec70e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0090248a-074d-4949-b9ab-21c802096ad3', 'volume_name': 'volume-0090248a-074d-4949-b9ab-21c802096ad3', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6a18b156-6454-417e-a437-4ac963369767 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c846391d-e06f-431c-b930-892d9d86671d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6a18b156-6454-417e-a437-4ac963369767 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c846391d-e06f-431c-b930-892d9d86671d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6a18b156-6454-417e-a437-4ac963369767 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d79eac2-0961-45f3-b633-68378f8c60ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:54 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-6a18b156-6454-417e-a437-4ac963369767 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Volume 0090248a-074d-4949-b9ab-21c802096ad3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0090248a-074d-4949-b9ab-21c802096ad3', 'volume_size': 1}
Jul 09 14:53:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6a18b156-6454-417e-a437-4ac963369767 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:53:55 devstack sudo[106623]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4a615717-e116-4966-a980-2c6896851410 tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d876a82-8240-4308-8dc7-24e4ca80208c" returned: 0 in 0.938s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:55 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-4a615717-e116-4966-a980-2c6896851410 tempest-ProjectMemberTests-1092548551 None] <== create_volume: return (2458ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:53:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-4a615717-e116-4966-a980-2c6896851410 tempest-ProjectMemberTests-1092548551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.463s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:53:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-01eabb6d-0166-4014-9b44-1b71f67fb73c tempest-CreateVolumesFromSnapshotTest-303675828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.369s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:53:55 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-01eabb6d-0166-4014-9b44-1b71f67fb73c tempest-CreateVolumesFromSnapshotTest-303675828 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:53:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-286595114',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc6875a7-da44-4794-9a22-f0fec9e0912d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bdfa284f5f6481594efaef07327b635',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:53:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:53:52Z,use_quota=True,user_id='36176575013d49d9a0b32ee854b6efea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:53:55 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-01eabb6d-0166-4014-9b44-1b71f67fb73c tempest-CreateVolumesFromSnapshotTest-303675828 None] Creating volume fc6875a7-da44-4794-9a22-f0fec9e0912d {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:53:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-01eabb6d-0166-4014-9b44-1b71f67fb73c tempest-CreateVolumesFromSnapshotTest-303675828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:53:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-01eabb6d-0166-4014-9b44-1b71f67fb73c tempest-CreateVolumesFromSnapshotTest-303675828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:53:55 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-01eabb6d-0166-4014-9b44-1b71f67fb73c tempest-CreateVolumesFromSnapshotTest-303675828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:53:55 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-01eabb6d-0166-4014-9b44-1b71f67fb73c tempest-CreateVolumesFromSnapshotTest-303675828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:53:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-01eabb6d-0166-4014-9b44-1b71f67fb73c tempest-CreateVolumesFromSnapshotTest-303675828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:53:55 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-01eabb6d-0166-4014-9b44-1b71f67fb73c tempest-CreateVolumesFromSnapshotTest-303675828 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:53:55 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-01eabb6d-0166-4014-9b44-1b71f67fb73c tempest-CreateVolumesFromSnapshotTest-303675828 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:53:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-01eabb6d-0166-4014-9b44-1b71f67fb73c tempest-CreateVolumesFromSnapshotTest-303675828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-fc6875a7-da44-4794-9a22-f0fec9e0912d 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:55 devstack sudo[106626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-fc6875a7-da44-4794-9a22-f0fec9e0912d 1073741824
Jul 09 14:53:55 devstack sudo[106626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:55 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4a615717-e116-4966-a980-2c6896851410 tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11a418b9-ec0a-4b91-8d76-90f14f2ba1ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d876a82-8240-4308-8dc7-24e4ca80208c', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:55 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4a615717-e116-4966-a980-2c6896851410 tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea221e69-816f-4681-94f4-a3501f834e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:55 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-4a615717-e116-4966-a980-2c6896851410 tempest-ProjectMemberTests-1092548551 None] Volume volume-2d876a82-8240-4308-8dc7-24e4ca80208c (2d876a82-8240-4308-8dc7-24e4ca80208c): created successfully
Jul 09 14:53:55 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4a615717-e116-4966-a980-2c6896851410 tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea221e69-816f-4681-94f4-a3501f834e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:55 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4a615717-e116-4966-a980-2c6896851410 tempest-ProjectMemberTests-1092548551 None] Flow 'volume_create_manager' (a6b3fd9a-3f2b-46d7-8976-0d6ad05cb13d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:53:55 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-67d5c6f0-c89f-4ca2-b923-261f4b20e21b tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:53:55 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-67d5c6f0-c89f-4ca2-b923-261f4b20e21b tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Flow 'volume_create_manager' (d4fa7e0b-f19b-4c5a-aa98-14a37b6e2c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:53:55 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-67d5c6f0-c89f-4ca2-b923-261f4b20e21b tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7f954fd-94d1-4c22-931a-8f8014ba18e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:55 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-4a615717-e116-4966-a980-2c6896851410 tempest-ProjectMemberTests-1092548551 None] Created volume successfully.
Jul 09 14:53:55 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-67d5c6f0-c89f-4ca2-b923-261f4b20e21b tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7f954fd-94d1-4c22-931a-8f8014ba18e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:53:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1891206851',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1265927-f2dd-4a37-8fec-0fe09a7c20e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ad4a5cc37f94ad5abb2eafd2cd071b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:53:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:53:55Z,use_quota=True,user_id='1d08e24ebf894fd1b7aa2249b1f75848',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:55 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-67d5c6f0-c89f-4ca2-b923-261f4b20e21b tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fb3f18f-973d-40df-b3b8-f53c5994d5ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:55 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-67d5c6f0-c89f-4ca2-b923-261f4b20e21b tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fb3f18f-973d-40df-b3b8-f53c5994d5ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:55 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-67d5c6f0-c89f-4ca2-b923-261f4b20e21b tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccac9128-4bfe-44b9-a05f-0de9c2e298e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:55 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-67d5c6f0-c89f-4ca2-b923-261f4b20e21b tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccac9128-4bfe-44b9-a05f-0de9c2e298e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1265927-f2dd-4a37-8fec-0fe09a7c20e5', 'volume_name': 'volume-a1265927-f2dd-4a37-8fec-0fe09a7c20e5', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:55 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-67d5c6f0-c89f-4ca2-b923-261f4b20e21b tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89cc3f6b-0e7e-42fd-80e6-7479c3e50a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:55 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-67d5c6f0-c89f-4ca2-b923-261f4b20e21b tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89cc3f6b-0e7e-42fd-80e6-7479c3e50a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:55 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-67d5c6f0-c89f-4ca2-b923-261f4b20e21b tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf28f37d-96df-4435-a744-d5135e3f184b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:55 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-67d5c6f0-c89f-4ca2-b923-261f4b20e21b tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Volume a1265927-f2dd-4a37-8fec-0fe09a7c20e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1265927-f2dd-4a37-8fec-0fe09a7c20e5', 'volume_size': 1}
Jul 09 14:53:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-67d5c6f0-c89f-4ca2-b923-261f4b20e21b tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:53:55 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-860db717-fa7f-409d-9b24-1507940e4ed5 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:53:55 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-860db717-fa7f-409d-9b24-1507940e4ed5 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Flow 'volume_create_manager' (b8758ba7-d8ab-46d6-ab0d-edee324baa9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:53:55 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-860db717-fa7f-409d-9b24-1507940e4ed5 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43b8a41a-4cb4-40d9-b973-42f2e29a306e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:55 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-860db717-fa7f-409d-9b24-1507940e4ed5 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43b8a41a-4cb4-40d9-b973-42f2e29a306e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:53:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2011315890',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e7a8300-56d9-4788-9691-19760e852760,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ad4a5cc37f94ad5abb2eafd2cd071b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:53:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:53:56Z,use_quota=True,user_id='1d08e24ebf894fd1b7aa2249b1f75848',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:55 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-860db717-fa7f-409d-9b24-1507940e4ed5 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51be4708-fbbb-4815-b9f4-9b7504c96696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:55 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-860db717-fa7f-409d-9b24-1507940e4ed5 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51be4708-fbbb-4815-b9f4-9b7504c96696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:55 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-860db717-fa7f-409d-9b24-1507940e4ed5 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b12c7d3d-be84-493e-b327-518aa71c50cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:55 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-860db717-fa7f-409d-9b24-1507940e4ed5 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b12c7d3d-be84-493e-b327-518aa71c50cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e7a8300-56d9-4788-9691-19760e852760', 'volume_name': 'volume-2e7a8300-56d9-4788-9691-19760e852760', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:55 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-860db717-fa7f-409d-9b24-1507940e4ed5 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6505501-b07c-4bfa-987a-dbf8bed4c865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:55 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-860db717-fa7f-409d-9b24-1507940e4ed5 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6505501-b07c-4bfa-987a-dbf8bed4c865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:55 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-860db717-fa7f-409d-9b24-1507940e4ed5 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd30d072-ecce-42a5-a7f0-8a7fdc2e3b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:55 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-860db717-fa7f-409d-9b24-1507940e4ed5 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Volume 2e7a8300-56d9-4788-9691-19760e852760: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e7a8300-56d9-4788-9691-19760e852760', 'volume_size': 1}
Jul 09 14:53:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-860db717-fa7f-409d-9b24-1507940e4ed5 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:53:56 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c04e6f9-286e-4cab-bbf9-c3d4ed8760a0 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:53:56 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8c04e6f9-286e-4cab-bbf9-c3d4ed8760a0 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Flow 'volume_create_manager' (dd6e6192-dbb1-4134-8927-6717c026bd73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:53:56 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8c04e6f9-286e-4cab-bbf9-c3d4ed8760a0 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69f564ea-93d0-4694-988f-7837d7257cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:56 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8c04e6f9-286e-4cab-bbf9-c3d4ed8760a0 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69f564ea-93d0-4694-988f-7837d7257cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:53:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-741544362',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd4696fe-a748-4550-b4ff-03a2297413f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ad4a5cc37f94ad5abb2eafd2cd071b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:53:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:53:56Z,use_quota=True,user_id='1d08e24ebf894fd1b7aa2249b1f75848',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:56 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8c04e6f9-286e-4cab-bbf9-c3d4ed8760a0 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (154cd183-0359-433a-9def-0eb21fdf6b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:56 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8c04e6f9-286e-4cab-bbf9-c3d4ed8760a0 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (154cd183-0359-433a-9def-0eb21fdf6b13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:56 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8c04e6f9-286e-4cab-bbf9-c3d4ed8760a0 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48750b05-cc15-402c-8574-d5994a6bceb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:56 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8c04e6f9-286e-4cab-bbf9-c3d4ed8760a0 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48750b05-cc15-402c-8574-d5994a6bceb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd4696fe-a748-4550-b4ff-03a2297413f6', 'volume_name': 'volume-dd4696fe-a748-4550-b4ff-03a2297413f6', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:56 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8c04e6f9-286e-4cab-bbf9-c3d4ed8760a0 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef42e6cb-68aa-459f-b57e-cc296f05d58a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:56 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8c04e6f9-286e-4cab-bbf9-c3d4ed8760a0 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef42e6cb-68aa-459f-b57e-cc296f05d58a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:56 devstack sudo[106626]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:56 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8c04e6f9-286e-4cab-bbf9-c3d4ed8760a0 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddce0378-1ee0-4f2b-bb53-a978c263dfbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:56 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-8c04e6f9-286e-4cab-bbf9-c3d4ed8760a0 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Volume dd4696fe-a748-4550-b4ff-03a2297413f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd4696fe-a748-4550-b4ff-03a2297413f6', 'volume_size': 1}
Jul 09 14:53:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8c04e6f9-286e-4cab-bbf9-c3d4ed8760a0 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:53:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-01eabb6d-0166-4014-9b44-1b71f67fb73c tempest-CreateVolumesFromSnapshotTest-303675828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-fc6875a7-da44-4794-9a22-f0fec9e0912d 1073741824" returned: 0 in 1.004s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-01eabb6d-0166-4014-9b44-1b71f67fb73c tempest-CreateVolumesFromSnapshotTest-303675828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-fc6875a7-da44-4794-9a22-f0fec9e0912d {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:56 devstack sudo[106632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-fc6875a7-da44-4794-9a22-f0fec9e0912d
Jul 09 14:53:56 devstack sudo[106632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-10cdd3ec-d12e-42d3-a717-0fd3240e7bf2 tempest-ProjectMemberTests-1092548551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:53:56 devstack sudo[106632]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-01eabb6d-0166-4014-9b44-1b71f67fb73c tempest-CreateVolumesFromSnapshotTest-303675828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-fc6875a7-da44-4794-9a22-f0fec9e0912d" returned: 0 in 0.724s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:56 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-01eabb6d-0166-4014-9b44-1b71f67fb73c tempest-CreateVolumesFromSnapshotTest-303675828 None] <== create_volume: return (1778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:53:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-01eabb6d-0166-4014-9b44-1b71f67fb73c tempest-CreateVolumesFromSnapshotTest-303675828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.781s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:53:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-29e6c2af-7624-4545-9da0-5399824ae4f0 tempest-CreateVolumesFromSnapshotTest-303675828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.769s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:53:56 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-29e6c2af-7624-4545-9da0-5399824ae4f0 tempest-CreateVolumesFromSnapshotTest-303675828 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:53:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-829273126',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad99f449-3ec8-4a59-a0cd-01a21f787538,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bdfa284f5f6481594efaef07327b635',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:53:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:53:52Z,use_quota=True,user_id='36176575013d49d9a0b32ee854b6efea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:53:56 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-29e6c2af-7624-4545-9da0-5399824ae4f0 tempest-CreateVolumesFromSnapshotTest-303675828 None] Creating volume ad99f449-3ec8-4a59-a0cd-01a21f787538 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:53:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-29e6c2af-7624-4545-9da0-5399824ae4f0 tempest-CreateVolumesFromSnapshotTest-303675828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:53:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-29e6c2af-7624-4545-9da0-5399824ae4f0 tempest-CreateVolumesFromSnapshotTest-303675828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:53:56 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-29e6c2af-7624-4545-9da0-5399824ae4f0 tempest-CreateVolumesFromSnapshotTest-303675828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:53:56 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-29e6c2af-7624-4545-9da0-5399824ae4f0 tempest-CreateVolumesFromSnapshotTest-303675828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:53:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-29e6c2af-7624-4545-9da0-5399824ae4f0 tempest-CreateVolumesFromSnapshotTest-303675828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:53:56 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-29e6c2af-7624-4545-9da0-5399824ae4f0 tempest-CreateVolumesFromSnapshotTest-303675828 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:53:56 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-29e6c2af-7624-4545-9da0-5399824ae4f0 tempest-CreateVolumesFromSnapshotTest-303675828 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:53:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-29e6c2af-7624-4545-9da0-5399824ae4f0 tempest-CreateVolumesFromSnapshotTest-303675828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ad99f449-3ec8-4a59-a0cd-01a21f787538 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:56 devstack sudo[106641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ad99f449-3ec8-4a59-a0cd-01a21f787538 1073741824
Jul 09 14:53:56 devstack sudo[106641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:56 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-01eabb6d-0166-4014-9b44-1b71f67fb73c tempest-CreateVolumesFromSnapshotTest-303675828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64e9312d-532a-49b4-8fd3-a7312a3a2d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc6875a7-da44-4794-9a22-f0fec9e0912d', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:56 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-01eabb6d-0166-4014-9b44-1b71f67fb73c tempest-CreateVolumesFromSnapshotTest-303675828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cc2ca35-21ad-46ab-b3fe-38f7ff4a87bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:57 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-01eabb6d-0166-4014-9b44-1b71f67fb73c tempest-CreateVolumesFromSnapshotTest-303675828 None] Volume volume-fc6875a7-da44-4794-9a22-f0fec9e0912d (fc6875a7-da44-4794-9a22-f0fec9e0912d): created successfully
Jul 09 14:53:57 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-01eabb6d-0166-4014-9b44-1b71f67fb73c tempest-CreateVolumesFromSnapshotTest-303675828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cc2ca35-21ad-46ab-b3fe-38f7ff4a87bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:57 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-01eabb6d-0166-4014-9b44-1b71f67fb73c tempest-CreateVolumesFromSnapshotTest-303675828 None] Flow 'volume_create_manager' (a6dada30-b70a-43f2-9665-60b26fc34515) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:53:57 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-01eabb6d-0166-4014-9b44-1b71f67fb73c tempest-CreateVolumesFromSnapshotTest-303675828 None] Created volume successfully.
Jul 09 14:53:57 devstack sudo[106641]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-29e6c2af-7624-4545-9da0-5399824ae4f0 tempest-CreateVolumesFromSnapshotTest-303675828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ad99f449-3ec8-4a59-a0cd-01a21f787538 1073741824" returned: 0 in 0.899s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-29e6c2af-7624-4545-9da0-5399824ae4f0 tempest-CreateVolumesFromSnapshotTest-303675828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ad99f449-3ec8-4a59-a0cd-01a21f787538 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:57 devstack sudo[106646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ad99f449-3ec8-4a59-a0cd-01a21f787538
Jul 09 14:53:57 devstack sudo[106646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:58 devstack sudo[106646]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-29e6c2af-7624-4545-9da0-5399824ae4f0 tempest-CreateVolumesFromSnapshotTest-303675828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ad99f449-3ec8-4a59-a0cd-01a21f787538" returned: 0 in 0.683s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:58 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-29e6c2af-7624-4545-9da0-5399824ae4f0 tempest-CreateVolumesFromSnapshotTest-303675828 None] <== create_volume: return (1626ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:53:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-29e6c2af-7624-4545-9da0-5399824ae4f0 tempest-CreateVolumesFromSnapshotTest-303675828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.628s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:53:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-da7aa60a-b098-4827-bc89-7cdb2691ecd1 tempest-CreateVolumesFromSnapshotTest-303675828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.954s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:53:58 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-da7aa60a-b098-4827-bc89-7cdb2691ecd1 tempest-CreateVolumesFromSnapshotTest-303675828 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:53:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1997510177',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97987746-5eba-4ba3-92be-4765847de99b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bdfa284f5f6481594efaef07327b635',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:53:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:53:52Z,use_quota=True,user_id='36176575013d49d9a0b32ee854b6efea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:53:58 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-da7aa60a-b098-4827-bc89-7cdb2691ecd1 tempest-CreateVolumesFromSnapshotTest-303675828 None] Creating volume 97987746-5eba-4ba3-92be-4765847de99b {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:53:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-da7aa60a-b098-4827-bc89-7cdb2691ecd1 tempest-CreateVolumesFromSnapshotTest-303675828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:53:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-da7aa60a-b098-4827-bc89-7cdb2691ecd1 tempest-CreateVolumesFromSnapshotTest-303675828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:53:58 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-da7aa60a-b098-4827-bc89-7cdb2691ecd1 tempest-CreateVolumesFromSnapshotTest-303675828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:53:58 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-da7aa60a-b098-4827-bc89-7cdb2691ecd1 tempest-CreateVolumesFromSnapshotTest-303675828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:53:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-da7aa60a-b098-4827-bc89-7cdb2691ecd1 tempest-CreateVolumesFromSnapshotTest-303675828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:53:58 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-da7aa60a-b098-4827-bc89-7cdb2691ecd1 tempest-CreateVolumesFromSnapshotTest-303675828 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:53:58 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-da7aa60a-b098-4827-bc89-7cdb2691ecd1 tempest-CreateVolumesFromSnapshotTest-303675828 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:53:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-da7aa60a-b098-4827-bc89-7cdb2691ecd1 tempest-CreateVolumesFromSnapshotTest-303675828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-97987746-5eba-4ba3-92be-4765847de99b 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:58 devstack sudo[106649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-97987746-5eba-4ba3-92be-4765847de99b 1073741824
Jul 09 14:53:58 devstack sudo[106649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:58 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-29e6c2af-7624-4545-9da0-5399824ae4f0 tempest-CreateVolumesFromSnapshotTest-303675828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59baefb4-20ec-4c4d-948e-2321ef0541f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad99f449-3ec8-4a59-a0cd-01a21f787538', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:58 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-29e6c2af-7624-4545-9da0-5399824ae4f0 tempest-CreateVolumesFromSnapshotTest-303675828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a3b27d0-ef82-4511-b47d-fe7c79002600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:58 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-29e6c2af-7624-4545-9da0-5399824ae4f0 tempest-CreateVolumesFromSnapshotTest-303675828 None] Volume volume-ad99f449-3ec8-4a59-a0cd-01a21f787538 (ad99f449-3ec8-4a59-a0cd-01a21f787538): created successfully
Jul 09 14:53:58 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-29e6c2af-7624-4545-9da0-5399824ae4f0 tempest-CreateVolumesFromSnapshotTest-303675828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a3b27d0-ef82-4511-b47d-fe7c79002600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:58 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-29e6c2af-7624-4545-9da0-5399824ae4f0 tempest-CreateVolumesFromSnapshotTest-303675828 None] Flow 'volume_create_manager' (f7c50571-f842-4302-ba1f-ce23fc91b234) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:53:58 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-29e6c2af-7624-4545-9da0-5399824ae4f0 tempest-CreateVolumesFromSnapshotTest-303675828 None] Created volume successfully.
Jul 09 14:53:59 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc2ee122-783f-424e-a9e0-bc81749caf9e tempest-VolumeImageDependencyTests-998889795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:53:59 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dc2ee122-783f-424e-a9e0-bc81749caf9e tempest-VolumeImageDependencyTests-998889795 None] Flow 'volume_create_manager' (d4e6c305-abab-4f04-bed1-dcae16877d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:53:59 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dc2ee122-783f-424e-a9e0-bc81749caf9e tempest-VolumeImageDependencyTests-998889795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ee3dcd3-01b0-4bd0-8e39-b78bf9437f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:59 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dc2ee122-783f-424e-a9e0-bc81749caf9e tempest-VolumeImageDependencyTests-998889795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ee3dcd3-01b0-4bd0-8e39-b78bf9437f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:53:59Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4046df0-23c7-44d1-aee7-a698730418b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5149d350a9114eee81ed61c00dd1eaa1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:53:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:53:59Z,use_quota=True,user_id='236312aead074bfcb0e0059a361f10b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:59 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dc2ee122-783f-424e-a9e0-bc81749caf9e tempest-VolumeImageDependencyTests-998889795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (307808c8-b323-4a5f-85cb-9c1183eb8109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:59 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dc2ee122-783f-424e-a9e0-bc81749caf9e tempest-VolumeImageDependencyTests-998889795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (307808c8-b323-4a5f-85cb-9c1183eb8109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:59 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dc2ee122-783f-424e-a9e0-bc81749caf9e tempest-VolumeImageDependencyTests-998889795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (040934e1-773a-4bcd-a11e-ffcdba58d84e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:59 devstack cinder-volume[87230]: DEBUG cinder.image.glance [None req-dc2ee122-783f-424e-a9e0-bc81749caf9e tempest-VolumeImageDependencyTests-998889795 None] Creating Keystone auth plugin from conf {{(pid=87230) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 09 14:53:59 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dc2ee122-783f-424e-a9e0-bc81749caf9e tempest-VolumeImageDependencyTests-998889795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (040934e1-773a-4bcd-a11e-ffcdba58d84e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e4046df0-23c7-44d1-aee7-a698730418b4', 'volume_name': 'volume-e4046df0-23c7-44d1-aee7-a698730418b4', 'volume_size': 1, 'image_id': '34eacf28-ca79-4be6-b4e2-9f7512ed6e6e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/34eacf28-ca79-4be6-b4e2-9f7512ed6e6e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'bc25a56de2393a7e3765d3a6f2b61b05', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5149d350a9114eee81ed61c00dd1eaa1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '89a62bcc84effd8f119f6b2a6bf668adbb3930dcbcdc18c7b09f7e36934b71390f049a5caf719e640e4acdbf868efa9da58cbdb0ea7fb930653416dfe5d435cd', 'id': '34eacf28-ca79-4be6-b4e2-9f7512ed6e6e', 'created_at': datetime.datetime(2026, 7, 9, 12, 53, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 12, 53, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/34eacf28-ca79-4be6-b4e2-9f7512ed6e6e/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x720a4a1cb950>}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:59 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dc2ee122-783f-424e-a9e0-bc81749caf9e tempest-VolumeImageDependencyTests-998889795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0d8b368-d1e3-43dc-bb17-f3157dba6ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:59 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dc2ee122-783f-424e-a9e0-bc81749caf9e tempest-VolumeImageDependencyTests-998889795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0d8b368-d1e3-43dc-bb17-f3157dba6ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:53:59 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dc2ee122-783f-424e-a9e0-bc81749caf9e tempest-VolumeImageDependencyTests-998889795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9e63348-d68c-4d7d-891d-211a44045f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:53:59 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-dc2ee122-783f-424e-a9e0-bc81749caf9e tempest-VolumeImageDependencyTests-998889795 None] Volume e4046df0-23c7-44d1-aee7-a698730418b4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e4046df0-23c7-44d1-aee7-a698730418b4', 'volume_size': 1, 'image_id': '34eacf28-ca79-4be6-b4e2-9f7512ed6e6e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/34eacf28-ca79-4be6-b4e2-9f7512ed6e6e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'bc25a56de2393a7e3765d3a6f2b61b05', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5149d350a9114eee81ed61c00dd1eaa1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '89a62bcc84effd8f119f6b2a6bf668adbb3930dcbcdc18c7b09f7e36934b71390f049a5caf719e640e4acdbf868efa9da58cbdb0ea7fb930653416dfe5d435cd', 'id': '34eacf28-ca79-4be6-b4e2-9f7512ed6e6e', 'created_at': datetime.datetime(2026, 7, 9, 12, 53, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 12, 53, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/34eacf28-ca79-4be6-b4e2-9f7512ed6e6e/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x720a4a1cb950>}
Jul 09 14:53:59 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc2ee122-783f-424e-a9e0-bc81749caf9e tempest-VolumeImageDependencyTests-998889795 None] Trying to clone e4046df0-23c7-44d1-aee7-a698730418b4 from image 34eacf28-ca79-4be6-b4e2-9f7512ed6e6e at location (None, [{'url': 'file:///opt/stack/data/glance/images/34eacf28-ca79-4be6-b4e2-9f7512ed6e6e', 'metadata': {}}]). {{(pid=87230) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 09 14:53:59 devstack sudo[106649]: pam_unix(sudo:session): session closed for user root
Jul 09 14:53:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-da7aa60a-b098-4827-bc89-7cdb2691ecd1 tempest-CreateVolumesFromSnapshotTest-303675828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-97987746-5eba-4ba3-92be-4765847de99b 1073741824" returned: 0 in 0.850s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:53:59 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-dc2ee122-783f-424e-a9e0-bc81749caf9e tempest-VolumeImageDependencyTests-998889795 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_34eacf28-ca79-4be6-b4e2-9f7512ed6e6e_d0_yz69vdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87230) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 09 14:53:59 devstack cinder-volume[87230]: INFO cinder.image.image_utils [None req-dc2ee122-783f-424e-a9e0-bc81749caf9e tempest-VolumeImageDependencyTests-998889795 None] Image download 0.00 MB at 0.00 MB/s
Jul 09 14:53:59 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:UPDATE=146,cinder:SELECT=128,cinder:DELETE=17,cinder:INSERT=40 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 14:53:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-da7aa60a-b098-4827-bc89-7cdb2691ecd1 tempest-CreateVolumesFromSnapshotTest-303675828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-97987746-5eba-4ba3-92be-4765847de99b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:59 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ee7dc3-5c55-49ec-9575-17a0a6b88911]: (4, 'raw') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:53:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dc2ee122-783f-424e-a9e0-bc81749caf9e tempest-VolumeImageDependencyTests-998889795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_34eacf28-ca79-4be6-b4e2-9f7512ed6e6e_d0_yz69vdevstack@QuobyteHD {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:53:59 devstack sudo[106655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-97987746-5eba-4ba3-92be-4765847de99b
Jul 09 14:53:59 devstack sudo[106655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:53:59 devstack sudo[106656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_34eacf28-ca79-4be6-b4e2-9f7512ed6e6e_d0_yz69vdevstack@QuobyteHD
Jul 09 14:53:59 devstack sudo[106656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:00 devstack sudo[106655]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-da7aa60a-b098-4827-bc89-7cdb2691ecd1 tempest-CreateVolumesFromSnapshotTest-303675828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-97987746-5eba-4ba3-92be-4765847de99b" returned: 0 in 0.668s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:00 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-da7aa60a-b098-4827-bc89-7cdb2691ecd1 tempest-CreateVolumesFromSnapshotTest-303675828 None] <== create_volume: return (1577ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:54:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-da7aa60a-b098-4827-bc89-7cdb2691ecd1 tempest-CreateVolumesFromSnapshotTest-303675828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.580s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:54:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0e805967-4edf-4467-9531-b14940590ee6 tempest-CreateVolumesFromSnapshotTest-303675828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.981s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:54:00 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-0e805967-4edf-4467-9531-b14940590ee6 tempest-CreateVolumesFromSnapshotTest-303675828 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:53:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1623187749',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1586047b-5cf7-469c-a65c-a5996921dc42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bdfa284f5f6481594efaef07327b635',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:53:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:53:53Z,use_quota=True,user_id='36176575013d49d9a0b32ee854b6efea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:54:00 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-0e805967-4edf-4467-9531-b14940590ee6 tempest-CreateVolumesFromSnapshotTest-303675828 None] Creating volume 1586047b-5cf7-469c-a65c-a5996921dc42 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:54:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0e805967-4edf-4467-9531-b14940590ee6 tempest-CreateVolumesFromSnapshotTest-303675828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:54:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0e805967-4edf-4467-9531-b14940590ee6 tempest-CreateVolumesFromSnapshotTest-303675828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:54:00 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-0e805967-4edf-4467-9531-b14940590ee6 tempest-CreateVolumesFromSnapshotTest-303675828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:54:00 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-0e805967-4edf-4467-9531-b14940590ee6 tempest-CreateVolumesFromSnapshotTest-303675828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:54:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0e805967-4edf-4467-9531-b14940590ee6 tempest-CreateVolumesFromSnapshotTest-303675828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:54:00 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-0e805967-4edf-4467-9531-b14940590ee6 tempest-CreateVolumesFromSnapshotTest-303675828 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:54:00 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-0e805967-4edf-4467-9531-b14940590ee6 tempest-CreateVolumesFromSnapshotTest-303675828 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:54:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0e805967-4edf-4467-9531-b14940590ee6 tempest-CreateVolumesFromSnapshotTest-303675828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1586047b-5cf7-469c-a65c-a5996921dc42 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:00 devstack sudo[106662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1586047b-5cf7-469c-a65c-a5996921dc42 1073741824
Jul 09 14:54:00 devstack sudo[106662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:00 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-da7aa60a-b098-4827-bc89-7cdb2691ecd1 tempest-CreateVolumesFromSnapshotTest-303675828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b0b14ba-e559-49ef-a956-7b6871e0f176) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97987746-5eba-4ba3-92be-4765847de99b', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:54:00 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-da7aa60a-b098-4827-bc89-7cdb2691ecd1 tempest-CreateVolumesFromSnapshotTest-303675828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c7fbbf7-91fe-492e-a212-94f820484ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:54:00 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-da7aa60a-b098-4827-bc89-7cdb2691ecd1 tempest-CreateVolumesFromSnapshotTest-303675828 None] Volume volume-97987746-5eba-4ba3-92be-4765847de99b (97987746-5eba-4ba3-92be-4765847de99b): created successfully
Jul 09 14:54:00 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-da7aa60a-b098-4827-bc89-7cdb2691ecd1 tempest-CreateVolumesFromSnapshotTest-303675828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c7fbbf7-91fe-492e-a212-94f820484ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:54:00 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-da7aa60a-b098-4827-bc89-7cdb2691ecd1 tempest-CreateVolumesFromSnapshotTest-303675828 None] Flow 'volume_create_manager' (5ef3b7ba-40b6-490f-89e7-4804213ecbce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:54:00 devstack sudo[106656]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dc2ee122-783f-424e-a9e0-bc81749caf9e tempest-VolumeImageDependencyTests-998889795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_34eacf28-ca79-4be6-b4e2-9f7512ed6e6e_d0_yz69vdevstack@QuobyteHD" returned: 0 in 0.764s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dc2ee122-783f-424e-a9e0-bc81749caf9e tempest-VolumeImageDependencyTests-998889795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_34eacf28-ca79-4be6-b4e2-9f7512ed6e6e_d0_yz69vdevstack@QuobyteHD {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:00 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-da7aa60a-b098-4827-bc89-7cdb2691ecd1 tempest-CreateVolumesFromSnapshotTest-303675828 None] Created volume successfully.
Jul 09 14:54:00 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=110,cinder:UPDATE=149,cinder:INSERT=36,cinder:DELETE=12 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 14:54:00 devstack sudo[106664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_34eacf28-ca79-4be6-b4e2-9f7512ed6e6e_d0_yz69vdevstack@QuobyteHD
Jul 09 14:54:00 devstack sudo[106664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:00 devstack sudo[106662]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0e805967-4edf-4467-9531-b14940590ee6 tempest-CreateVolumesFromSnapshotTest-303675828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1586047b-5cf7-469c-a65c-a5996921dc42 1073741824" returned: 0 in 0.811s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0e805967-4edf-4467-9531-b14940590ee6 tempest-CreateVolumesFromSnapshotTest-303675828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1586047b-5cf7-469c-a65c-a5996921dc42 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:01 devstack sudo[106664]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dc2ee122-783f-424e-a9e0-bc81749caf9e tempest-VolumeImageDependencyTests-998889795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_34eacf28-ca79-4be6-b4e2-9f7512ed6e6e_d0_yz69vdevstack@QuobyteHD" returned: 1 in 0.781s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dc2ee122-783f-424e-a9e0-bc81749caf9e tempest-VolumeImageDependencyTests-998889795 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_34eacf28-ca79-4be6-b4e2-9f7512ed6e6e_d0_yz69vdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 09 14:54:01 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-dc2ee122-783f-424e-a9e0-bc81749caf9e tempest-VolumeImageDependencyTests-998889795 None] Temporary image 34eacf28-ca79-4be6-b4e2-9f7512ed6e6e is fetched for user 236312aead074bfcb0e0059a361f10b2. {{(pid=87230) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 09 14:54:01 devstack sudo[106673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1586047b-5cf7-469c-a65c-a5996921dc42
Jul 09 14:54:01 devstack sudo[106673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:01 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[b97f1700-4913-418a-a24c-6312f867c2e1]: (4, 'raw') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:54:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dc2ee122-783f-424e-a9e0-bc81749caf9e tempest-VolumeImageDependencyTests-998889795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_34eacf28-ca79-4be6-b4e2-9f7512ed6e6e_d0_yz69vdevstack@QuobyteHD {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:01 devstack sudo[106675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_34eacf28-ca79-4be6-b4e2-9f7512ed6e6e_d0_yz69vdevstack@QuobyteHD
Jul 09 14:54:01 devstack sudo[106675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:01 devstack sudo[106673]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0e805967-4edf-4467-9531-b14940590ee6 tempest-CreateVolumesFromSnapshotTest-303675828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1586047b-5cf7-469c-a65c-a5996921dc42" returned: 0 in 0.665s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:01 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-0e805967-4edf-4467-9531-b14940590ee6 tempest-CreateVolumesFromSnapshotTest-303675828 None] <== create_volume: return (1529ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:54:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0e805967-4edf-4467-9531-b14940590ee6 tempest-CreateVolumesFromSnapshotTest-303675828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.533s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:54:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9ba715bd-1d54-4d5b-ba18-92ab198d1627 tempest-CreateVolumesFromSnapshotTest-303675828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.993s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:54:01 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9ba715bd-1d54-4d5b-ba18-92ab198d1627 tempest-CreateVolumesFromSnapshotTest-303675828 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:53:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-148141273',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77c619ff-2c0d-4e50-9e76-17b8c4f320f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bdfa284f5f6481594efaef07327b635',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:53:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:53:54Z,use_quota=True,user_id='36176575013d49d9a0b32ee854b6efea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:54:01 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-9ba715bd-1d54-4d5b-ba18-92ab198d1627 tempest-CreateVolumesFromSnapshotTest-303675828 None] Creating volume 77c619ff-2c0d-4e50-9e76-17b8c4f320f7 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:54:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9ba715bd-1d54-4d5b-ba18-92ab198d1627 tempest-CreateVolumesFromSnapshotTest-303675828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:54:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9ba715bd-1d54-4d5b-ba18-92ab198d1627 tempest-CreateVolumesFromSnapshotTest-303675828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:54:01 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9ba715bd-1d54-4d5b-ba18-92ab198d1627 tempest-CreateVolumesFromSnapshotTest-303675828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:54:01 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9ba715bd-1d54-4d5b-ba18-92ab198d1627 tempest-CreateVolumesFromSnapshotTest-303675828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:54:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9ba715bd-1d54-4d5b-ba18-92ab198d1627 tempest-CreateVolumesFromSnapshotTest-303675828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:54:01 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9ba715bd-1d54-4d5b-ba18-92ab198d1627 tempest-CreateVolumesFromSnapshotTest-303675828 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:54:01 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-9ba715bd-1d54-4d5b-ba18-92ab198d1627 tempest-CreateVolumesFromSnapshotTest-303675828 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:54:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9ba715bd-1d54-4d5b-ba18-92ab198d1627 tempest-CreateVolumesFromSnapshotTest-303675828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-77c619ff-2c0d-4e50-9e76-17b8c4f320f7 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:01 devstack sudo[106678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-77c619ff-2c0d-4e50-9e76-17b8c4f320f7 1073741824
Jul 09 14:54:01 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0e805967-4edf-4467-9531-b14940590ee6 tempest-CreateVolumesFromSnapshotTest-303675828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67787b26-2588-4a7a-a6ba-c1bd205a0d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1586047b-5cf7-469c-a65c-a5996921dc42', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:54:01 devstack sudo[106678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:01 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0e805967-4edf-4467-9531-b14940590ee6 tempest-CreateVolumesFromSnapshotTest-303675828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49ae4c3a-0e29-4eeb-a030-5d0e50c35a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:54:01 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-0e805967-4edf-4467-9531-b14940590ee6 tempest-CreateVolumesFromSnapshotTest-303675828 None] Volume volume-1586047b-5cf7-469c-a65c-a5996921dc42 (1586047b-5cf7-469c-a65c-a5996921dc42): created successfully
Jul 09 14:54:01 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0e805967-4edf-4467-9531-b14940590ee6 tempest-CreateVolumesFromSnapshotTest-303675828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49ae4c3a-0e29-4eeb-a030-5d0e50c35a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:54:01 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0e805967-4edf-4467-9531-b14940590ee6 tempest-CreateVolumesFromSnapshotTest-303675828 None] Flow 'volume_create_manager' (a39aeac4-a612-4bf3-aec7-1a175dc92df3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:54:01 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-0e805967-4edf-4467-9531-b14940590ee6 tempest-CreateVolumesFromSnapshotTest-303675828 None] Created volume successfully.
Jul 09 14:54:01 devstack sudo[106675]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dc2ee122-783f-424e-a9e0-bc81749caf9e tempest-VolumeImageDependencyTests-998889795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_34eacf28-ca79-4be6-b4e2-9f7512ed6e6e_d0_yz69vdevstack@QuobyteHD" returned: 0 in 0.768s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dc2ee122-783f-424e-a9e0-bc81749caf9e tempest-VolumeImageDependencyTests-998889795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_34eacf28-ca79-4be6-b4e2-9f7512ed6e6e_d0_yz69vdevstack@QuobyteHD {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:02 devstack sudo[106682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_34eacf28-ca79-4be6-b4e2-9f7512ed6e6e_d0_yz69vdevstack@QuobyteHD
Jul 09 14:54:02 devstack sudo[106682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:02 devstack sudo[106678]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9ba715bd-1d54-4d5b-ba18-92ab198d1627 tempest-CreateVolumesFromSnapshotTest-303675828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-77c619ff-2c0d-4e50-9e76-17b8c4f320f7 1073741824" returned: 0 in 0.881s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9ba715bd-1d54-4d5b-ba18-92ab198d1627 tempest-CreateVolumesFromSnapshotTest-303675828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-77c619ff-2c0d-4e50-9e76-17b8c4f320f7 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:02 devstack sudo[106690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-77c619ff-2c0d-4e50-9e76-17b8c4f320f7
Jul 09 14:54:02 devstack sudo[106690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:02 devstack sudo[106682]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dc2ee122-783f-424e-a9e0-bc81749caf9e tempest-VolumeImageDependencyTests-998889795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_34eacf28-ca79-4be6-b4e2-9f7512ed6e6e_d0_yz69vdevstack@QuobyteHD" returned: 1 in 0.807s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dc2ee122-783f-424e-a9e0-bc81749caf9e tempest-VolumeImageDependencyTests-998889795 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_34eacf28-ca79-4be6-b4e2-9f7512ed6e6e_d0_yz69vdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 09 14:54:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-dc2ee122-783f-424e-a9e0-bc81749caf9e tempest-VolumeImageDependencyTests-998889795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:54:03 devstack sudo[106690]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9ba715bd-1d54-4d5b-ba18-92ab198d1627 tempest-CreateVolumesFromSnapshotTest-303675828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-77c619ff-2c0d-4e50-9e76-17b8c4f320f7" returned: 0 in 0.647s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:03 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9ba715bd-1d54-4d5b-ba18-92ab198d1627 tempest-CreateVolumesFromSnapshotTest-303675828 None] <== create_volume: return (1576ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:54:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9ba715bd-1d54-4d5b-ba18-92ab198d1627 tempest-CreateVolumesFromSnapshotTest-303675828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.579s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:54:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-83b47563-a4b5-4f99-b1a2-17c23cf6795a tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.867s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:54:03 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-83b47563-a4b5-4f99-b1a2-17c23cf6795a tempest-CreateVolumesFromSourceVolumeTest-198004667 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:53:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-111397788',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd335abf-2533-46b8-bae0-d13f2958194b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ad4a5cc37f94ad5abb2eafd2cd071b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:53:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:53:54Z,use_quota=True,user_id='1d08e24ebf894fd1b7aa2249b1f75848',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:54:03 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-83b47563-a4b5-4f99-b1a2-17c23cf6795a tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Creating volume bd335abf-2533-46b8-bae0-d13f2958194b {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:54:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-83b47563-a4b5-4f99-b1a2-17c23cf6795a tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:54:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-83b47563-a4b5-4f99-b1a2-17c23cf6795a tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:54:03 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-83b47563-a4b5-4f99-b1a2-17c23cf6795a tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:54:03 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-83b47563-a4b5-4f99-b1a2-17c23cf6795a tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:54:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-83b47563-a4b5-4f99-b1a2-17c23cf6795a tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:54:03 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-83b47563-a4b5-4f99-b1a2-17c23cf6795a tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:54:03 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-83b47563-a4b5-4f99-b1a2-17c23cf6795a tempest-CreateVolumesFromSourceVolumeTest-198004667 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:54:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-83b47563-a4b5-4f99-b1a2-17c23cf6795a tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bd335abf-2533-46b8-bae0-d13f2958194b 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9ba715bd-1d54-4d5b-ba18-92ab198d1627 tempest-CreateVolumesFromSnapshotTest-303675828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3fb971d-dc46-4cb8-9325-dc360f25ab3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77c619ff-2c0d-4e50-9e76-17b8c4f320f7', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:54:03 devstack sudo[106693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bd335abf-2533-46b8-bae0-d13f2958194b 1073741824
Jul 09 14:54:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9ba715bd-1d54-4d5b-ba18-92ab198d1627 tempest-CreateVolumesFromSnapshotTest-303675828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67fd2c30-6a14-48c9-8876-5036ed4280b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:54:03 devstack sudo[106693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:03 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-9ba715bd-1d54-4d5b-ba18-92ab198d1627 tempest-CreateVolumesFromSnapshotTest-303675828 None] Volume volume-77c619ff-2c0d-4e50-9e76-17b8c4f320f7 (77c619ff-2c0d-4e50-9e76-17b8c4f320f7): created successfully
Jul 09 14:54:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9ba715bd-1d54-4d5b-ba18-92ab198d1627 tempest-CreateVolumesFromSnapshotTest-303675828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67fd2c30-6a14-48c9-8876-5036ed4280b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:54:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9ba715bd-1d54-4d5b-ba18-92ab198d1627 tempest-CreateVolumesFromSnapshotTest-303675828 None] Flow 'volume_create_manager' (c6e9e7a0-71f9-46a8-9d14-951f4d92ed22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:54:03 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-9ba715bd-1d54-4d5b-ba18-92ab198d1627 tempest-CreateVolumesFromSnapshotTest-303675828 None] Created volume successfully.
Jul 09 14:54:03 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3364255c-0bc6-4660-9a9e-bcb4e5ff70e4 tempest-CreateVolumesFromSnapshotTest-303675828 None] Acquiring lock "cinder-77c619ff-2c0d-4e50-9e76-17b8c4f320f7-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:54:03 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3364255c-0bc6-4660-9a9e-bcb4e5ff70e4 tempest-CreateVolumesFromSnapshotTest-303675828 None] Lock "cinder-77c619ff-2c0d-4e50-9e76-17b8c4f320f7-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:54:03 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3364255c-0bc6-4660-9a9e-bcb4e5ff70e4 tempest-CreateVolumesFromSnapshotTest-303675828 None] Acquiring lock "cinder-quobyte-77c619ff-2c0d-4e50-9e76-17b8c4f320f7" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:54:03 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3364255c-0bc6-4660-9a9e-bcb4e5ff70e4 tempest-CreateVolumesFromSnapshotTest-303675828 None] Lock "cinder-quobyte-77c619ff-2c0d-4e50-9e76-17b8c4f320f7" acquired by "delete_volume" :: waited 0.019s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:54:03 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[31d434e0-781a-4861-880d-c6cff542e15c]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:54:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3364255c-0bc6-4660-9a9e-bcb4e5ff70e4 tempest-CreateVolumesFromSnapshotTest-303675828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-77c619ff-2c0d-4e50-9e76-17b8c4f320f7 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:03 devstack sudo[106695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-77c619ff-2c0d-4e50-9e76-17b8c4f320f7
Jul 09 14:54:03 devstack sudo[106695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:04 devstack sudo[106693]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-83b47563-a4b5-4f99-b1a2-17c23cf6795a tempest-CreateVolumesFromSourceVolumeTest-198004667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bd335abf-2533-46b8-bae0-d13f2958194b 1073741824" returned: 0 in 0.861s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-83b47563-a4b5-4f99-b1a2-17c23cf6795a tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bd335abf-2533-46b8-bae0-d13f2958194b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:04 devstack sudo[106700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bd335abf-2533-46b8-bae0-d13f2958194b
Jul 09 14:54:04 devstack sudo[106700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:04 devstack sudo[106695]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3364255c-0bc6-4660-9a9e-bcb4e5ff70e4 tempest-CreateVolumesFromSnapshotTest-303675828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-77c619ff-2c0d-4e50-9e76-17b8c4f320f7" returned: 0 in 0.770s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3364255c-0bc6-4660-9a9e-bcb4e5ff70e4 tempest-CreateVolumesFromSnapshotTest-303675828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-77c619ff-2c0d-4e50-9e76-17b8c4f320f7 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:04 devstack sudo[106705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-77c619ff-2c0d-4e50-9e76-17b8c4f320f7
Jul 09 14:54:04 devstack sudo[106705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:04 devstack sudo[106700]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-83b47563-a4b5-4f99-b1a2-17c23cf6795a tempest-CreateVolumesFromSourceVolumeTest-198004667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bd335abf-2533-46b8-bae0-d13f2958194b" returned: 0 in 0.696s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:04 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-83b47563-a4b5-4f99-b1a2-17c23cf6795a tempest-CreateVolumesFromSourceVolumeTest-198004667 None] <== create_volume: return (1601ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:54:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-83b47563-a4b5-4f99-b1a2-17c23cf6795a tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.604s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:54:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6a18b156-6454-417e-a437-4ac963369767 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.017s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:54:04 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-6a18b156-6454-417e-a437-4ac963369767 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:53:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-298937859',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0090248a-074d-4949-b9ab-21c802096ad3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ad4a5cc37f94ad5abb2eafd2cd071b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:53:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:53:55Z,use_quota=True,user_id='1d08e24ebf894fd1b7aa2249b1f75848',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:54:04 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-6a18b156-6454-417e-a437-4ac963369767 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Creating volume 0090248a-074d-4949-b9ab-21c802096ad3 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:54:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6a18b156-6454-417e-a437-4ac963369767 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:54:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6a18b156-6454-417e-a437-4ac963369767 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:54:04 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-6a18b156-6454-417e-a437-4ac963369767 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:54:04 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-6a18b156-6454-417e-a437-4ac963369767 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:54:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6a18b156-6454-417e-a437-4ac963369767 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:54:04 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-6a18b156-6454-417e-a437-4ac963369767 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:54:04 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-6a18b156-6454-417e-a437-4ac963369767 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:54:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6a18b156-6454-417e-a437-4ac963369767 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0090248a-074d-4949-b9ab-21c802096ad3 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-83b47563-a4b5-4f99-b1a2-17c23cf6795a tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40ef7eb6-1311-4eda-9129-2c8a8c17269f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd335abf-2533-46b8-bae0-d13f2958194b', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:54:04 devstack sudo[106708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0090248a-074d-4949-b9ab-21c802096ad3 1073741824
Jul 09 14:54:04 devstack sudo[106708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-83b47563-a4b5-4f99-b1a2-17c23cf6795a tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8119da1b-5cc7-4392-abfc-89f30b941138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:54:04 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-83b47563-a4b5-4f99-b1a2-17c23cf6795a tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Volume volume-bd335abf-2533-46b8-bae0-d13f2958194b (bd335abf-2533-46b8-bae0-d13f2958194b): created successfully
Jul 09 14:54:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-83b47563-a4b5-4f99-b1a2-17c23cf6795a tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8119da1b-5cc7-4392-abfc-89f30b941138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:54:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-83b47563-a4b5-4f99-b1a2-17c23cf6795a tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Flow 'volume_create_manager' (6a93f4f3-5d43-4f8d-ad17-5c8c2f5a6d14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:54:04 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-83b47563-a4b5-4f99-b1a2-17c23cf6795a tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Created volume successfully.
Jul 09 14:54:05 devstack sudo[106705]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3364255c-0bc6-4660-9a9e-bcb4e5ff70e4 tempest-CreateVolumesFromSnapshotTest-303675828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-77c619ff-2c0d-4e50-9e76-17b8c4f320f7" returned: 0 in 0.685s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:05 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3364255c-0bc6-4660-9a9e-bcb4e5ff70e4 tempest-CreateVolumesFromSnapshotTest-303675828 None] Lock "cinder-quobyte-77c619ff-2c0d-4e50-9e76-17b8c4f320f7" released by "delete_volume" :: held 1.505s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:54:05 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-3364255c-0bc6-4660-9a9e-bcb4e5ff70e4 tempest-CreateVolumesFromSnapshotTest-303675828 None] Created reservations ['1029c327-45f5-49bc-8cab-0fcc8b2ade14', '867f132d-ebaf-4145-aaf8-9848533656e9', 'df0fcce9-1d55-452b-a20d-fd4cdeb76f7b', 'd3a50015-0d04-46f6-8b6a-702129a5eb1f'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:54:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3364255c-0bc6-4660-9a9e-bcb4e5ff70e4 tempest-CreateVolumesFromSnapshotTest-303675828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:54:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3364255c-0bc6-4660-9a9e-bcb4e5ff70e4 tempest-CreateVolumesFromSnapshotTest-303675828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:54:05 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3364255c-0bc6-4660-9a9e-bcb4e5ff70e4 tempest-CreateVolumesFromSnapshotTest-303675828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:54:05 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3364255c-0bc6-4660-9a9e-bcb4e5ff70e4 tempest-CreateVolumesFromSnapshotTest-303675828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:54:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3364255c-0bc6-4660-9a9e-bcb4e5ff70e4 tempest-CreateVolumesFromSnapshotTest-303675828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:54:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3364255c-0bc6-4660-9a9e-bcb4e5ff70e4 tempest-CreateVolumesFromSnapshotTest-303675828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:05 devstack sudo[106711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:54:05 devstack sudo[106711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:05 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7595ef72-b750-4ea5-aba0-d89297960f46 tempest-CreateVolumesFromSnapshotTest-303675828 None] Acquiring lock "cinder-1586047b-5cf7-469c-a65c-a5996921dc42-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:54:05 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7595ef72-b750-4ea5-aba0-d89297960f46 tempest-CreateVolumesFromSnapshotTest-303675828 None] Lock "cinder-1586047b-5cf7-469c-a65c-a5996921dc42-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:54:05 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7595ef72-b750-4ea5-aba0-d89297960f46 tempest-CreateVolumesFromSnapshotTest-303675828 None] Acquiring lock "cinder-quobyte-1586047b-5cf7-469c-a65c-a5996921dc42" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:54:05 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7595ef72-b750-4ea5-aba0-d89297960f46 tempest-CreateVolumesFromSnapshotTest-303675828 None] Lock "cinder-quobyte-1586047b-5cf7-469c-a65c-a5996921dc42" acquired by "delete_volume" :: waited 0.017s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:54:05 devstack sudo[106708]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6a18b156-6454-417e-a437-4ac963369767 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0090248a-074d-4949-b9ab-21c802096ad3 1073741824" returned: 0 in 0.915s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:05 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad4bac4f-8602-413c-b89f-3ce2c4c47adf]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:54:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7595ef72-b750-4ea5-aba0-d89297960f46 tempest-CreateVolumesFromSnapshotTest-303675828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1586047b-5cf7-469c-a65c-a5996921dc42 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6a18b156-6454-417e-a437-4ac963369767 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0090248a-074d-4949-b9ab-21c802096ad3 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:05 devstack sudo[106719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0090248a-074d-4949-b9ab-21c802096ad3
Jul 09 14:54:05 devstack sudo[106719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:05 devstack sudo[106718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1586047b-5cf7-469c-a65c-a5996921dc42
Jul 09 14:54:05 devstack sudo[106718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:05 devstack sudo[106711]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3364255c-0bc6-4660-9a9e-bcb4e5ff70e4 tempest-CreateVolumesFromSnapshotTest-303675828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.727s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:05 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-3364255c-0bc6-4660-9a9e-bcb4e5ff70e4 tempest-CreateVolumesFromSnapshotTest-303675828 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:54:05 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-3364255c-0bc6-4660-9a9e-bcb4e5ff70e4 tempest-CreateVolumesFromSnapshotTest-303675828 None] Deleted volume successfully.
Jul 09 14:54:06 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3364255c-0bc6-4660-9a9e-bcb4e5ff70e4 tempest-CreateVolumesFromSnapshotTest-303675828 None] Lock "cinder-77c619ff-2c0d-4e50-9e76-17b8c4f320f7-delete_volume" released by "delete_volume" :: held 2.499s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:54:06 devstack sudo[106719]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6a18b156-6454-417e-a437-4ac963369767 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0090248a-074d-4949-b9ab-21c802096ad3" returned: 0 in 0.693s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:06 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-6a18b156-6454-417e-a437-4ac963369767 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] <== create_volume: return (1664ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:54:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6a18b156-6454-417e-a437-4ac963369767 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.667s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:54:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-67d5c6f0-c89f-4ca2-b923-261f4b20e21b tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.142s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:54:06 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-67d5c6f0-c89f-4ca2-b923-261f4b20e21b tempest-CreateVolumesFromSourceVolumeTest-198004667 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:53:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1891206851',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1265927-f2dd-4a37-8fec-0fe09a7c20e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ad4a5cc37f94ad5abb2eafd2cd071b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:53:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:53:55Z,use_quota=True,user_id='1d08e24ebf894fd1b7aa2249b1f75848',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:54:06 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-67d5c6f0-c89f-4ca2-b923-261f4b20e21b tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Creating volume a1265927-f2dd-4a37-8fec-0fe09a7c20e5 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:54:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-67d5c6f0-c89f-4ca2-b923-261f4b20e21b tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:54:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-67d5c6f0-c89f-4ca2-b923-261f4b20e21b tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:54:06 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-67d5c6f0-c89f-4ca2-b923-261f4b20e21b tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:54:06 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-67d5c6f0-c89f-4ca2-b923-261f4b20e21b tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:54:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-67d5c6f0-c89f-4ca2-b923-261f4b20e21b tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:54:06 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-67d5c6f0-c89f-4ca2-b923-261f4b20e21b tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:54:06 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-67d5c6f0-c89f-4ca2-b923-261f4b20e21b tempest-CreateVolumesFromSourceVolumeTest-198004667 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:54:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-67d5c6f0-c89f-4ca2-b923-261f4b20e21b tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a1265927-f2dd-4a37-8fec-0fe09a7c20e5 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:06 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6a18b156-6454-417e-a437-4ac963369767 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d79eac2-0961-45f3-b633-68378f8c60ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0090248a-074d-4949-b9ab-21c802096ad3', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:54:06 devstack sudo[106726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a1265927-f2dd-4a37-8fec-0fe09a7c20e5 1073741824
Jul 09 14:54:06 devstack sudo[106726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:06 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6a18b156-6454-417e-a437-4ac963369767 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b40e64bc-bbdf-4c02-af6e-f5b67d3ab444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:54:06 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-6a18b156-6454-417e-a437-4ac963369767 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Volume volume-0090248a-074d-4949-b9ab-21c802096ad3 (0090248a-074d-4949-b9ab-21c802096ad3): created successfully
Jul 09 14:54:06 devstack sudo[106718]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:06 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6a18b156-6454-417e-a437-4ac963369767 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b40e64bc-bbdf-4c02-af6e-f5b67d3ab444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:54:06 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6a18b156-6454-417e-a437-4ac963369767 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Flow 'volume_create_manager' (9469dc05-026e-458e-83d7-77ebac8ab0e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:54:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7595ef72-b750-4ea5-aba0-d89297960f46 tempest-CreateVolumesFromSnapshotTest-303675828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1586047b-5cf7-469c-a65c-a5996921dc42" returned: 0 in 0.820s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7595ef72-b750-4ea5-aba0-d89297960f46 tempest-CreateVolumesFromSnapshotTest-303675828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1586047b-5cf7-469c-a65c-a5996921dc42 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:06 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-6a18b156-6454-417e-a437-4ac963369767 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Created volume successfully.
Jul 09 14:54:06 devstack sudo[106728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1586047b-5cf7-469c-a65c-a5996921dc42
Jul 09 14:54:06 devstack sudo[106728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:07 devstack sudo[106728]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7595ef72-b750-4ea5-aba0-d89297960f46 tempest-CreateVolumesFromSnapshotTest-303675828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1586047b-5cf7-469c-a65c-a5996921dc42" returned: 0 in 0.703s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:07 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7595ef72-b750-4ea5-aba0-d89297960f46 tempest-CreateVolumesFromSnapshotTest-303675828 None] Lock "cinder-quobyte-1586047b-5cf7-469c-a65c-a5996921dc42" released by "delete_volume" :: held 1.576s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:54:07 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-7595ef72-b750-4ea5-aba0-d89297960f46 tempest-CreateVolumesFromSnapshotTest-303675828 None] Created reservations ['ac3ea62b-a94e-47cd-b6ea-359723a4a16a', 'a53093e2-d571-4de7-89d5-58676e7a41a4', '844c24c1-2f77-4053-9d6d-9685c1e6c358', 'e75b5003-4f30-4735-a1a5-b6895c455e16'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:54:07 devstack sudo[106726]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-67d5c6f0-c89f-4ca2-b923-261f4b20e21b tempest-CreateVolumesFromSourceVolumeTest-198004667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a1265927-f2dd-4a37-8fec-0fe09a7c20e5 1073741824" returned: 0 in 0.902s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7595ef72-b750-4ea5-aba0-d89297960f46 tempest-CreateVolumesFromSnapshotTest-303675828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:54:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7595ef72-b750-4ea5-aba0-d89297960f46 tempest-CreateVolumesFromSnapshotTest-303675828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:54:07 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7595ef72-b750-4ea5-aba0-d89297960f46 tempest-CreateVolumesFromSnapshotTest-303675828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:54:07 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7595ef72-b750-4ea5-aba0-d89297960f46 tempest-CreateVolumesFromSnapshotTest-303675828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:54:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7595ef72-b750-4ea5-aba0-d89297960f46 tempest-CreateVolumesFromSnapshotTest-303675828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:54:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7595ef72-b750-4ea5-aba0-d89297960f46 tempest-CreateVolumesFromSnapshotTest-303675828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-67d5c6f0-c89f-4ca2-b923-261f4b20e21b tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a1265927-f2dd-4a37-8fec-0fe09a7c20e5 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:07 devstack sudo[106734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:54:07 devstack sudo[106734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:07 devstack sudo[106735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a1265927-f2dd-4a37-8fec-0fe09a7c20e5
Jul 09 14:54:07 devstack sudo[106735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:07 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-2bdacf4f-7f50-4eb1-8021-cd4be151f2c3 tempest-CreateVolumesFromSnapshotTest-303675828 None] Acquiring lock "cinder-97987746-5eba-4ba3-92be-4765847de99b-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:54:07 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-2bdacf4f-7f50-4eb1-8021-cd4be151f2c3 tempest-CreateVolumesFromSnapshotTest-303675828 None] Lock "cinder-97987746-5eba-4ba3-92be-4765847de99b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:54:08 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-2bdacf4f-7f50-4eb1-8021-cd4be151f2c3 tempest-CreateVolumesFromSnapshotTest-303675828 None] Acquiring lock "cinder-quobyte-97987746-5eba-4ba3-92be-4765847de99b" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:54:08 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-2bdacf4f-7f50-4eb1-8021-cd4be151f2c3 tempest-CreateVolumesFromSnapshotTest-303675828 None] Lock "cinder-quobyte-97987746-5eba-4ba3-92be-4765847de99b" acquired by "delete_volume" :: waited 0.023s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:54:08 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[0391f99e-3708-4ac3-b762-680c9185e3be]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:54:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2bdacf4f-7f50-4eb1-8021-cd4be151f2c3 tempest-CreateVolumesFromSnapshotTest-303675828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-97987746-5eba-4ba3-92be-4765847de99b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:08 devstack sudo[106734]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7595ef72-b750-4ea5-aba0-d89297960f46 tempest-CreateVolumesFromSnapshotTest-303675828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.667s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:08 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-7595ef72-b750-4ea5-aba0-d89297960f46 tempest-CreateVolumesFromSnapshotTest-303675828 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:54:08 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-7595ef72-b750-4ea5-aba0-d89297960f46 tempest-CreateVolumesFromSnapshotTest-303675828 None] Deleted volume successfully.
Jul 09 14:54:08 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7595ef72-b750-4ea5-aba0-d89297960f46 tempest-CreateVolumesFromSnapshotTest-303675828 None] Lock "cinder-1586047b-5cf7-469c-a65c-a5996921dc42-delete_volume" released by "delete_volume" :: held 2.492s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:54:08 devstack sudo[106735]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:08 devstack sudo[106740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-97987746-5eba-4ba3-92be-4765847de99b
Jul 09 14:54:08 devstack sudo[106740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-67d5c6f0-c89f-4ca2-b923-261f4b20e21b tempest-CreateVolumesFromSourceVolumeTest-198004667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a1265927-f2dd-4a37-8fec-0fe09a7c20e5" returned: 0 in 0.717s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:08 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-67d5c6f0-c89f-4ca2-b923-261f4b20e21b tempest-CreateVolumesFromSourceVolumeTest-198004667 None] <== create_volume: return (1680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:54:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-67d5c6f0-c89f-4ca2-b923-261f4b20e21b tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.683s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:54:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-860db717-fa7f-409d-9b24-1507940e4ed5 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.497s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:54:08 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-860db717-fa7f-409d-9b24-1507940e4ed5 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:53:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2011315890',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e7a8300-56d9-4788-9691-19760e852760,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ad4a5cc37f94ad5abb2eafd2cd071b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:53:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:53:56Z,use_quota=True,user_id='1d08e24ebf894fd1b7aa2249b1f75848',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:54:08 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-860db717-fa7f-409d-9b24-1507940e4ed5 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Creating volume 2e7a8300-56d9-4788-9691-19760e852760 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:54:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-860db717-fa7f-409d-9b24-1507940e4ed5 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:54:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-860db717-fa7f-409d-9b24-1507940e4ed5 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:54:08 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-860db717-fa7f-409d-9b24-1507940e4ed5 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:54:08 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-860db717-fa7f-409d-9b24-1507940e4ed5 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:54:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-860db717-fa7f-409d-9b24-1507940e4ed5 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:54:08 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-860db717-fa7f-409d-9b24-1507940e4ed5 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:54:08 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-860db717-fa7f-409d-9b24-1507940e4ed5 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:54:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-860db717-fa7f-409d-9b24-1507940e4ed5 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2e7a8300-56d9-4788-9691-19760e852760 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-67d5c6f0-c89f-4ca2-b923-261f4b20e21b tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf28f37d-96df-4435-a744-d5135e3f184b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1265927-f2dd-4a37-8fec-0fe09a7c20e5', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:54:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-67d5c6f0-c89f-4ca2-b923-261f4b20e21b tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad006cc7-1e6f-4874-bd7b-de3812cd8744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:54:08 devstack sudo[106743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2e7a8300-56d9-4788-9691-19760e852760 1073741824
Jul 09 14:54:08 devstack sudo[106743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:08 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-67d5c6f0-c89f-4ca2-b923-261f4b20e21b tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Volume volume-a1265927-f2dd-4a37-8fec-0fe09a7c20e5 (a1265927-f2dd-4a37-8fec-0fe09a7c20e5): created successfully
Jul 09 14:54:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-67d5c6f0-c89f-4ca2-b923-261f4b20e21b tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad006cc7-1e6f-4874-bd7b-de3812cd8744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:54:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-67d5c6f0-c89f-4ca2-b923-261f4b20e21b tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Flow 'volume_create_manager' (d4fa7e0b-f19b-4c5a-aa98-14a37b6e2c5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:54:08 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-67d5c6f0-c89f-4ca2-b923-261f4b20e21b tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Created volume successfully.
Jul 09 14:54:08 devstack sudo[106740]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2bdacf4f-7f50-4eb1-8021-cd4be151f2c3 tempest-CreateVolumesFromSnapshotTest-303675828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-97987746-5eba-4ba3-92be-4765847de99b" returned: 0 in 0.841s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2bdacf4f-7f50-4eb1-8021-cd4be151f2c3 tempest-CreateVolumesFromSnapshotTest-303675828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-97987746-5eba-4ba3-92be-4765847de99b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:08 devstack sudo[106751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-97987746-5eba-4ba3-92be-4765847de99b
Jul 09 14:54:08 devstack sudo[106751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:09 devstack sudo[106743]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-860db717-fa7f-409d-9b24-1507940e4ed5 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2e7a8300-56d9-4788-9691-19760e852760 1073741824" returned: 0 in 0.951s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-860db717-fa7f-409d-9b24-1507940e4ed5 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2e7a8300-56d9-4788-9691-19760e852760 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:09 devstack sudo[106754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2e7a8300-56d9-4788-9691-19760e852760
Jul 09 14:54:09 devstack sudo[106754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:09 devstack sudo[106751]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2bdacf4f-7f50-4eb1-8021-cd4be151f2c3 tempest-CreateVolumesFromSnapshotTest-303675828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-97987746-5eba-4ba3-92be-4765847de99b" returned: 0 in 0.709s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:09 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-2bdacf4f-7f50-4eb1-8021-cd4be151f2c3 tempest-CreateVolumesFromSnapshotTest-303675828 None] Lock "cinder-quobyte-97987746-5eba-4ba3-92be-4765847de99b" released by "delete_volume" :: held 1.605s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:54:09 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-2bdacf4f-7f50-4eb1-8021-cd4be151f2c3 tempest-CreateVolumesFromSnapshotTest-303675828 None] Created reservations ['cf42fb57-914e-4de8-998c-a0496b81ea84', 'a36c3cb0-db94-4437-bb68-b26df14138a8', '9498d0fe-a060-4512-a96c-8857a386b205', 'c1b1bd13-dd6a-4b0e-8baa-6347aaef8c7d'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:54:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-2bdacf4f-7f50-4eb1-8021-cd4be151f2c3 tempest-CreateVolumesFromSnapshotTest-303675828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:54:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-2bdacf4f-7f50-4eb1-8021-cd4be151f2c3 tempest-CreateVolumesFromSnapshotTest-303675828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:54:09 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-2bdacf4f-7f50-4eb1-8021-cd4be151f2c3 tempest-CreateVolumesFromSnapshotTest-303675828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:54:09 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-2bdacf4f-7f50-4eb1-8021-cd4be151f2c3 tempest-CreateVolumesFromSnapshotTest-303675828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:54:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-2bdacf4f-7f50-4eb1-8021-cd4be151f2c3 tempest-CreateVolumesFromSnapshotTest-303675828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:54:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2bdacf4f-7f50-4eb1-8021-cd4be151f2c3 tempest-CreateVolumesFromSnapshotTest-303675828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:09 devstack sudo[106757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:54:09 devstack sudo[106757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:09 devstack sudo[106754]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-860db717-fa7f-409d-9b24-1507940e4ed5 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2e7a8300-56d9-4788-9691-19760e852760" returned: 0 in 0.674s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:09 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-860db717-fa7f-409d-9b24-1507940e4ed5 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] <== create_volume: return (1693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:54:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-860db717-fa7f-409d-9b24-1507940e4ed5 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.697s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:54:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8c04e6f9-286e-4cab-bbf9-c3d4ed8760a0 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.767s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:54:09 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-8c04e6f9-286e-4cab-bbf9-c3d4ed8760a0 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:53:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-741544362',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd4696fe-a748-4550-b4ff-03a2297413f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ad4a5cc37f94ad5abb2eafd2cd071b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:53:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:53:56Z,use_quota=True,user_id='1d08e24ebf894fd1b7aa2249b1f75848',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:54:09 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-8c04e6f9-286e-4cab-bbf9-c3d4ed8760a0 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Creating volume dd4696fe-a748-4550-b4ff-03a2297413f6 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:54:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8c04e6f9-286e-4cab-bbf9-c3d4ed8760a0 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:54:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8c04e6f9-286e-4cab-bbf9-c3d4ed8760a0 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:54:09 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-8c04e6f9-286e-4cab-bbf9-c3d4ed8760a0 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:54:09 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-8c04e6f9-286e-4cab-bbf9-c3d4ed8760a0 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:54:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8c04e6f9-286e-4cab-bbf9-c3d4ed8760a0 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:54:09 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-8c04e6f9-286e-4cab-bbf9-c3d4ed8760a0 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:54:09 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-8c04e6f9-286e-4cab-bbf9-c3d4ed8760a0 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:54:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8c04e6f9-286e-4cab-bbf9-c3d4ed8760a0 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-dd4696fe-a748-4550-b4ff-03a2297413f6 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:10 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-860db717-fa7f-409d-9b24-1507940e4ed5 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd30d072-ecce-42a5-a7f0-8a7fdc2e3b30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e7a8300-56d9-4788-9691-19760e852760', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:54:10 devstack sudo[106760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-dd4696fe-a748-4550-b4ff-03a2297413f6 1073741824
Jul 09 14:54:10 devstack sudo[106760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:10 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-860db717-fa7f-409d-9b24-1507940e4ed5 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69dc2319-154b-4333-8caa-915189eee2e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:54:10 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-860db717-fa7f-409d-9b24-1507940e4ed5 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Volume volume-2e7a8300-56d9-4788-9691-19760e852760 (2e7a8300-56d9-4788-9691-19760e852760): created successfully
Jul 09 14:54:10 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-860db717-fa7f-409d-9b24-1507940e4ed5 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69dc2319-154b-4333-8caa-915189eee2e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:54:10 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-860db717-fa7f-409d-9b24-1507940e4ed5 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Flow 'volume_create_manager' (b8758ba7-d8ab-46d6-ab0d-edee324baa9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:54:10 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-860db717-fa7f-409d-9b24-1507940e4ed5 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Created volume successfully.
Jul 09 14:54:10 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-62ff1835-239d-4f96-9204-4f109ea4c151 tempest-CreateVolumesFromSnapshotTest-303675828 None] Acquiring lock "cinder-ad99f449-3ec8-4a59-a0cd-01a21f787538-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:54:10 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-62ff1835-239d-4f96-9204-4f109ea4c151 tempest-CreateVolumesFromSnapshotTest-303675828 None] Lock "cinder-ad99f449-3ec8-4a59-a0cd-01a21f787538-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:54:10 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-62ff1835-239d-4f96-9204-4f109ea4c151 tempest-CreateVolumesFromSnapshotTest-303675828 None] Acquiring lock "cinder-quobyte-ad99f449-3ec8-4a59-a0cd-01a21f787538" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:54:10 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-62ff1835-239d-4f96-9204-4f109ea4c151 tempest-CreateVolumesFromSnapshotTest-303675828 None] Lock "cinder-quobyte-ad99f449-3ec8-4a59-a0cd-01a21f787538" acquired by "delete_volume" :: waited 0.024s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:54:10 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[209d819d-781b-4a85-867b-e2cb6def406e]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:54:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-62ff1835-239d-4f96-9204-4f109ea4c151 tempest-CreateVolumesFromSnapshotTest-303675828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ad99f449-3ec8-4a59-a0cd-01a21f787538 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:10 devstack sudo[106762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ad99f449-3ec8-4a59-a0cd-01a21f787538
Jul 09 14:54:10 devstack sudo[106762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:10 devstack sudo[106757]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2bdacf4f-7f50-4eb1-8021-cd4be151f2c3 tempest-CreateVolumesFromSnapshotTest-303675828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.712s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:10 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-2bdacf4f-7f50-4eb1-8021-cd4be151f2c3 tempest-CreateVolumesFromSnapshotTest-303675828 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:54:10 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-2bdacf4f-7f50-4eb1-8021-cd4be151f2c3 tempest-CreateVolumesFromSnapshotTest-303675828 None] Deleted volume successfully.
Jul 09 14:54:10 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-2bdacf4f-7f50-4eb1-8021-cd4be151f2c3 tempest-CreateVolumesFromSnapshotTest-303675828 None] Lock "cinder-97987746-5eba-4ba3-92be-4765847de99b-delete_volume" released by "delete_volume" :: held 2.545s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:54:10 devstack sudo[106760]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8c04e6f9-286e-4cab-bbf9-c3d4ed8760a0 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-dd4696fe-a748-4550-b4ff-03a2297413f6 1073741824" returned: 0 in 0.934s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8c04e6f9-286e-4cab-bbf9-c3d4ed8760a0 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-dd4696fe-a748-4550-b4ff-03a2297413f6 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:10 devstack sudo[106769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-dd4696fe-a748-4550-b4ff-03a2297413f6
Jul 09 14:54:10 devstack sudo[106769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:11 devstack sudo[106762]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-62ff1835-239d-4f96-9204-4f109ea4c151 tempest-CreateVolumesFromSnapshotTest-303675828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ad99f449-3ec8-4a59-a0cd-01a21f787538" returned: 0 in 0.811s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-62ff1835-239d-4f96-9204-4f109ea4c151 tempest-CreateVolumesFromSnapshotTest-303675828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ad99f449-3ec8-4a59-a0cd-01a21f787538 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:11 devstack sudo[106774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ad99f449-3ec8-4a59-a0cd-01a21f787538
Jul 09 14:54:11 devstack sudo[106774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:11 devstack sudo[106769]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8c04e6f9-286e-4cab-bbf9-c3d4ed8760a0 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-dd4696fe-a748-4550-b4ff-03a2297413f6" returned: 0 in 0.666s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:11 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-8c04e6f9-286e-4cab-bbf9-c3d4ed8760a0 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] <== create_volume: return (1640ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:54:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8c04e6f9-286e-4cab-bbf9-c3d4ed8760a0 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.644s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:54:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-10cdd3ec-d12e-42d3-a717-0fd3240e7bf2 tempest-ProjectMemberTests-1092548551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 14.743s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:54:11 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-10cdd3ec-d12e-42d3-a717-0fd3240e7bf2 tempest-ProjectMemberTests-1092548551 None] Creating offline snapshot 9de5dc8c-9940-463e-bc62-15530fff5885 of volume 2d876a82-8240-4308-8dc7-24e4ca80208c {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 14:54:11 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8c04e6f9-286e-4cab-bbf9-c3d4ed8760a0 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddce0378-1ee0-4f2b-bb53-a978c263dfbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd4696fe-a748-4550-b4ff-03a2297413f6', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:54:11 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8c04e6f9-286e-4cab-bbf9-c3d4ed8760a0 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1128d5a-3781-4711-b4e6-911b24b7b395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:54:11 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6833242-3f6d-4984-891c-7cb4c2872b77]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:54:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-10cdd3ec-d12e-42d3-a717-0fd3240e7bf2 tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d876a82-8240-4308-8dc7-24e4ca80208c {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:11 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-8c04e6f9-286e-4cab-bbf9-c3d4ed8760a0 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Volume volume-dd4696fe-a748-4550-b4ff-03a2297413f6 (dd4696fe-a748-4550-b4ff-03a2297413f6): created successfully
Jul 09 14:54:11 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8c04e6f9-286e-4cab-bbf9-c3d4ed8760a0 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1128d5a-3781-4711-b4e6-911b24b7b395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:54:11 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8c04e6f9-286e-4cab-bbf9-c3d4ed8760a0 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Flow 'volume_create_manager' (dd6e6192-dbb1-4134-8927-6717c026bd73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:54:11 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-8c04e6f9-286e-4cab-bbf9-c3d4ed8760a0 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Created volume successfully.
Jul 09 14:54:11 devstack sudo[106777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d876a82-8240-4308-8dc7-24e4ca80208c
Jul 09 14:54:11 devstack sudo[106777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:11 devstack sudo[106774]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-62ff1835-239d-4f96-9204-4f109ea4c151 tempest-CreateVolumesFromSnapshotTest-303675828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ad99f449-3ec8-4a59-a0cd-01a21f787538" returned: 0 in 0.666s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:11 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-62ff1835-239d-4f96-9204-4f109ea4c151 tempest-CreateVolumesFromSnapshotTest-303675828 None] Lock "cinder-quobyte-ad99f449-3ec8-4a59-a0cd-01a21f787538" released by "delete_volume" :: held 1.527s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:54:11 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-62ff1835-239d-4f96-9204-4f109ea4c151 tempest-CreateVolumesFromSnapshotTest-303675828 None] Created reservations ['c243e187-3a5b-43f8-859f-48f48a1c8d21', '3481b6c3-a82e-49bb-b022-fc01f2ec39de', '77750ba8-b3fe-4c58-b11d-11b9f5aeb613', 'f0646aa7-b401-47bc-8f32-1e8b6a7e5d91'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:54:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-62ff1835-239d-4f96-9204-4f109ea4c151 tempest-CreateVolumesFromSnapshotTest-303675828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:54:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-62ff1835-239d-4f96-9204-4f109ea4c151 tempest-CreateVolumesFromSnapshotTest-303675828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:54:11 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-62ff1835-239d-4f96-9204-4f109ea4c151 tempest-CreateVolumesFromSnapshotTest-303675828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:54:11 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-62ff1835-239d-4f96-9204-4f109ea4c151 tempest-CreateVolumesFromSnapshotTest-303675828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:54:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-62ff1835-239d-4f96-9204-4f109ea4c151 tempest-CreateVolumesFromSnapshotTest-303675828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:54:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-62ff1835-239d-4f96-9204-4f109ea4c151 tempest-CreateVolumesFromSnapshotTest-303675828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:11 devstack sudo[106780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:54:11 devstack sudo[106780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:12 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1ff17ef8-98e7-4e2f-9d51-1cbe7e58aa0e tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Acquiring lock "cinder-dd4696fe-a748-4550-b4ff-03a2297413f6-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:54:12 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1ff17ef8-98e7-4e2f-9d51-1cbe7e58aa0e tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Lock "cinder-dd4696fe-a748-4550-b4ff-03a2297413f6-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:54:12 devstack sudo[106777]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-10cdd3ec-d12e-42d3-a717-0fd3240e7bf2 tempest-ProjectMemberTests-1092548551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d876a82-8240-4308-8dc7-24e4ca80208c" returned: 0 in 0.777s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-10cdd3ec-d12e-42d3-a717-0fd3240e7bf2 tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d876a82-8240-4308-8dc7-24e4ca80208c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d876a82-8240-4308-8dc7-24e4ca80208c.9de5dc8c-9940-463e-bc62-15530fff5885 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:12 devstack sudo[106785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d876a82-8240-4308-8dc7-24e4ca80208c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d876a82-8240-4308-8dc7-24e4ca80208c.9de5dc8c-9940-463e-bc62-15530fff5885 1G
Jul 09 14:54:12 devstack sudo[106785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:12 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-adf03198-1ebe-4a5c-9705-ae23da63d93e tempest-CreateVolumesFromSnapshotTest-303675828 None] Acquiring lock "cinder-fc6875a7-da44-4794-9a22-f0fec9e0912d-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:54:12 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1ff17ef8-98e7-4e2f-9d51-1cbe7e58aa0e tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Acquiring lock "cinder-quobyte-dd4696fe-a748-4550-b4ff-03a2297413f6" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:54:12 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-adf03198-1ebe-4a5c-9705-ae23da63d93e tempest-CreateVolumesFromSnapshotTest-303675828 None] Lock "cinder-fc6875a7-da44-4794-9a22-f0fec9e0912d-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:54:12 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1ff17ef8-98e7-4e2f-9d51-1cbe7e58aa0e tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Lock "cinder-quobyte-dd4696fe-a748-4550-b4ff-03a2297413f6" acquired by "delete_volume" :: waited 0.027s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:54:12 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[79603a27-caea-4352-8c0e-62606879db55]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:54:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1ff17ef8-98e7-4e2f-9d51-1cbe7e58aa0e tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-dd4696fe-a748-4550-b4ff-03a2297413f6 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:12 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-adf03198-1ebe-4a5c-9705-ae23da63d93e tempest-CreateVolumesFromSnapshotTest-303675828 None] Acquiring lock "cinder-quobyte-fc6875a7-da44-4794-9a22-f0fec9e0912d" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:54:12 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-adf03198-1ebe-4a5c-9705-ae23da63d93e tempest-CreateVolumesFromSnapshotTest-303675828 None] Lock "cinder-quobyte-fc6875a7-da44-4794-9a22-f0fec9e0912d" acquired by "delete_volume" :: waited 0.025s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:54:12 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[736b88e3-4ad5-462a-8b81-93312bf8c7ed]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:54:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-adf03198-1ebe-4a5c-9705-ae23da63d93e tempest-CreateVolumesFromSnapshotTest-303675828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-fc6875a7-da44-4794-9a22-f0fec9e0912d {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:12 devstack sudo[106780]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-62ff1835-239d-4f96-9204-4f109ea4c151 tempest-CreateVolumesFromSnapshotTest-303675828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.750s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:12 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-62ff1835-239d-4f96-9204-4f109ea4c151 tempest-CreateVolumesFromSnapshotTest-303675828 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:54:12 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-62ff1835-239d-4f96-9204-4f109ea4c151 tempest-CreateVolumesFromSnapshotTest-303675828 None] Deleted volume successfully.
Jul 09 14:54:12 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-62ff1835-239d-4f96-9204-4f109ea4c151 tempest-CreateVolumesFromSnapshotTest-303675828 None] Lock "cinder-ad99f449-3ec8-4a59-a0cd-01a21f787538-delete_volume" released by "delete_volume" :: held 2.483s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:54:12 devstack sudo[106788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-dd4696fe-a748-4550-b4ff-03a2297413f6
Jul 09 14:54:12 devstack sudo[106788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:12 devstack sudo[106789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-fc6875a7-da44-4794-9a22-f0fec9e0912d
Jul 09 14:54:12 devstack sudo[106789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:13 devstack sudo[106785]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-10cdd3ec-d12e-42d3-a717-0fd3240e7bf2 tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d876a82-8240-4308-8dc7-24e4ca80208c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d876a82-8240-4308-8dc7-24e4ca80208c.9de5dc8c-9940-463e-bc62-15530fff5885 1G" returned: 0 in 0.873s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-10cdd3ec-d12e-42d3-a717-0fd3240e7bf2 tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d876a82-8240-4308-8dc7-24e4ca80208c -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d876a82-8240-4308-8dc7-24e4ca80208c.9de5dc8c-9940-463e-bc62-15530fff5885 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:13 devstack sudo[106798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d876a82-8240-4308-8dc7-24e4ca80208c -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d876a82-8240-4308-8dc7-24e4ca80208c.9de5dc8c-9940-463e-bc62-15530fff5885
Jul 09 14:54:13 devstack sudo[106798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:13 devstack sudo[106788]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1ff17ef8-98e7-4e2f-9d51-1cbe7e58aa0e tempest-CreateVolumesFromSourceVolumeTest-198004667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-dd4696fe-a748-4550-b4ff-03a2297413f6" returned: 0 in 0.812s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1ff17ef8-98e7-4e2f-9d51-1cbe7e58aa0e tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-dd4696fe-a748-4550-b4ff-03a2297413f6 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:13 devstack sudo[106803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-dd4696fe-a748-4550-b4ff-03a2297413f6
Jul 09 14:54:13 devstack sudo[106803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:13 devstack sudo[106789]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-adf03198-1ebe-4a5c-9705-ae23da63d93e tempest-CreateVolumesFromSnapshotTest-303675828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-fc6875a7-da44-4794-9a22-f0fec9e0912d" returned: 0 in 0.833s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-adf03198-1ebe-4a5c-9705-ae23da63d93e tempest-CreateVolumesFromSnapshotTest-303675828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-fc6875a7-da44-4794-9a22-f0fec9e0912d {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:13 devstack sudo[106805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-fc6875a7-da44-4794-9a22-f0fec9e0912d
Jul 09 14:54:13 devstack sudo[106805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:14 devstack sudo[106803]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1ff17ef8-98e7-4e2f-9d51-1cbe7e58aa0e tempest-CreateVolumesFromSourceVolumeTest-198004667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-dd4696fe-a748-4550-b4ff-03a2297413f6" returned: 0 in 0.656s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:14 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1ff17ef8-98e7-4e2f-9d51-1cbe7e58aa0e tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Lock "cinder-quobyte-dd4696fe-a748-4550-b4ff-03a2297413f6" released by "delete_volume" :: held 1.533s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:54:14 devstack sudo[106798]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-10cdd3ec-d12e-42d3-a717-0fd3240e7bf2 tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d876a82-8240-4308-8dc7-24e4ca80208c -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d876a82-8240-4308-8dc7-24e4ca80208c.9de5dc8c-9940-463e-bc62-15530fff5885" returned: 0 in 0.774s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:14 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-10cdd3ec-d12e-42d3-a717-0fd3240e7bf2 tempest-ProjectMemberTests-1092548551 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d876a82-8240-4308-8dc7-24e4ca80208c.9de5dc8c-9940-463e-bc62-15530fff5885 is being set with open permissions: ugo+rw
Jul 09 14:54:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-10cdd3ec-d12e-42d3-a717-0fd3240e7bf2 tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d876a82-8240-4308-8dc7-24e4ca80208c.9de5dc8c-9940-463e-bc62-15530fff5885 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:14 devstack sudo[106812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d876a82-8240-4308-8dc7-24e4ca80208c.9de5dc8c-9940-463e-bc62-15530fff5885
Jul 09 14:54:14 devstack sudo[106812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:14 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-1ff17ef8-98e7-4e2f-9d51-1cbe7e58aa0e tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Created reservations ['a3c384db-275f-4457-a501-6e574897a2ca', '83e338cd-fe23-45d0-83f9-412a88651998', '2c1659fe-0237-459f-948b-41c32c85e045', '1f8b20ec-54e2-4c37-bdb5-0b97aaba7086'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:54:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1ff17ef8-98e7-4e2f-9d51-1cbe7e58aa0e tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:54:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1ff17ef8-98e7-4e2f-9d51-1cbe7e58aa0e tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:54:14 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-1ff17ef8-98e7-4e2f-9d51-1cbe7e58aa0e tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:54:14 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-1ff17ef8-98e7-4e2f-9d51-1cbe7e58aa0e tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:54:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1ff17ef8-98e7-4e2f-9d51-1cbe7e58aa0e tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:54:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1ff17ef8-98e7-4e2f-9d51-1cbe7e58aa0e tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:14 devstack sudo[106805]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-adf03198-1ebe-4a5c-9705-ae23da63d93e tempest-CreateVolumesFromSnapshotTest-303675828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-fc6875a7-da44-4794-9a22-f0fec9e0912d" returned: 0 in 0.750s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:14 devstack sudo[106815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:54:14 devstack sudo[106815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:14 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-adf03198-1ebe-4a5c-9705-ae23da63d93e tempest-CreateVolumesFromSnapshotTest-303675828 None] Lock "cinder-quobyte-fc6875a7-da44-4794-9a22-f0fec9e0912d" released by "delete_volume" :: held 1.633s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:54:14 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-adf03198-1ebe-4a5c-9705-ae23da63d93e tempest-CreateVolumesFromSnapshotTest-303675828 None] Created reservations ['66e85036-4332-49f6-8007-cef1228ea3c3', '93250401-ba3a-41b3-afbf-c96aa1e61953', 'aea96d30-a203-4669-aad1-0c252167ef84', 'c0658e7b-89c2-4321-9346-5c70a3b21a60'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:54:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-adf03198-1ebe-4a5c-9705-ae23da63d93e tempest-CreateVolumesFromSnapshotTest-303675828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:54:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-adf03198-1ebe-4a5c-9705-ae23da63d93e tempest-CreateVolumesFromSnapshotTest-303675828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:54:14 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-adf03198-1ebe-4a5c-9705-ae23da63d93e tempest-CreateVolumesFromSnapshotTest-303675828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:54:14 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-adf03198-1ebe-4a5c-9705-ae23da63d93e tempest-CreateVolumesFromSnapshotTest-303675828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:54:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-adf03198-1ebe-4a5c-9705-ae23da63d93e tempest-CreateVolumesFromSnapshotTest-303675828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:54:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-adf03198-1ebe-4a5c-9705-ae23da63d93e tempest-CreateVolumesFromSnapshotTest-303675828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:14 devstack sudo[106817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:54:14 devstack sudo[106817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:14 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-2c0f9996-6529-40ff-8dc0-dcfeab72a980 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Acquiring lock "cinder-2e7a8300-56d9-4788-9691-19760e852760-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:54:14 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-2c0f9996-6529-40ff-8dc0-dcfeab72a980 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Lock "cinder-2e7a8300-56d9-4788-9691-19760e852760-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:54:14 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1c1b58b5-56e9-420c-a9e3-90f241709b50 tempest-CreateVolumesFromSnapshotTest-303675828 None] Acquiring lock "cinder-b830e671-a102-4b4a-bc78-0d890c99499a-delete_snapshot" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:54:14 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-2c0f9996-6529-40ff-8dc0-dcfeab72a980 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Acquiring lock "cinder-quobyte-2e7a8300-56d9-4788-9691-19760e852760" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:54:14 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1c1b58b5-56e9-420c-a9e3-90f241709b50 tempest-CreateVolumesFromSnapshotTest-303675828 None] Lock "cinder-b830e671-a102-4b4a-bc78-0d890c99499a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:54:14 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1c1b58b5-56e9-420c-a9e3-90f241709b50 tempest-CreateVolumesFromSnapshotTest-303675828 None] Acquiring lock "cinder-quobyte-ac7156ee-f183-4cff-9c09-a0bb86fac1f7" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:54:14 devstack sudo[106812]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:14 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-2c0f9996-6529-40ff-8dc0-dcfeab72a980 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Lock "cinder-quobyte-2e7a8300-56d9-4788-9691-19760e852760" acquired by "delete_volume" :: waited 0.032s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:54:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-10cdd3ec-d12e-42d3-a717-0fd3240e7bf2 tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d876a82-8240-4308-8dc7-24e4ca80208c.9de5dc8c-9940-463e-bc62-15530fff5885" returned: 0 in 0.791s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:14 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1c1b58b5-56e9-420c-a9e3-90f241709b50 tempest-CreateVolumesFromSnapshotTest-303675828 None] Lock "cinder-quobyte-ac7156ee-f183-4cff-9c09-a0bb86fac1f7" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:54:14 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1c1b58b5-56e9-420c-a9e3-90f241709b50 tempest-CreateVolumesFromSnapshotTest-303675828 None] Acquiring lock "cinder-quobyte-b830e671-a102-4b4a-bc78-0d890c99499a" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:54:14 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[6037c3ac-927d-4f0b-86f6-0d59bdfd638e]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:54:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2c0f9996-6529-40ff-8dc0-dcfeab72a980 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2e7a8300-56d9-4788-9691-19760e852760 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-10cdd3ec-d12e-42d3-a717-0fd3240e7bf2 tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d876a82-8240-4308-8dc7-24e4ca80208c.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:14 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1c1b58b5-56e9-420c-a9e3-90f241709b50 tempest-CreateVolumesFromSnapshotTest-303675828 None] Lock "cinder-quobyte-b830e671-a102-4b4a-bc78-0d890c99499a" acquired by "_delete_snapshot" :: waited 0.063s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:54:14 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-1c1b58b5-56e9-420c-a9e3-90f241709b50 tempest-CreateVolumesFromSnapshotTest-303675828 None] Deleting offline snapshot b830e671-a102-4b4a-bc78-0d890c99499a of volume ac7156ee-f183-4cff-9c09-a0bb86fac1f7 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 14:54:14 devstack sudo[106822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d876a82-8240-4308-8dc7-24e4ca80208c.info
Jul 09 14:54:14 devstack sudo[106822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:14 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-1c1b58b5-56e9-420c-a9e3-90f241709b50 tempest-CreateVolumesFromSnapshotTest-303675828 None] snapshot_file for this snap is: volume-ac7156ee-f183-4cff-9c09-a0bb86fac1f7.b830e671-a102-4b4a-bc78-0d890c99499a {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 14:54:15 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c66efe0-9e63-49d2-adeb-ea18fad11c76]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:54:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1c1b58b5-56e9-420c-a9e3-90f241709b50 tempest-CreateVolumesFromSnapshotTest-303675828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ac7156ee-f183-4cff-9c09-a0bb86fac1f7.b830e671-a102-4b4a-bc78-0d890c99499a {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:15 devstack sudo[106815]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1ff17ef8-98e7-4e2f-9d51-1cbe7e58aa0e tempest-CreateVolumesFromSourceVolumeTest-198004667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.812s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:15 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-1ff17ef8-98e7-4e2f-9d51-1cbe7e58aa0e tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:54:15 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-1ff17ef8-98e7-4e2f-9d51-1cbe7e58aa0e tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Deleted volume successfully.
Jul 09 14:54:15 devstack sudo[106821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2e7a8300-56d9-4788-9691-19760e852760
Jul 09 14:54:15 devstack sudo[106821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:15 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1ff17ef8-98e7-4e2f-9d51-1cbe7e58aa0e tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Lock "cinder-dd4696fe-a748-4550-b4ff-03a2297413f6-delete_volume" released by "delete_volume" :: held 2.671s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:54:15 devstack sudo[106824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ac7156ee-f183-4cff-9c09-a0bb86fac1f7.b830e671-a102-4b4a-bc78-0d890c99499a
Jul 09 14:54:15 devstack sudo[106824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:15 devstack sudo[106817]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-adf03198-1ebe-4a5c-9705-ae23da63d93e tempest-CreateVolumesFromSnapshotTest-303675828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.822s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:15 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-adf03198-1ebe-4a5c-9705-ae23da63d93e tempest-CreateVolumesFromSnapshotTest-303675828 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:54:15 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-adf03198-1ebe-4a5c-9705-ae23da63d93e tempest-CreateVolumesFromSnapshotTest-303675828 None] Deleted volume successfully.
Jul 09 14:54:15 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-adf03198-1ebe-4a5c-9705-ae23da63d93e tempest-CreateVolumesFromSnapshotTest-303675828 None] Lock "cinder-fc6875a7-da44-4794-9a22-f0fec9e0912d-delete_volume" released by "delete_volume" :: held 2.702s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:54:15 devstack sudo[106822]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-10cdd3ec-d12e-42d3-a717-0fd3240e7bf2 tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d876a82-8240-4308-8dc7-24e4ca80208c.info" returned: 0 in 0.748s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:15 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-10cdd3ec-d12e-42d3-a717-0fd3240e7bf2 tempest-ProjectMemberTests-1092548551 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d876a82-8240-4308-8dc7-24e4ca80208c.info is being set with open permissions: ugo+rw
Jul 09 14:54:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-10cdd3ec-d12e-42d3-a717-0fd3240e7bf2 tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d876a82-8240-4308-8dc7-24e4ca80208c.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:15 devstack sudo[106832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d876a82-8240-4308-8dc7-24e4ca80208c.info
Jul 09 14:54:15 devstack sudo[106832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:15 devstack sudo[106821]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2c0f9996-6529-40ff-8dc0-dcfeab72a980 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2e7a8300-56d9-4788-9691-19760e852760" returned: 0 in 0.903s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2c0f9996-6529-40ff-8dc0-dcfeab72a980 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2e7a8300-56d9-4788-9691-19760e852760 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:15 devstack sudo[106837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2e7a8300-56d9-4788-9691-19760e852760
Jul 09 14:54:15 devstack sudo[106837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:15 devstack sudo[106824]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1c1b58b5-56e9-420c-a9e3-90f241709b50 tempest-CreateVolumesFromSnapshotTest-303675828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ac7156ee-f183-4cff-9c09-a0bb86fac1f7.b830e671-a102-4b4a-bc78-0d890c99499a" returned: 0 in 0.871s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:15 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-1c1b58b5-56e9-420c-a9e3-90f241709b50 tempest-CreateVolumesFromSnapshotTest-303675828 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ac7156ee-f183-4cff-9c09-a0bb86fac1f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 14:54:15 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[872a571b-cff2-4b25-b103-1719ea22ef8b]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:54:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1c1b58b5-56e9-420c-a9e3-90f241709b50 tempest-CreateVolumesFromSnapshotTest-303675828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ac7156ee-f183-4cff-9c09-a0bb86fac1f7 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:16 devstack sudo[106839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ac7156ee-f183-4cff-9c09-a0bb86fac1f7
Jul 09 14:54:16 devstack sudo[106839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:16 devstack sudo[106832]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-10cdd3ec-d12e-42d3-a717-0fd3240e7bf2 tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d876a82-8240-4308-8dc7-24e4ca80208c.info" returned: 0 in 0.689s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-10cdd3ec-d12e-42d3-a717-0fd3240e7bf2 tempest-ProjectMemberTests-1092548551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.775s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:54:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-dc2ee122-783f-424e-a9e0-bc81749caf9e tempest-VolumeImageDependencyTests-998889795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.661s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:54:16 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-dc2ee122-783f-424e-a9e0-bc81749caf9e tempest-VolumeImageDependencyTests-998889795 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:53:59Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4046df0-23c7-44d1-aee7-a698730418b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5149d350a9114eee81ed61c00dd1eaa1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:53:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:53:59Z,use_quota=True,user_id='236312aead074bfcb0e0059a361f10b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:54:16 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-dc2ee122-783f-424e-a9e0-bc81749caf9e tempest-VolumeImageDependencyTests-998889795 None] Creating volume e4046df0-23c7-44d1-aee7-a698730418b4 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:54:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-dc2ee122-783f-424e-a9e0-bc81749caf9e tempest-VolumeImageDependencyTests-998889795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:54:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-dc2ee122-783f-424e-a9e0-bc81749caf9e tempest-VolumeImageDependencyTests-998889795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:54:16 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-dc2ee122-783f-424e-a9e0-bc81749caf9e tempest-VolumeImageDependencyTests-998889795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:54:16 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-dc2ee122-783f-424e-a9e0-bc81749caf9e tempest-VolumeImageDependencyTests-998889795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:54:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-dc2ee122-783f-424e-a9e0-bc81749caf9e tempest-VolumeImageDependencyTests-998889795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:54:16 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-dc2ee122-783f-424e-a9e0-bc81749caf9e tempest-VolumeImageDependencyTests-998889795 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:54:16 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-dc2ee122-783f-424e-a9e0-bc81749caf9e tempest-VolumeImageDependencyTests-998889795 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:54:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dc2ee122-783f-424e-a9e0-bc81749caf9e tempest-VolumeImageDependencyTests-998889795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e4046df0-23c7-44d1-aee7-a698730418b4 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:16 devstack sudo[106843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e4046df0-23c7-44d1-aee7-a698730418b4 1073741824
Jul 09 14:54:16 devstack sudo[106843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:16 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-10cdd3ec-d12e-42d3-a717-0fd3240e7bf2 tempest-ProjectMemberTests-1092548551 None] Create snapshot completed successfully
Jul 09 14:54:16 devstack sudo[106837]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2c0f9996-6529-40ff-8dc0-dcfeab72a980 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2e7a8300-56d9-4788-9691-19760e852760" returned: 0 in 0.692s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:16 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-2c0f9996-6529-40ff-8dc0-dcfeab72a980 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Lock "cinder-quobyte-2e7a8300-56d9-4788-9691-19760e852760" released by "delete_volume" :: held 1.652s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:54:16 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-2c0f9996-6529-40ff-8dc0-dcfeab72a980 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Created reservations ['de596844-a340-49e9-98d1-aa752af40808', '16d0d925-c450-4393-9cb7-0b81431b3119', '37e55c0b-b5a9-47a7-94fd-a22f3caca81d', '37da89ac-e999-44fd-b1c3-16779553bd0a'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:54:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-2c0f9996-6529-40ff-8dc0-dcfeab72a980 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:54:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-2c0f9996-6529-40ff-8dc0-dcfeab72a980 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:54:16 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-2c0f9996-6529-40ff-8dc0-dcfeab72a980 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:54:16 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-2c0f9996-6529-40ff-8dc0-dcfeab72a980 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:54:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-2c0f9996-6529-40ff-8dc0-dcfeab72a980 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:54:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2c0f9996-6529-40ff-8dc0-dcfeab72a980 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:16 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a6e41037-6555-4bac-ab21-14579f33464c tempest-ProjectMemberTests-1092548551 None] Acquiring lock "cinder-9de5dc8c-9940-463e-bc62-15530fff5885-delete_snapshot" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:54:16 devstack sudo[106848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:54:16 devstack sudo[106848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:16 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a6e41037-6555-4bac-ab21-14579f33464c tempest-ProjectMemberTests-1092548551 None] Lock "cinder-9de5dc8c-9940-463e-bc62-15530fff5885-delete_snapshot" acquired by "delete_snapshot" :: waited 0.059s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:54:16 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a6e41037-6555-4bac-ab21-14579f33464c tempest-ProjectMemberTests-1092548551 None] Acquiring lock "cinder-quobyte-2d876a82-8240-4308-8dc7-24e4ca80208c" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:54:16 devstack sudo[106839]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1c1b58b5-56e9-420c-a9e3-90f241709b50 tempest-CreateVolumesFromSnapshotTest-303675828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ac7156ee-f183-4cff-9c09-a0bb86fac1f7" returned: 0 in 0.860s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1c1b58b5-56e9-420c-a9e3-90f241709b50 tempest-CreateVolumesFromSnapshotTest-303675828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ac7156ee-f183-4cff-9c09-a0bb86fac1f7.b830e671-a102-4b4a-bc78-0d890c99499a {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:16 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a6e41037-6555-4bac-ab21-14579f33464c tempest-ProjectMemberTests-1092548551 None] Lock "cinder-quobyte-2d876a82-8240-4308-8dc7-24e4ca80208c" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:54:16 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a6e41037-6555-4bac-ab21-14579f33464c tempest-ProjectMemberTests-1092548551 None] Acquiring lock "cinder-quobyte-9de5dc8c-9940-463e-bc62-15530fff5885" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:54:16 devstack sudo[106850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ac7156ee-f183-4cff-9c09-a0bb86fac1f7.b830e671-a102-4b4a-bc78-0d890c99499a
Jul 09 14:54:16 devstack sudo[106850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:16 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a6e41037-6555-4bac-ab21-14579f33464c tempest-ProjectMemberTests-1092548551 None] Lock "cinder-quobyte-9de5dc8c-9940-463e-bc62-15530fff5885" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:54:16 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-a6e41037-6555-4bac-ab21-14579f33464c tempest-ProjectMemberTests-1092548551 None] Deleting offline snapshot 9de5dc8c-9940-463e-bc62-15530fff5885 of volume 2d876a82-8240-4308-8dc7-24e4ca80208c {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 14:54:16 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-a6e41037-6555-4bac-ab21-14579f33464c tempest-ProjectMemberTests-1092548551 None] snapshot_file for this snap is: volume-2d876a82-8240-4308-8dc7-24e4ca80208c.9de5dc8c-9940-463e-bc62-15530fff5885 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 14:54:16 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe17b0a-538a-4e6e-b98f-2403f81fef9e]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:54:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a6e41037-6555-4bac-ab21-14579f33464c tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d876a82-8240-4308-8dc7-24e4ca80208c.9de5dc8c-9940-463e-bc62-15530fff5885 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:17 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-306d729d-fb9a-47dc-9b86-2911731c87d7 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Acquiring lock "cinder-a1265927-f2dd-4a37-8fec-0fe09a7c20e5-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:54:17 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-306d729d-fb9a-47dc-9b86-2911731c87d7 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Lock "cinder-a1265927-f2dd-4a37-8fec-0fe09a7c20e5-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:54:17 devstack sudo[106852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d876a82-8240-4308-8dc7-24e4ca80208c.9de5dc8c-9940-463e-bc62-15530fff5885
Jul 09 14:54:17 devstack sudo[106852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:17 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-306d729d-fb9a-47dc-9b86-2911731c87d7 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Acquiring lock "cinder-quobyte-a1265927-f2dd-4a37-8fec-0fe09a7c20e5" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:54:17 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-306d729d-fb9a-47dc-9b86-2911731c87d7 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Lock "cinder-quobyte-a1265927-f2dd-4a37-8fec-0fe09a7c20e5" acquired by "delete_volume" :: waited 0.028s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:54:17 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[59ca2c2b-1e9e-4b11-9fe9-871d9188ca91]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:54:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-306d729d-fb9a-47dc-9b86-2911731c87d7 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a1265927-f2dd-4a37-8fec-0fe09a7c20e5 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:17 devstack sudo[106857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a1265927-f2dd-4a37-8fec-0fe09a7c20e5
Jul 09 14:54:17 devstack sudo[106857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:17 devstack sudo[106843]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dc2ee122-783f-424e-a9e0-bc81749caf9e tempest-VolumeImageDependencyTests-998889795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e4046df0-23c7-44d1-aee7-a698730418b4 1073741824" returned: 0 in 1.177s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:17 devstack sudo[106848]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2c0f9996-6529-40ff-8dc0-dcfeab72a980 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.934s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:17 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-2c0f9996-6529-40ff-8dc0-dcfeab72a980 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:54:17 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-2c0f9996-6529-40ff-8dc0-dcfeab72a980 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Deleted volume successfully.
Jul 09 14:54:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dc2ee122-783f-424e-a9e0-bc81749caf9e tempest-VolumeImageDependencyTests-998889795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e4046df0-23c7-44d1-aee7-a698730418b4 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:17 devstack sudo[106863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e4046df0-23c7-44d1-aee7-a698730418b4
Jul 09 14:54:17 devstack sudo[106863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:17 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-2c0f9996-6529-40ff-8dc0-dcfeab72a980 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Lock "cinder-2e7a8300-56d9-4788-9691-19760e852760-delete_volume" released by "delete_volume" :: held 2.945s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:54:17 devstack sudo[106850]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1c1b58b5-56e9-420c-a9e3-90f241709b50 tempest-CreateVolumesFromSnapshotTest-303675828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ac7156ee-f183-4cff-9c09-a0bb86fac1f7.b830e671-a102-4b4a-bc78-0d890c99499a" returned: 0 in 0.949s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1c1b58b5-56e9-420c-a9e3-90f241709b50 tempest-CreateVolumesFromSnapshotTest-303675828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ac7156ee-f183-4cff-9c09-a0bb86fac1f7.b830e671-a102-4b4a-bc78-0d890c99499a {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:17 devstack sudo[106865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ac7156ee-f183-4cff-9c09-a0bb86fac1f7.b830e671-a102-4b4a-bc78-0d890c99499a
Jul 09 14:54:17 devstack sudo[106865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:18 devstack sudo[106852]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a6e41037-6555-4bac-ab21-14579f33464c tempest-ProjectMemberTests-1092548551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d876a82-8240-4308-8dc7-24e4ca80208c.9de5dc8c-9940-463e-bc62-15530fff5885" returned: 0 in 1.262s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:18 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-a6e41037-6555-4bac-ab21-14579f33464c tempest-ProjectMemberTests-1092548551 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2d876a82-8240-4308-8dc7-24e4ca80208c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 14:54:18 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[c86237c6-7365-4a63-9b6b-c4ab1f07ce63]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:54:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a6e41037-6555-4bac-ab21-14579f33464c tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d876a82-8240-4308-8dc7-24e4ca80208c {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:18 devstack sudo[106857]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-306d729d-fb9a-47dc-9b86-2911731c87d7 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a1265927-f2dd-4a37-8fec-0fe09a7c20e5" returned: 0 in 0.926s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-306d729d-fb9a-47dc-9b86-2911731c87d7 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a1265927-f2dd-4a37-8fec-0fe09a7c20e5 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:18 devstack sudo[106876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a1265927-f2dd-4a37-8fec-0fe09a7c20e5
Jul 09 14:54:18 devstack sudo[106876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:18 devstack sudo[106863]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:18 devstack sudo[106874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d876a82-8240-4308-8dc7-24e4ca80208c
Jul 09 14:54:18 devstack sudo[106874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dc2ee122-783f-424e-a9e0-bc81749caf9e tempest-VolumeImageDependencyTests-998889795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e4046df0-23c7-44d1-aee7-a698730418b4" returned: 0 in 0.695s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:18 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-dc2ee122-783f-424e-a9e0-bc81749caf9e tempest-VolumeImageDependencyTests-998889795 None] <== create_volume: return (1953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:54:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-dc2ee122-783f-424e-a9e0-bc81749caf9e tempest-VolumeImageDependencyTests-998889795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.957s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:54:18 devstack cinder-volume[87230]: DEBUG cinder.volume.volume_utils [None req-dc2ee122-783f-424e-a9e0-bc81749caf9e tempest-VolumeImageDependencyTests-998889795 None] Attempting download of 34eacf28-ca79-4be6-b4e2-9f7512ed6e6e ((None, [{'url': 'file:///opt/stack/data/glance/images/34eacf28-ca79-4be6-b4e2-9f7512ed6e6e', 'metadata': {}}])) to volume e4046df0-23c7-44d1-aee7-a698730418b4. {{(pid=87230) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 09 14:54:18 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c766c0-f259-4cda-979b-3adfbba00999]: (4, 'raw') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:54:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dc2ee122-783f-424e-a9e0-bc81749caf9e tempest-VolumeImageDependencyTests-998889795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_34eacf28-ca79-4be6-b4e2-9f7512ed6e6e_hd5dtqny {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:18 devstack sudo[106865]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1c1b58b5-56e9-420c-a9e3-90f241709b50 tempest-CreateVolumesFromSnapshotTest-303675828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ac7156ee-f183-4cff-9c09-a0bb86fac1f7.b830e671-a102-4b4a-bc78-0d890c99499a" returned: 0 in 0.768s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:18 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1c1b58b5-56e9-420c-a9e3-90f241709b50 tempest-CreateVolumesFromSnapshotTest-303675828 None] Lock "cinder-quobyte-b830e671-a102-4b4a-bc78-0d890c99499a" released by "_delete_snapshot" :: held 3.598s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:54:18 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1c1b58b5-56e9-420c-a9e3-90f241709b50 tempest-CreateVolumesFromSnapshotTest-303675828 None] Lock "cinder-quobyte-ac7156ee-f183-4cff-9c09-a0bb86fac1f7" released by "delete_snapshot" :: held 3.670s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:54:18 devstack sudo[106880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_34eacf28-ca79-4be6-b4e2-9f7512ed6e6e_hd5dtqny
Jul 09 14:54:18 devstack sudo[106880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:18 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-1c1b58b5-56e9-420c-a9e3-90f241709b50 tempest-CreateVolumesFromSnapshotTest-303675828 None] Created reservations ['3a47fe4d-7a21-4748-9eae-fd3fd1e1232a', '78fbcec3-8ce4-4e8c-b461-880a9a72d87c', '92f2d34d-c5e5-4717-a551-f4a1fd3eb21d', '4ff2101d-3b4f-46bd-b43c-408212277c60'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:54:18 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-1c1b58b5-56e9-420c-a9e3-90f241709b50 tempest-CreateVolumesFromSnapshotTest-303675828 None] Delete snapshot completed successfully.
Jul 09 14:54:18 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1c1b58b5-56e9-420c-a9e3-90f241709b50 tempest-CreateVolumesFromSnapshotTest-303675828 None] Lock "cinder-b830e671-a102-4b4a-bc78-0d890c99499a-delete_snapshot" released by "delete_snapshot" :: held 3.882s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:54:19 devstack sudo[106874]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a6e41037-6555-4bac-ab21-14579f33464c tempest-ProjectMemberTests-1092548551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d876a82-8240-4308-8dc7-24e4ca80208c" returned: 0 in 0.874s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a6e41037-6555-4bac-ab21-14579f33464c tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d876a82-8240-4308-8dc7-24e4ca80208c.9de5dc8c-9940-463e-bc62-15530fff5885 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:19 devstack sudo[106876]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-306d729d-fb9a-47dc-9b86-2911731c87d7 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-a1265927-f2dd-4a37-8fec-0fe09a7c20e5" returned: 0 in 0.875s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:19 devstack sudo[106887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d876a82-8240-4308-8dc7-24e4ca80208c.9de5dc8c-9940-463e-bc62-15530fff5885
Jul 09 14:54:19 devstack sudo[106887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:19 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8c8092ac-0d5d-45ca-8fe7-9aed4e7c8ea8 tempest-CreateVolumesFromSnapshotTest-303675828 None] Acquiring lock "cinder-ac7156ee-f183-4cff-9c09-a0bb86fac1f7-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:54:19 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-306d729d-fb9a-47dc-9b86-2911731c87d7 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Lock "cinder-quobyte-a1265927-f2dd-4a37-8fec-0fe09a7c20e5" released by "delete_volume" :: held 1.868s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:54:19 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8c8092ac-0d5d-45ca-8fe7-9aed4e7c8ea8 tempest-CreateVolumesFromSnapshotTest-303675828 None] Lock "cinder-ac7156ee-f183-4cff-9c09-a0bb86fac1f7-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:54:19 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8c8092ac-0d5d-45ca-8fe7-9aed4e7c8ea8 tempest-CreateVolumesFromSnapshotTest-303675828 None] Acquiring lock "cinder-quobyte-ac7156ee-f183-4cff-9c09-a0bb86fac1f7" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:54:19 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8c8092ac-0d5d-45ca-8fe7-9aed4e7c8ea8 tempest-CreateVolumesFromSnapshotTest-303675828 None] Lock "cinder-quobyte-ac7156ee-f183-4cff-9c09-a0bb86fac1f7" acquired by "delete_volume" :: waited 0.034s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:54:19 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-306d729d-fb9a-47dc-9b86-2911731c87d7 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Created reservations ['202b562d-fce4-4b40-a3ed-a5d3c8c4a445', 'fd02a5a9-1bc1-401e-8bd6-3125400378df', '75c9fe00-d673-47d4-8be5-37b0c53aa916', '06e4e7f1-c3cd-49c1-b252-ae4525602db6'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:54:19 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf7a291-5501-47b7-91f3-4c9d0ed81fa7]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:54:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8c8092ac-0d5d-45ca-8fe7-9aed4e7c8ea8 tempest-CreateVolumesFromSnapshotTest-303675828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ac7156ee-f183-4cff-9c09-a0bb86fac1f7 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:19 devstack sudo[106880]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dc2ee122-783f-424e-a9e0-bc81749caf9e tempest-VolumeImageDependencyTests-998889795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_34eacf28-ca79-4be6-b4e2-9f7512ed6e6e_hd5dtqny" returned: 0 in 0.839s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dc2ee122-783f-424e-a9e0-bc81749caf9e tempest-VolumeImageDependencyTests-998889795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_34eacf28-ca79-4be6-b4e2-9f7512ed6e6e_hd5dtqny {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-306d729d-fb9a-47dc-9b86-2911731c87d7 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:54:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-306d729d-fb9a-47dc-9b86-2911731c87d7 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:54:19 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-306d729d-fb9a-47dc-9b86-2911731c87d7 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:54:19 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-306d729d-fb9a-47dc-9b86-2911731c87d7 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:54:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-306d729d-fb9a-47dc-9b86-2911731c87d7 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:54:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-306d729d-fb9a-47dc-9b86-2911731c87d7 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:19 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-38c33daf-b1c0-4c00-b49c-ea021f8b61e5 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Acquiring lock "cinder-0090248a-074d-4949-b9ab-21c802096ad3-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:54:19 devstack sudo[106893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:54:19 devstack sudo[106893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:19 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-38c33daf-b1c0-4c00-b49c-ea021f8b61e5 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Lock "cinder-0090248a-074d-4949-b9ab-21c802096ad3-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:54:19 devstack sudo[106891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ac7156ee-f183-4cff-9c09-a0bb86fac1f7
Jul 09 14:54:19 devstack sudo[106891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:19 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-38c33daf-b1c0-4c00-b49c-ea021f8b61e5 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Acquiring lock "cinder-quobyte-0090248a-074d-4949-b9ab-21c802096ad3" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:54:19 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-38c33daf-b1c0-4c00-b49c-ea021f8b61e5 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Lock "cinder-quobyte-0090248a-074d-4949-b9ab-21c802096ad3" acquired by "delete_volume" :: waited 0.015s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:54:19 devstack sudo[106892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_34eacf28-ca79-4be6-b4e2-9f7512ed6e6e_hd5dtqny
Jul 09 14:54:19 devstack sudo[106892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:19 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd09989-c5d0-4a37-8719-c0fdc5d08d8b]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:54:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-38c33daf-b1c0-4c00-b49c-ea021f8b61e5 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0090248a-074d-4949-b9ab-21c802096ad3 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:19 devstack sudo[106897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0090248a-074d-4949-b9ab-21c802096ad3
Jul 09 14:54:19 devstack sudo[106897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:20 devstack sudo[106887]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a6e41037-6555-4bac-ab21-14579f33464c tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d876a82-8240-4308-8dc7-24e4ca80208c.9de5dc8c-9940-463e-bc62-15530fff5885" returned: 0 in 0.971s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a6e41037-6555-4bac-ab21-14579f33464c tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d876a82-8240-4308-8dc7-24e4ca80208c.9de5dc8c-9940-463e-bc62-15530fff5885 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:20 devstack sudo[106902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d876a82-8240-4308-8dc7-24e4ca80208c.9de5dc8c-9940-463e-bc62-15530fff5885
Jul 09 14:54:20 devstack sudo[106902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:20 devstack sudo[106893]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-306d729d-fb9a-47dc-9b86-2911731c87d7 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.930s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:20 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-306d729d-fb9a-47dc-9b86-2911731c87d7 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:54:20 devstack sudo[106892]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:20 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-306d729d-fb9a-47dc-9b86-2911731c87d7 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Deleted volume successfully.
Jul 09 14:54:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dc2ee122-783f-424e-a9e0-bc81749caf9e tempest-VolumeImageDependencyTests-998889795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_34eacf28-ca79-4be6-b4e2-9f7512ed6e6e_hd5dtqny" returned: 1 in 1.049s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dc2ee122-783f-424e-a9e0-bc81749caf9e tempest-VolumeImageDependencyTests-998889795 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_34eacf28-ca79-4be6-b4e2-9f7512ed6e6e_hd5dtqny' failed. Not Retrying. {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 09 14:54:20 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[c81a1c50-0e28-4917-9fd1-3862d1b8b2c1]: (4, 'raw') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:54:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dc2ee122-783f-424e-a9e0-bc81749caf9e tempest-VolumeImageDependencyTests-998889795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_34eacf28-ca79-4be6-b4e2-9f7512ed6e6e_d0_yz69vdevstack@QuobyteHD {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:20 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-306d729d-fb9a-47dc-9b86-2911731c87d7 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Lock "cinder-a1265927-f2dd-4a37-8fec-0fe09a7c20e5-delete_volume" released by "delete_volume" :: held 3.315s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:54:20 devstack sudo[106911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_34eacf28-ca79-4be6-b4e2-9f7512ed6e6e_d0_yz69vdevstack@QuobyteHD
Jul 09 14:54:20 devstack sudo[106911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:20 devstack sudo[106891]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8c8092ac-0d5d-45ca-8fe7-9aed4e7c8ea8 tempest-CreateVolumesFromSnapshotTest-303675828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ac7156ee-f183-4cff-9c09-a0bb86fac1f7" returned: 0 in 1.315s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8c8092ac-0d5d-45ca-8fe7-9aed4e7c8ea8 tempest-CreateVolumesFromSnapshotTest-303675828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ac7156ee-f183-4cff-9c09-a0bb86fac1f7 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:20 devstack sudo[106918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ac7156ee-f183-4cff-9c09-a0bb86fac1f7
Jul 09 14:54:20 devstack sudo[106918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:20 devstack sudo[106897]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-38c33daf-b1c0-4c00-b49c-ea021f8b61e5 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0090248a-074d-4949-b9ab-21c802096ad3" returned: 0 in 1.139s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-38c33daf-b1c0-4c00-b49c-ea021f8b61e5 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0090248a-074d-4949-b9ab-21c802096ad3 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:20 devstack sudo[106920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0090248a-074d-4949-b9ab-21c802096ad3
Jul 09 14:54:20 devstack sudo[106920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:21 devstack sudo[106902]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a6e41037-6555-4bac-ab21-14579f33464c tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d876a82-8240-4308-8dc7-24e4ca80208c.9de5dc8c-9940-463e-bc62-15530fff5885" returned: 0 in 0.981s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:21 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a6e41037-6555-4bac-ab21-14579f33464c tempest-ProjectMemberTests-1092548551 None] Lock "cinder-quobyte-9de5dc8c-9940-463e-bc62-15530fff5885" released by "_delete_snapshot" :: held 4.232s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:54:21 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a6e41037-6555-4bac-ab21-14579f33464c tempest-ProjectMemberTests-1092548551 None] Lock "cinder-quobyte-2d876a82-8240-4308-8dc7-24e4ca80208c" released by "delete_snapshot" :: held 4.264s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:54:21 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-a6e41037-6555-4bac-ab21-14579f33464c tempest-ProjectMemberTests-1092548551 None] Created reservations ['891e8f9f-51aa-45eb-934d-1fd15c5649b1', '0dc46a9e-9b23-4adb-a029-65e0da873746', '9754e6c1-7a70-4bab-bc5a-48c62b00f59b', '608af5ae-9f6c-4341-87f0-ecc8dcebc228'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:54:21 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-a6e41037-6555-4bac-ab21-14579f33464c tempest-ProjectMemberTests-1092548551 None] Delete snapshot completed successfully.
Jul 09 14:54:21 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a6e41037-6555-4bac-ab21-14579f33464c tempest-ProjectMemberTests-1092548551 None] Lock "cinder-9de5dc8c-9940-463e-bc62-15530fff5885-delete_snapshot" released by "delete_snapshot" :: held 4.456s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:54:21 devstack sudo[106911]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dc2ee122-783f-424e-a9e0-bc81749caf9e tempest-VolumeImageDependencyTests-998889795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_34eacf28-ca79-4be6-b4e2-9f7512ed6e6e_d0_yz69vdevstack@QuobyteHD" returned: 0 in 0.964s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dc2ee122-783f-424e-a9e0-bc81749caf9e tempest-VolumeImageDependencyTests-998889795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_34eacf28-ca79-4be6-b4e2-9f7512ed6e6e_d0_yz69vdevstack@QuobyteHD {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:21 devstack sudo[106918]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8c8092ac-0d5d-45ca-8fe7-9aed4e7c8ea8 tempest-CreateVolumesFromSnapshotTest-303675828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ac7156ee-f183-4cff-9c09-a0bb86fac1f7" returned: 0 in 0.780s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:21 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8c8092ac-0d5d-45ca-8fe7-9aed4e7c8ea8 tempest-CreateVolumesFromSnapshotTest-303675828 None] Lock "cinder-quobyte-ac7156ee-f183-4cff-9c09-a0bb86fac1f7" released by "delete_volume" :: held 2.178s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:54:21 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-8c8092ac-0d5d-45ca-8fe7-9aed4e7c8ea8 tempest-CreateVolumesFromSnapshotTest-303675828 None] Created reservations ['5c34ae26-848c-47d9-b179-1e0db981fce0', 'd703078a-9771-4040-a34d-cb29bfc3e87b', 'ab34db65-ff2f-4302-84fe-ef2691ef5ad8', '7af1471c-2194-4e7e-9977-110d66c2aa39'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:54:21 devstack sudo[106920]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-38c33daf-b1c0-4c00-b49c-ea021f8b61e5 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-0090248a-074d-4949-b9ab-21c802096ad3" returned: 0 in 0.726s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:21 devstack sudo[106929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_34eacf28-ca79-4be6-b4e2-9f7512ed6e6e_d0_yz69vdevstack@QuobyteHD
Jul 09 14:54:21 devstack sudo[106929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:21 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-38c33daf-b1c0-4c00-b49c-ea021f8b61e5 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Lock "cinder-quobyte-0090248a-074d-4949-b9ab-21c802096ad3" released by "delete_volume" :: held 1.936s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:54:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8c8092ac-0d5d-45ca-8fe7-9aed4e7c8ea8 tempest-CreateVolumesFromSnapshotTest-303675828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:54:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8c8092ac-0d5d-45ca-8fe7-9aed4e7c8ea8 tempest-CreateVolumesFromSnapshotTest-303675828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:54:21 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-8c8092ac-0d5d-45ca-8fe7-9aed4e7c8ea8 tempest-CreateVolumesFromSnapshotTest-303675828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:54:21 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-8c8092ac-0d5d-45ca-8fe7-9aed4e7c8ea8 tempest-CreateVolumesFromSnapshotTest-303675828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:54:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8c8092ac-0d5d-45ca-8fe7-9aed4e7c8ea8 tempest-CreateVolumesFromSnapshotTest-303675828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:54:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8c8092ac-0d5d-45ca-8fe7-9aed4e7c8ea8 tempest-CreateVolumesFromSnapshotTest-303675828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:21 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-38c33daf-b1c0-4c00-b49c-ea021f8b61e5 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Created reservations ['c4dc869a-947e-41c5-9dd3-bd4f34c66b18', '8ab8bdb2-5918-4ec0-922a-24c764a15f31', '932618f3-1986-4c21-9723-4856b56c450e', '92c60329-ec79-418f-b1af-e3799a10b381'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:54:21 devstack sudo[106932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:54:21 devstack sudo[106932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-38c33daf-b1c0-4c00-b49c-ea021f8b61e5 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:54:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-38c33daf-b1c0-4c00-b49c-ea021f8b61e5 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:54:21 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-38c33daf-b1c0-4c00-b49c-ea021f8b61e5 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:54:21 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-38c33daf-b1c0-4c00-b49c-ea021f8b61e5 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:54:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-38c33daf-b1c0-4c00-b49c-ea021f8b61e5 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:54:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-38c33daf-b1c0-4c00-b49c-ea021f8b61e5 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:21 devstack sudo[106934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:54:21 devstack sudo[106934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:21 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b6c18b6d-f56d-4bd8-b59a-f5f24a14568e tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Acquiring lock "cinder-bd335abf-2533-46b8-bae0-d13f2958194b-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:54:21 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b6c18b6d-f56d-4bd8-b59a-f5f24a14568e tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Lock "cinder-bd335abf-2533-46b8-bae0-d13f2958194b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:54:21 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b6c18b6d-f56d-4bd8-b59a-f5f24a14568e tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Acquiring lock "cinder-quobyte-bd335abf-2533-46b8-bae0-d13f2958194b" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:54:21 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b6c18b6d-f56d-4bd8-b59a-f5f24a14568e tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Lock "cinder-quobyte-bd335abf-2533-46b8-bae0-d13f2958194b" acquired by "delete_volume" :: waited 0.029s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:54:22 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b6ff0e-8a6f-49ff-801d-a3448f970cd9]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:54:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b6c18b6d-f56d-4bd8-b59a-f5f24a14568e tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bd335abf-2533-46b8-bae0-d13f2958194b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:22 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3fab3fec-0cba-4a7f-a478-e0ffd6913222 tempest-ProjectMemberTests-1092548551 None] Acquiring lock "cinder-2d876a82-8240-4308-8dc7-24e4ca80208c-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:54:22 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3fab3fec-0cba-4a7f-a478-e0ffd6913222 tempest-ProjectMemberTests-1092548551 None] Lock "cinder-2d876a82-8240-4308-8dc7-24e4ca80208c-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:54:22 devstack sudo[106936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bd335abf-2533-46b8-bae0-d13f2958194b
Jul 09 14:54:22 devstack sudo[106936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:22 devstack sudo[106929]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:22 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3fab3fec-0cba-4a7f-a478-e0ffd6913222 tempest-ProjectMemberTests-1092548551 None] Acquiring lock "cinder-quobyte-2d876a82-8240-4308-8dc7-24e4ca80208c" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:54:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dc2ee122-783f-424e-a9e0-bc81749caf9e tempest-VolumeImageDependencyTests-998889795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_34eacf28-ca79-4be6-b4e2-9f7512ed6e6e_d0_yz69vdevstack@QuobyteHD" returned: 1 in 0.924s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dc2ee122-783f-424e-a9e0-bc81749caf9e tempest-VolumeImageDependencyTests-998889795 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_34eacf28-ca79-4be6-b4e2-9f7512ed6e6e_d0_yz69vdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 09 14:54:22 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-dc2ee122-783f-424e-a9e0-bc81749caf9e tempest-VolumeImageDependencyTests-998889795 None] 34eacf28-ca79-4be6-b4e2-9f7512ed6e6e was raw, converting to raw {{(pid=87230) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 09 14:54:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dc2ee122-783f-424e-a9e0-bc81749caf9e tempest-VolumeImageDependencyTests-998889795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_34eacf28-ca79-4be6-b4e2-9f7512ed6e6e_d0_yz69vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e4046df0-23c7-44d1-aee7-a698730418b4 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:22 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3fab3fec-0cba-4a7f-a478-e0ffd6913222 tempest-ProjectMemberTests-1092548551 None] Lock "cinder-quobyte-2d876a82-8240-4308-8dc7-24e4ca80208c" acquired by "delete_volume" :: waited 0.062s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:54:22 devstack sudo[106941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_34eacf28-ca79-4be6-b4e2-9f7512ed6e6e_d0_yz69vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e4046df0-23c7-44d1-aee7-a698730418b4
Jul 09 14:54:22 devstack sudo[106941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:22 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e17e277-7375-4f98-8745-c8573799f246]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:54:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3fab3fec-0cba-4a7f-a478-e0ffd6913222 tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d876a82-8240-4308-8dc7-24e4ca80208c {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:22 devstack sudo[106932]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8c8092ac-0d5d-45ca-8fe7-9aed4e7c8ea8 tempest-CreateVolumesFromSnapshotTest-303675828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.912s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:22 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-8c8092ac-0d5d-45ca-8fe7-9aed4e7c8ea8 tempest-CreateVolumesFromSnapshotTest-303675828 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:54:22 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-8c8092ac-0d5d-45ca-8fe7-9aed4e7c8ea8 tempest-CreateVolumesFromSnapshotTest-303675828 None] Deleted volume successfully.
Jul 09 14:54:22 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8c8092ac-0d5d-45ca-8fe7-9aed4e7c8ea8 tempest-CreateVolumesFromSnapshotTest-303675828 None] Lock "cinder-ac7156ee-f183-4cff-9c09-a0bb86fac1f7-delete_volume" released by "delete_volume" :: held 3.409s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:54:22 devstack sudo[106944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d876a82-8240-4308-8dc7-24e4ca80208c
Jul 09 14:54:22 devstack sudo[106944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:22 devstack sudo[106934]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-38c33daf-b1c0-4c00-b49c-ea021f8b61e5 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.936s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:22 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-38c33daf-b1c0-4c00-b49c-ea021f8b61e5 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:54:22 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-38c33daf-b1c0-4c00-b49c-ea021f8b61e5 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Deleted volume successfully.
Jul 09 14:54:22 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-38c33daf-b1c0-4c00-b49c-ea021f8b61e5 tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Lock "cinder-0090248a-074d-4949-b9ab-21c802096ad3-delete_volume" released by "delete_volume" :: held 3.272s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:54:23 devstack sudo[106936]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b6c18b6d-f56d-4bd8-b59a-f5f24a14568e tempest-CreateVolumesFromSourceVolumeTest-198004667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bd335abf-2533-46b8-bae0-d13f2958194b" returned: 0 in 1.015s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b6c18b6d-f56d-4bd8-b59a-f5f24a14568e tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bd335abf-2533-46b8-bae0-d13f2958194b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:23 devstack sudo[106953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bd335abf-2533-46b8-bae0-d13f2958194b
Jul 09 14:54:23 devstack sudo[106953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:23 devstack sudo[106941]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dc2ee122-783f-424e-a9e0-bc81749caf9e tempest-VolumeImageDependencyTests-998889795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_34eacf28-ca79-4be6-b4e2-9f7512ed6e6e_d0_yz69vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e4046df0-23c7-44d1-aee7-a698730418b4" returned: 0 in 0.967s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:23 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-dc2ee122-783f-424e-a9e0-bc81749caf9e tempest-VolumeImageDependencyTests-998889795 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_34eacf28-ca79-4be6-b4e2-9f7512ed6e6e_d0_yz69vdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e4046df0-23c7-44d1-aee7-a698730418b4 {{(pid=87230) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 09 14:54:23 devstack cinder-volume[87230]: INFO cinder.image.image_utils [None req-dc2ee122-783f-424e-a9e0-bc81749caf9e tempest-VolumeImageDependencyTests-998889795 None] Converted 0.00 MB image at 0.00 MB/s
Jul 09 14:54:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dc2ee122-783f-424e-a9e0-bc81749caf9e tempest-VolumeImageDependencyTests-998889795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e4046df0-23c7-44d1-aee7-a698730418b4 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:23 devstack sudo[106956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e4046df0-23c7-44d1-aee7-a698730418b4 1G
Jul 09 14:54:23 devstack sudo[106956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:23 devstack sudo[106944]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3fab3fec-0cba-4a7f-a478-e0ffd6913222 tempest-ProjectMemberTests-1092548551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d876a82-8240-4308-8dc7-24e4ca80208c" returned: 0 in 1.068s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3fab3fec-0cba-4a7f-a478-e0ffd6913222 tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d876a82-8240-4308-8dc7-24e4ca80208c {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:23 devstack sudo[106961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d876a82-8240-4308-8dc7-24e4ca80208c
Jul 09 14:54:23 devstack sudo[106961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:23 devstack sudo[106953]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b6c18b6d-f56d-4bd8-b59a-f5f24a14568e tempest-CreateVolumesFromSourceVolumeTest-198004667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bd335abf-2533-46b8-bae0-d13f2958194b" returned: 0 in 0.776s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:23 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b6c18b6d-f56d-4bd8-b59a-f5f24a14568e tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Lock "cinder-quobyte-bd335abf-2533-46b8-bae0-d13f2958194b" released by "delete_volume" :: held 1.859s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:54:23 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-b6c18b6d-f56d-4bd8-b59a-f5f24a14568e tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Created reservations ['a3b940c6-8262-42d6-8380-328cbcb0166d', 'f1a61118-f633-4b28-9758-ef2ff47d58b4', '91caec30-8c85-4480-abba-134470ebce91', 'cbe48e7e-203a-49e4-b432-6b4e5f1931cf'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:54:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b6c18b6d-f56d-4bd8-b59a-f5f24a14568e tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:54:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b6c18b6d-f56d-4bd8-b59a-f5f24a14568e tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:54:23 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b6c18b6d-f56d-4bd8-b59a-f5f24a14568e tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:54:23 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b6c18b6d-f56d-4bd8-b59a-f5f24a14568e tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:54:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b6c18b6d-f56d-4bd8-b59a-f5f24a14568e tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:54:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b6c18b6d-f56d-4bd8-b59a-f5f24a14568e tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:24 devstack sudo[106967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:54:24 devstack sudo[106967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:24 devstack sudo[106956]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dc2ee122-783f-424e-a9e0-bc81749caf9e tempest-VolumeImageDependencyTests-998889795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e4046df0-23c7-44d1-aee7-a698730418b4 1G" returned: 0 in 0.817s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:24 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f8927a-c379-48b7-9dbc-3050cd1d5e2f]: (4, 'raw') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:54:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dc2ee122-783f-424e-a9e0-bc81749caf9e tempest-VolumeImageDependencyTests-998889795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e4046df0-23c7-44d1-aee7-a698730418b4 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:24 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c5028f42-5722-4622-9959-5f9cb0d9b10f tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Acquiring lock "cinder-c532d40d-dabb-4ed6-a47c-368185b6317f-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:54:24 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c5028f42-5722-4622-9959-5f9cb0d9b10f tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Lock "cinder-c532d40d-dabb-4ed6-a47c-368185b6317f-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:54:24 devstack sudo[106969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e4046df0-23c7-44d1-aee7-a698730418b4
Jul 09 14:54:24 devstack sudo[106969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:24 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c5028f42-5722-4622-9959-5f9cb0d9b10f tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Acquiring lock "cinder-quobyte-c532d40d-dabb-4ed6-a47c-368185b6317f" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:54:24 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c5028f42-5722-4622-9959-5f9cb0d9b10f tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Lock "cinder-quobyte-c532d40d-dabb-4ed6-a47c-368185b6317f" acquired by "delete_volume" :: waited 0.024s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:54:24 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[64efc53f-1361-446e-b247-ab33d2e05346]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:54:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c5028f42-5722-4622-9959-5f9cb0d9b10f tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-c532d40d-dabb-4ed6-a47c-368185b6317f {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:24 devstack sudo[106961]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3fab3fec-0cba-4a7f-a478-e0ffd6913222 tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-2d876a82-8240-4308-8dc7-24e4ca80208c" returned: 0 in 0.956s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:24 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3fab3fec-0cba-4a7f-a478-e0ffd6913222 tempest-ProjectMemberTests-1092548551 None] Lock "cinder-quobyte-2d876a82-8240-4308-8dc7-24e4ca80208c" released by "delete_volume" :: held 2.144s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:54:24 devstack sudo[106972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-c532d40d-dabb-4ed6-a47c-368185b6317f
Jul 09 14:54:24 devstack sudo[106972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:24 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-3fab3fec-0cba-4a7f-a478-e0ffd6913222 tempest-ProjectMemberTests-1092548551 None] Created reservations ['0779b8cf-401d-43ba-859d-059a41bdab30', 'b26bedfc-73b6-48ed-8419-1ae01fc1bbdd', '3e282425-e2db-4ba2-9151-ed3f876d727e', '530891dc-1d9a-4b99-a25a-b02cf3c3bc5a'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:54:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3fab3fec-0cba-4a7f-a478-e0ffd6913222 tempest-ProjectMemberTests-1092548551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:54:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3fab3fec-0cba-4a7f-a478-e0ffd6913222 tempest-ProjectMemberTests-1092548551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:54:24 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3fab3fec-0cba-4a7f-a478-e0ffd6913222 tempest-ProjectMemberTests-1092548551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:54:24 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3fab3fec-0cba-4a7f-a478-e0ffd6913222 tempest-ProjectMemberTests-1092548551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:54:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3fab3fec-0cba-4a7f-a478-e0ffd6913222 tempest-ProjectMemberTests-1092548551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:54:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3fab3fec-0cba-4a7f-a478-e0ffd6913222 tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:24 devstack sudo[106975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:54:24 devstack sudo[106975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:24 devstack sudo[106967]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b6c18b6d-f56d-4bd8-b59a-f5f24a14568e tempest-CreateVolumesFromSourceVolumeTest-198004667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.916s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:24 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-b6c18b6d-f56d-4bd8-b59a-f5f24a14568e tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:54:24 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-b6c18b6d-f56d-4bd8-b59a-f5f24a14568e tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Deleted volume successfully.
Jul 09 14:54:24 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b6c18b6d-f56d-4bd8-b59a-f5f24a14568e tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Lock "cinder-bd335abf-2533-46b8-bae0-d13f2958194b-delete_volume" released by "delete_volume" :: held 3.095s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:54:25 devstack sudo[106969]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dc2ee122-783f-424e-a9e0-bc81749caf9e tempest-VolumeImageDependencyTests-998889795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e4046df0-23c7-44d1-aee7-a698730418b4" returned: 0 in 1.126s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dc2ee122-783f-424e-a9e0-bc81749caf9e tempest-VolumeImageDependencyTests-998889795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e4046df0-23c7-44d1-aee7-a698730418b4 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:25 devstack sudo[106981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e4046df0-23c7-44d1-aee7-a698730418b4
Jul 09 14:54:25 devstack sudo[106981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:25 devstack sudo[106972]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c5028f42-5722-4622-9959-5f9cb0d9b10f tempest-CreateVolumesFromSourceVolumeTest-198004667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-c532d40d-dabb-4ed6-a47c-368185b6317f" returned: 0 in 1.049s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c5028f42-5722-4622-9959-5f9cb0d9b10f tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-c532d40d-dabb-4ed6-a47c-368185b6317f {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:25 devstack sudo[106985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-c532d40d-dabb-4ed6-a47c-368185b6317f
Jul 09 14:54:25 devstack sudo[106985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:25 devstack sudo[106975]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3fab3fec-0cba-4a7f-a478-e0ffd6913222 tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.838s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:25 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-3fab3fec-0cba-4a7f-a478-e0ffd6913222 tempest-ProjectMemberTests-1092548551 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:54:25 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-3fab3fec-0cba-4a7f-a478-e0ffd6913222 tempest-ProjectMemberTests-1092548551 None] Deleted volume successfully.
Jul 09 14:54:25 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3fab3fec-0cba-4a7f-a478-e0ffd6913222 tempest-ProjectMemberTests-1092548551 None] Lock "cinder-2d876a82-8240-4308-8dc7-24e4ca80208c-delete_volume" released by "delete_volume" :: held 3.374s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:54:26 devstack sudo[106985]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:26 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-59e51a4b-0421-44fe-a143-ea20ffaf0d85 tempest-ProjectMemberTests-1092548551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:54:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-59e51a4b-0421-44fe-a143-ea20ffaf0d85 tempest-ProjectMemberTests-1092548551 None] Flow 'volume_create_manager' (0c115777-170a-4487-8eb3-7179a69c6720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:54:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-59e51a4b-0421-44fe-a143-ea20ffaf0d85 tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b5e0567-35f7-4e54-9baa-ffb19504a7a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:54:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c5028f42-5722-4622-9959-5f9cb0d9b10f tempest-CreateVolumesFromSourceVolumeTest-198004667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-c532d40d-dabb-4ed6-a47c-368185b6317f" returned: 0 in 0.826s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:26 devstack sudo[106981]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:26 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c5028f42-5722-4622-9959-5f9cb0d9b10f tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Lock "cinder-quobyte-c532d40d-dabb-4ed6-a47c-368185b6317f" released by "delete_volume" :: held 1.953s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:54:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dc2ee122-783f-424e-a9e0-bc81749caf9e tempest-VolumeImageDependencyTests-998889795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e4046df0-23c7-44d1-aee7-a698730418b4" returned: 1 in 1.032s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dc2ee122-783f-424e-a9e0-bc81749caf9e tempest-VolumeImageDependencyTests-998889795 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e4046df0-23c7-44d1-aee7-a698730418b4' failed. Not Retrying. {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 09 14:54:26 devstack cinder-volume[87230]: DEBUG cinder.volume.volume_utils [None req-dc2ee122-783f-424e-a9e0-bc81749caf9e tempest-VolumeImageDependencyTests-998889795 None] Downloaded image 34eacf28-ca79-4be6-b4e2-9f7512ed6e6e ((None, [{'url': 'file:///opt/stack/data/glance/images/34eacf28-ca79-4be6-b4e2-9f7512ed6e6e', 'metadata': {}}])) to volume e4046df0-23c7-44d1-aee7-a698730418b4 successfully. {{(pid=87230) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 09 14:54:26 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-dc2ee122-783f-424e-a9e0-bc81749caf9e tempest-VolumeImageDependencyTests-998889795 None] Temporary image 34eacf28-ca79-4be6-b4e2-9f7512ed6e6e for user 236312aead074bfcb0e0059a361f10b2 is deleted. {{(pid=87230) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 09 14:54:26 devstack cinder-volume[87230]: DEBUG cinder.volume.volume_utils [None req-dc2ee122-783f-424e-a9e0-bc81749caf9e tempest-VolumeImageDependencyTests-998889795 None] Marking volume e4046df0-23c7-44d1-aee7-a698730418b4 as bootable. {{(pid=87230) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 09 14:54:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-59e51a4b-0421-44fe-a143-ea20ffaf0d85 tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b5e0567-35f7-4e54-9baa-ffb19504a7a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:54:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1621664570',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a948584-ad5a-46ab-b602-be3c72e61272,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53e3a7b509634eeda7e218e1577efd89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:54:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:54:26Z,use_quota=True,user_id='6f31a0c3fe3e49ccabfa9bdf47df92af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:54:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-59e51a4b-0421-44fe-a143-ea20ffaf0d85 tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e878adf-2abb-469d-bf18-66a306652d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:54:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-59e51a4b-0421-44fe-a143-ea20ffaf0d85 tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e878adf-2abb-469d-bf18-66a306652d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:54:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-59e51a4b-0421-44fe-a143-ea20ffaf0d85 tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (582b9ba0-6149-4aff-945d-66590ebd19c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:54:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-59e51a4b-0421-44fe-a143-ea20ffaf0d85 tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (582b9ba0-6149-4aff-945d-66590ebd19c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a948584-ad5a-46ab-b602-be3c72e61272', 'volume_name': 'volume-1a948584-ad5a-46ab-b602-be3c72e61272', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:54:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-59e51a4b-0421-44fe-a143-ea20ffaf0d85 tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f1cdf52-cb5c-454e-85e4-b0069a20803c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:54:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-59e51a4b-0421-44fe-a143-ea20ffaf0d85 tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f1cdf52-cb5c-454e-85e4-b0069a20803c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:54:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-59e51a4b-0421-44fe-a143-ea20ffaf0d85 tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0a79eab-6e2d-4279-8c9f-d4d1cfc4a4b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:54:26 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-59e51a4b-0421-44fe-a143-ea20ffaf0d85 tempest-ProjectMemberTests-1092548551 None] Volume 1a948584-ad5a-46ab-b602-be3c72e61272: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a948584-ad5a-46ab-b602-be3c72e61272', 'volume_size': 1}
Jul 09 14:54:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-59e51a4b-0421-44fe-a143-ea20ffaf0d85 tempest-ProjectMemberTests-1092548551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:54:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-59e51a4b-0421-44fe-a143-ea20ffaf0d85 tempest-ProjectMemberTests-1092548551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:54:26 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-59e51a4b-0421-44fe-a143-ea20ffaf0d85 tempest-ProjectMemberTests-1092548551 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:54:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1621664570',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a948584-ad5a-46ab-b602-be3c72e61272,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53e3a7b509634eeda7e218e1577efd89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:54:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:54:26Z,use_quota=True,user_id='6f31a0c3fe3e49ccabfa9bdf47df92af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:54:26 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-59e51a4b-0421-44fe-a143-ea20ffaf0d85 tempest-ProjectMemberTests-1092548551 None] Creating volume 1a948584-ad5a-46ab-b602-be3c72e61272 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:54:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-59e51a4b-0421-44fe-a143-ea20ffaf0d85 tempest-ProjectMemberTests-1092548551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:54:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-59e51a4b-0421-44fe-a143-ea20ffaf0d85 tempest-ProjectMemberTests-1092548551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:54:26 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-59e51a4b-0421-44fe-a143-ea20ffaf0d85 tempest-ProjectMemberTests-1092548551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:54:26 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-59e51a4b-0421-44fe-a143-ea20ffaf0d85 tempest-ProjectMemberTests-1092548551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:54:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-59e51a4b-0421-44fe-a143-ea20ffaf0d85 tempest-ProjectMemberTests-1092548551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:54:26 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-59e51a4b-0421-44fe-a143-ea20ffaf0d85 tempest-ProjectMemberTests-1092548551 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:54:26 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-59e51a4b-0421-44fe-a143-ea20ffaf0d85 tempest-ProjectMemberTests-1092548551 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:54:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-59e51a4b-0421-44fe-a143-ea20ffaf0d85 tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1a948584-ad5a-46ab-b602-be3c72e61272 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:26 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc2ee122-783f-424e-a9e0-bc81749caf9e tempest-VolumeImageDependencyTests-998889795 None] Copying metadata from image 34eacf28-ca79-4be6-b4e2-9f7512ed6e6e to e4046df0-23c7-44d1-aee7-a698730418b4. {{(pid=87230) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 09 14:54:26 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc2ee122-783f-424e-a9e0-bc81749caf9e tempest-VolumeImageDependencyTests-998889795 None] Creating volume glance metadata for volume e4046df0-23c7-44d1-aee7-a698730418b4 backed by image 34eacf28-ca79-4be6-b4e2-9f7512ed6e6e with: {'image_id': '34eacf28-ca79-4be6-b4e2-9f7512ed6e6e', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'bc25a56de2393a7e3765d3a6f2b61b05', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87230) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 09 14:54:26 devstack sudo[106991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1a948584-ad5a-46ab-b602-be3c72e61272 1073741824
Jul 09 14:54:26 devstack sudo[106991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:26 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-c5028f42-5722-4622-9959-5f9cb0d9b10f tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Created reservations ['d4f59b6b-f669-4e4f-9974-d2e8f14fc9b8', '89a616bc-5501-47d1-922a-0143d2a15509', '6b9c85e1-028b-4ac3-b03a-32e3ab8ce731', 'b0325914-c8e0-4ce7-8018-e27b56c5fe9d'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:54:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dc2ee122-783f-424e-a9e0-bc81749caf9e tempest-VolumeImageDependencyTests-998889795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9e63348-d68c-4d7d-891d-211a44045f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4046df0-23c7-44d1-aee7-a698730418b4', 'volume_size': 1, 'image_id': '34eacf28-ca79-4be6-b4e2-9f7512ed6e6e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/34eacf28-ca79-4be6-b4e2-9f7512ed6e6e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'bc25a56de2393a7e3765d3a6f2b61b05', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5149d350a9114eee81ed61c00dd1eaa1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '89a62bcc84effd8f119f6b2a6bf668adbb3930dcbcdc18c7b09f7e36934b71390f049a5caf719e640e4acdbf868efa9da58cbdb0ea7fb930653416dfe5d435cd', 'id': '34eacf28-ca79-4be6-b4e2-9f7512ed6e6e', 'created_at': datetime.datetime(2026, 7, 9, 12, 53, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 12, 53, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/34eacf28-ca79-4be6-b4e2-9f7512ed6e6e/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x720a4a1cb950>}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:54:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dc2ee122-783f-424e-a9e0-bc81749caf9e tempest-VolumeImageDependencyTests-998889795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b96e1fc-d21b-4edc-aaed-8ff9839dc601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:54:26 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-dc2ee122-783f-424e-a9e0-bc81749caf9e tempest-VolumeImageDependencyTests-998889795 None] Volume volume-e4046df0-23c7-44d1-aee7-a698730418b4 (e4046df0-23c7-44d1-aee7-a698730418b4): created successfully
Jul 09 14:54:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dc2ee122-783f-424e-a9e0-bc81749caf9e tempest-VolumeImageDependencyTests-998889795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b96e1fc-d21b-4edc-aaed-8ff9839dc601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:54:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dc2ee122-783f-424e-a9e0-bc81749caf9e tempest-VolumeImageDependencyTests-998889795 None] Flow 'volume_create_manager' (d4e6c305-abab-4f04-bed1-dcae16877d3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:54:26 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-dc2ee122-783f-424e-a9e0-bc81749caf9e tempest-VolumeImageDependencyTests-998889795 None] Created volume successfully.
Jul 09 14:54:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c5028f42-5722-4622-9959-5f9cb0d9b10f tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:54:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c5028f42-5722-4622-9959-5f9cb0d9b10f tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:54:26 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-c5028f42-5722-4622-9959-5f9cb0d9b10f tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:54:26 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-c5028f42-5722-4622-9959-5f9cb0d9b10f tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:54:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c5028f42-5722-4622-9959-5f9cb0d9b10f tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:54:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c5028f42-5722-4622-9959-5f9cb0d9b10f tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:26 devstack sudo[106993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:54:26 devstack sudo[106993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:27 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-db80e7da-b4ae-4427-bbcd-641ad51b2cfa tempest-ProjectAdminTests-1986448573 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.648853302002, 'free_capacity_gb': 1775.648853302002, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87230) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Jul 09 14:54:27 devstack sudo[106993]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c5028f42-5722-4622-9959-5f9cb0d9b10f tempest-CreateVolumesFromSourceVolumeTest-198004667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.687s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:27 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-c5028f42-5722-4622-9959-5f9cb0d9b10f tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:54:27 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-c5028f42-5722-4622-9959-5f9cb0d9b10f tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Deleted volume successfully.
Jul 09 14:54:27 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c5028f42-5722-4622-9959-5f9cb0d9b10f tempest-CreateVolumesFromSourceVolumeTest-198004667 None] Lock "cinder-c532d40d-dabb-4ed6-a47c-368185b6317f-delete_volume" released by "delete_volume" :: held 3.036s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:54:27 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c4520b5d-4ef4-4f5c-8fb3-844034a7f214 tempest-VolumeImageDependencyTests-998889795 None] Acquiring lock "cinder-e4046df0-23c7-44d1-aee7-a698730418b4-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:54:27 devstack sudo[106991]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:27 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c4520b5d-4ef4-4f5c-8fb3-844034a7f214 tempest-VolumeImageDependencyTests-998889795 None] Lock "cinder-e4046df0-23c7-44d1-aee7-a698730418b4-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:54:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-59e51a4b-0421-44fe-a143-ea20ffaf0d85 tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1a948584-ad5a-46ab-b602-be3c72e61272 1073741824" returned: 0 in 0.989s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:27 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c4520b5d-4ef4-4f5c-8fb3-844034a7f214 tempest-VolumeImageDependencyTests-998889795 None] Acquiring lock "cinder-quobyte-e4046df0-23c7-44d1-aee7-a698730418b4" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:54:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-59e51a4b-0421-44fe-a143-ea20ffaf0d85 tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1a948584-ad5a-46ab-b602-be3c72e61272 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:27 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c4520b5d-4ef4-4f5c-8fb3-844034a7f214 tempest-VolumeImageDependencyTests-998889795 None] Lock "cinder-quobyte-e4046df0-23c7-44d1-aee7-a698730418b4" acquired by "delete_volume" :: waited 0.029s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:54:27 devstack sudo[107000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1a948584-ad5a-46ab-b602-be3c72e61272
Jul 09 14:54:27 devstack sudo[107000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:27 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[d80728e7-fbc8-4269-bb20-41a8e386f573]: (4, 'raw') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:54:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c4520b5d-4ef4-4f5c-8fb3-844034a7f214 tempest-VolumeImageDependencyTests-998889795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e4046df0-23c7-44d1-aee7-a698730418b4 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:27 devstack sudo[107002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e4046df0-23c7-44d1-aee7-a698730418b4
Jul 09 14:54:27 devstack sudo[107002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:28 devstack sudo[107000]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-59e51a4b-0421-44fe-a143-ea20ffaf0d85 tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1a948584-ad5a-46ab-b602-be3c72e61272" returned: 0 in 0.827s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:28 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-59e51a4b-0421-44fe-a143-ea20ffaf0d85 tempest-ProjectMemberTests-1092548551 None] <== create_volume: return (1875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:54:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-59e51a4b-0421-44fe-a143-ea20ffaf0d85 tempest-ProjectMemberTests-1092548551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.878s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:54:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-59e51a4b-0421-44fe-a143-ea20ffaf0d85 tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0a79eab-6e2d-4279-8c9f-d4d1cfc4a4b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a948584-ad5a-46ab-b602-be3c72e61272', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:54:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-59e51a4b-0421-44fe-a143-ea20ffaf0d85 tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f658ab3-4a10-44f8-864c-899094de07a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:54:28 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-59e51a4b-0421-44fe-a143-ea20ffaf0d85 tempest-ProjectMemberTests-1092548551 None] Volume volume-1a948584-ad5a-46ab-b602-be3c72e61272 (1a948584-ad5a-46ab-b602-be3c72e61272): created successfully
Jul 09 14:54:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-59e51a4b-0421-44fe-a143-ea20ffaf0d85 tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f658ab3-4a10-44f8-864c-899094de07a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:54:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-59e51a4b-0421-44fe-a143-ea20ffaf0d85 tempest-ProjectMemberTests-1092548551 None] Flow 'volume_create_manager' (0c115777-170a-4487-8eb3-7179a69c6720) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:54:28 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-59e51a4b-0421-44fe-a143-ea20ffaf0d85 tempest-ProjectMemberTests-1092548551 None] Created volume successfully.
Jul 09 14:54:28 devstack sudo[107002]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c4520b5d-4ef4-4f5c-8fb3-844034a7f214 tempest-VolumeImageDependencyTests-998889795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e4046df0-23c7-44d1-aee7-a698730418b4" returned: 0 in 0.871s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c4520b5d-4ef4-4f5c-8fb3-844034a7f214 tempest-VolumeImageDependencyTests-998889795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e4046df0-23c7-44d1-aee7-a698730418b4 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:28 devstack sudo[107007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e4046df0-23c7-44d1-aee7-a698730418b4
Jul 09 14:54:28 devstack sudo[107007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:29 devstack sudo[107007]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c4520b5d-4ef4-4f5c-8fb3-844034a7f214 tempest-VolumeImageDependencyTests-998889795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e4046df0-23c7-44d1-aee7-a698730418b4" returned: 1 in 0.941s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c4520b5d-4ef4-4f5c-8fb3-844034a7f214 tempest-VolumeImageDependencyTests-998889795 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e4046df0-23c7-44d1-aee7-a698730418b4' failed. Not Retrying. {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 09 14:54:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c4520b5d-4ef4-4f5c-8fb3-844034a7f214 tempest-VolumeImageDependencyTests-998889795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e4046df0-23c7-44d1-aee7-a698730418b4 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:29 devstack sudo[107012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e4046df0-23c7-44d1-aee7-a698730418b4
Jul 09 14:54:29 devstack sudo[107012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-fa128e53-4ecc-4fa0-bf55-a0458fae37bc tempest-ProjectMemberTests-1092548551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:54:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-fa128e53-4ecc-4fa0-bf55-a0458fae37bc tempest-ProjectMemberTests-1092548551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:54:29 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-fa128e53-4ecc-4fa0-bf55-a0458fae37bc tempest-ProjectMemberTests-1092548551 None] Creating offline snapshot 087e83cb-168f-4152-b301-4f7b15e6e00c of volume 1a948584-ad5a-46ab-b602-be3c72e61272 {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 14:54:29 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e483a97-1513-4bc7-9733-26a74a65b5b3]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:54:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fa128e53-4ecc-4fa0-bf55-a0458fae37bc tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1a948584-ad5a-46ab-b602-be3c72e61272 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:29 devstack sudo[107014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1a948584-ad5a-46ab-b602-be3c72e61272
Jul 09 14:54:29 devstack sudo[107014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:30 devstack sudo[107012]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c4520b5d-4ef4-4f5c-8fb3-844034a7f214 tempest-VolumeImageDependencyTests-998889795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e4046df0-23c7-44d1-aee7-a698730418b4" returned: 0 in 0.832s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:30 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c4520b5d-4ef4-4f5c-8fb3-844034a7f214 tempest-VolumeImageDependencyTests-998889795 None] Lock "cinder-quobyte-e4046df0-23c7-44d1-aee7-a698730418b4" released by "delete_volume" :: held 2.717s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:54:30 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-c4520b5d-4ef4-4f5c-8fb3-844034a7f214 tempest-VolumeImageDependencyTests-998889795 None] Created reservations ['a0ecf8d4-e811-427a-ad22-376047195a9f', '2fb846cf-05f9-4922-a2dd-7568ae87195e', '39e78060-67f9-4f43-a447-279d5d4fb233', 'e24553c3-4dff-4a95-a4a0-2f581e2df004'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:54:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c4520b5d-4ef4-4f5c-8fb3-844034a7f214 tempest-VolumeImageDependencyTests-998889795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:54:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c4520b5d-4ef4-4f5c-8fb3-844034a7f214 tempest-VolumeImageDependencyTests-998889795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:54:30 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-c4520b5d-4ef4-4f5c-8fb3-844034a7f214 tempest-VolumeImageDependencyTests-998889795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:54:30 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-c4520b5d-4ef4-4f5c-8fb3-844034a7f214 tempest-VolumeImageDependencyTests-998889795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:54:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c4520b5d-4ef4-4f5c-8fb3-844034a7f214 tempest-VolumeImageDependencyTests-998889795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:54:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c4520b5d-4ef4-4f5c-8fb3-844034a7f214 tempest-VolumeImageDependencyTests-998889795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:30 devstack sudo[107017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:54:30 devstack sudo[107017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:30 devstack sudo[107014]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fa128e53-4ecc-4fa0-bf55-a0458fae37bc tempest-ProjectMemberTests-1092548551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1a948584-ad5a-46ab-b602-be3c72e61272" returned: 0 in 0.897s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fa128e53-4ecc-4fa0-bf55-a0458fae37bc tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1a948584-ad5a-46ab-b602-be3c72e61272,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1a948584-ad5a-46ab-b602-be3c72e61272.087e83cb-168f-4152-b301-4f7b15e6e00c 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:30 devstack sudo[107022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1a948584-ad5a-46ab-b602-be3c72e61272,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1a948584-ad5a-46ab-b602-be3c72e61272.087e83cb-168f-4152-b301-4f7b15e6e00c 1G
Jul 09 14:54:30 devstack sudo[107022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:31 devstack sudo[107017]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c4520b5d-4ef4-4f5c-8fb3-844034a7f214 tempest-VolumeImageDependencyTests-998889795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.959s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:31 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-c4520b5d-4ef4-4f5c-8fb3-844034a7f214 tempest-VolumeImageDependencyTests-998889795 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:54:31 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-c4520b5d-4ef4-4f5c-8fb3-844034a7f214 tempest-VolumeImageDependencyTests-998889795 None] Deleted volume successfully.
Jul 09 14:54:31 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c4520b5d-4ef4-4f5c-8fb3-844034a7f214 tempest-VolumeImageDependencyTests-998889795 None] Lock "cinder-e4046df0-23c7-44d1-aee7-a698730418b4-delete_volume" released by "delete_volume" :: held 3.962s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:54:31 devstack sudo[107022]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fa128e53-4ecc-4fa0-bf55-a0458fae37bc tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1a948584-ad5a-46ab-b602-be3c72e61272,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1a948584-ad5a-46ab-b602-be3c72e61272.087e83cb-168f-4152-b301-4f7b15e6e00c 1G" returned: 0 in 0.988s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fa128e53-4ecc-4fa0-bf55-a0458fae37bc tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a948584-ad5a-46ab-b602-be3c72e61272 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1a948584-ad5a-46ab-b602-be3c72e61272.087e83cb-168f-4152-b301-4f7b15e6e00c {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:31 devstack sudo[107030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a948584-ad5a-46ab-b602-be3c72e61272 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1a948584-ad5a-46ab-b602-be3c72e61272.087e83cb-168f-4152-b301-4f7b15e6e00c
Jul 09 14:54:31 devstack sudo[107030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:32 devstack sudo[107030]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fa128e53-4ecc-4fa0-bf55-a0458fae37bc tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a948584-ad5a-46ab-b602-be3c72e61272 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1a948584-ad5a-46ab-b602-be3c72e61272.087e83cb-168f-4152-b301-4f7b15e6e00c" returned: 0 in 0.850s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:32 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-fa128e53-4ecc-4fa0-bf55-a0458fae37bc tempest-ProjectMemberTests-1092548551 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1a948584-ad5a-46ab-b602-be3c72e61272.087e83cb-168f-4152-b301-4f7b15e6e00c is being set with open permissions: ugo+rw
Jul 09 14:54:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fa128e53-4ecc-4fa0-bf55-a0458fae37bc tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1a948584-ad5a-46ab-b602-be3c72e61272.087e83cb-168f-4152-b301-4f7b15e6e00c {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:32 devstack sudo[107036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1a948584-ad5a-46ab-b602-be3c72e61272.087e83cb-168f-4152-b301-4f7b15e6e00c
Jul 09 14:54:32 devstack sudo[107036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:33 devstack sudo[107036]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fa128e53-4ecc-4fa0-bf55-a0458fae37bc tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1a948584-ad5a-46ab-b602-be3c72e61272.087e83cb-168f-4152-b301-4f7b15e6e00c" returned: 0 in 0.685s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fa128e53-4ecc-4fa0-bf55-a0458fae37bc tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1a948584-ad5a-46ab-b602-be3c72e61272.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:33 devstack sudo[107039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1a948584-ad5a-46ab-b602-be3c72e61272.info
Jul 09 14:54:33 devstack sudo[107039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:33 devstack sudo[107039]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fa128e53-4ecc-4fa0-bf55-a0458fae37bc tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1a948584-ad5a-46ab-b602-be3c72e61272.info" returned: 0 in 0.766s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:33 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-fa128e53-4ecc-4fa0-bf55-a0458fae37bc tempest-ProjectMemberTests-1092548551 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1a948584-ad5a-46ab-b602-be3c72e61272.info is being set with open permissions: ugo+rw
Jul 09 14:54:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fa128e53-4ecc-4fa0-bf55-a0458fae37bc tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1a948584-ad5a-46ab-b602-be3c72e61272.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:33 devstack sudo[107042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1a948584-ad5a-46ab-b602-be3c72e61272.info
Jul 09 14:54:33 devstack sudo[107042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:34 devstack sudo[107042]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fa128e53-4ecc-4fa0-bf55-a0458fae37bc tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1a948584-ad5a-46ab-b602-be3c72e61272.info" returned: 0 in 0.794s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-fa128e53-4ecc-4fa0-bf55-a0458fae37bc tempest-ProjectMemberTests-1092548551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.104s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:54:34 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-fa128e53-4ecc-4fa0-bf55-a0458fae37bc tempest-ProjectMemberTests-1092548551 None] Create snapshot completed successfully
Jul 09 14:54:34 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f9637201-d31c-4f9f-bbc9-a3a6201c1834 tempest-ProjectMemberTests-1092548551 None] Acquiring lock "cinder-087e83cb-168f-4152-b301-4f7b15e6e00c-delete_snapshot" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:54:34 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f9637201-d31c-4f9f-bbc9-a3a6201c1834 tempest-ProjectMemberTests-1092548551 None] Lock "cinder-087e83cb-168f-4152-b301-4f7b15e6e00c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:54:34 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f9637201-d31c-4f9f-bbc9-a3a6201c1834 tempest-ProjectMemberTests-1092548551 None] Acquiring lock "cinder-quobyte-1a948584-ad5a-46ab-b602-be3c72e61272" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:54:34 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f9637201-d31c-4f9f-bbc9-a3a6201c1834 tempest-ProjectMemberTests-1092548551 None] Lock "cinder-quobyte-1a948584-ad5a-46ab-b602-be3c72e61272" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:54:34 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f9637201-d31c-4f9f-bbc9-a3a6201c1834 tempest-ProjectMemberTests-1092548551 None] Acquiring lock "cinder-quobyte-087e83cb-168f-4152-b301-4f7b15e6e00c" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:54:35 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f9637201-d31c-4f9f-bbc9-a3a6201c1834 tempest-ProjectMemberTests-1092548551 None] Lock "cinder-quobyte-087e83cb-168f-4152-b301-4f7b15e6e00c" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:54:35 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-f9637201-d31c-4f9f-bbc9-a3a6201c1834 tempest-ProjectMemberTests-1092548551 None] Deleting offline snapshot 087e83cb-168f-4152-b301-4f7b15e6e00c of volume 1a948584-ad5a-46ab-b602-be3c72e61272 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 14:54:35 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-f9637201-d31c-4f9f-bbc9-a3a6201c1834 tempest-ProjectMemberTests-1092548551 None] snapshot_file for this snap is: volume-1a948584-ad5a-46ab-b602-be3c72e61272.087e83cb-168f-4152-b301-4f7b15e6e00c {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 14:54:35 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[6744f69c-c440-4d5e-8b82-1e53e9439ba0]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:54:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f9637201-d31c-4f9f-bbc9-a3a6201c1834 tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1a948584-ad5a-46ab-b602-be3c72e61272.087e83cb-168f-4152-b301-4f7b15e6e00c {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:35 devstack sudo[107045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1a948584-ad5a-46ab-b602-be3c72e61272.087e83cb-168f-4152-b301-4f7b15e6e00c
Jul 09 14:54:35 devstack sudo[107045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:35 devstack sudo[107045]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f9637201-d31c-4f9f-bbc9-a3a6201c1834 tempest-ProjectMemberTests-1092548551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1a948584-ad5a-46ab-b602-be3c72e61272.087e83cb-168f-4152-b301-4f7b15e6e00c" returned: 0 in 0.880s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:35 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-f9637201-d31c-4f9f-bbc9-a3a6201c1834 tempest-ProjectMemberTests-1092548551 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a948584-ad5a-46ab-b602-be3c72e61272(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 14:54:36 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae50d232-621c-46cd-96c8-c4f6320b0d04]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:54:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f9637201-d31c-4f9f-bbc9-a3a6201c1834 tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1a948584-ad5a-46ab-b602-be3c72e61272 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:36 devstack sudo[107051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1a948584-ad5a-46ab-b602-be3c72e61272
Jul 09 14:54:36 devstack sudo[107051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:36 devstack sudo[107051]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f9637201-d31c-4f9f-bbc9-a3a6201c1834 tempest-ProjectMemberTests-1092548551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1a948584-ad5a-46ab-b602-be3c72e61272" returned: 0 in 0.941s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f9637201-d31c-4f9f-bbc9-a3a6201c1834 tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1a948584-ad5a-46ab-b602-be3c72e61272.087e83cb-168f-4152-b301-4f7b15e6e00c {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:37 devstack sudo[107056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1a948584-ad5a-46ab-b602-be3c72e61272.087e83cb-168f-4152-b301-4f7b15e6e00c
Jul 09 14:54:37 devstack sudo[107056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:37 devstack sudo[107056]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f9637201-d31c-4f9f-bbc9-a3a6201c1834 tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1a948584-ad5a-46ab-b602-be3c72e61272.087e83cb-168f-4152-b301-4f7b15e6e00c" returned: 0 in 0.901s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f9637201-d31c-4f9f-bbc9-a3a6201c1834 tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1a948584-ad5a-46ab-b602-be3c72e61272.087e83cb-168f-4152-b301-4f7b15e6e00c {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:37 devstack sudo[107062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1a948584-ad5a-46ab-b602-be3c72e61272.087e83cb-168f-4152-b301-4f7b15e6e00c
Jul 09 14:54:37 devstack sudo[107062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:37 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ec88195-6808-45e9-9e6a-d356fdda93cc tempest-ProjectReaderTests-934378749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:54:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5ec88195-6808-45e9-9e6a-d356fdda93cc tempest-ProjectReaderTests-934378749 None] Flow 'volume_create_manager' (5e6776a8-b0f4-4dbe-8dd2-29b6acfaac94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:54:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5ec88195-6808-45e9-9e6a-d356fdda93cc tempest-ProjectReaderTests-934378749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (685be60d-12e9-4adf-954f-1a87fadcaf37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:54:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5ec88195-6808-45e9-9e6a-d356fdda93cc tempest-ProjectReaderTests-934378749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (685be60d-12e9-4adf-954f-1a87fadcaf37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:54:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-163003943',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae2ad5fe-e1c2-4ea4-b81d-1eadedd51054,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20599830728f47858cc21c11b6e6bbac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:54:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:54:38Z,use_quota=True,user_id='a49bf6be1b4b4e2d810713bc1d8374d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:54:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5ec88195-6808-45e9-9e6a-d356fdda93cc tempest-ProjectReaderTests-934378749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15c187b4-d92c-4bc6-8839-2adc78d651a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:54:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5ec88195-6808-45e9-9e6a-d356fdda93cc tempest-ProjectReaderTests-934378749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15c187b4-d92c-4bc6-8839-2adc78d651a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:54:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5ec88195-6808-45e9-9e6a-d356fdda93cc tempest-ProjectReaderTests-934378749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44fdee95-3890-477c-87d5-b380b7e9b692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:54:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5ec88195-6808-45e9-9e6a-d356fdda93cc tempest-ProjectReaderTests-934378749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44fdee95-3890-477c-87d5-b380b7e9b692) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae2ad5fe-e1c2-4ea4-b81d-1eadedd51054', 'volume_name': 'volume-ae2ad5fe-e1c2-4ea4-b81d-1eadedd51054', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:54:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5ec88195-6808-45e9-9e6a-d356fdda93cc tempest-ProjectReaderTests-934378749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe70768e-ce79-44a9-85d5-120b083308b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:54:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5ec88195-6808-45e9-9e6a-d356fdda93cc tempest-ProjectReaderTests-934378749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe70768e-ce79-44a9-85d5-120b083308b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:54:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5ec88195-6808-45e9-9e6a-d356fdda93cc tempest-ProjectReaderTests-934378749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b681abd5-0baf-4014-ae46-cc84e4ca0554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:54:38 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-5ec88195-6808-45e9-9e6a-d356fdda93cc tempest-ProjectReaderTests-934378749 None] Volume ae2ad5fe-e1c2-4ea4-b81d-1eadedd51054: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae2ad5fe-e1c2-4ea4-b81d-1eadedd51054', 'volume_size': 1}
Jul 09 14:54:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5ec88195-6808-45e9-9e6a-d356fdda93cc tempest-ProjectReaderTests-934378749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:54:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5ec88195-6808-45e9-9e6a-d356fdda93cc tempest-ProjectReaderTests-934378749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:54:38 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-5ec88195-6808-45e9-9e6a-d356fdda93cc tempest-ProjectReaderTests-934378749 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:54:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-163003943',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae2ad5fe-e1c2-4ea4-b81d-1eadedd51054,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20599830728f47858cc21c11b6e6bbac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:54:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:54:38Z,use_quota=True,user_id='a49bf6be1b4b4e2d810713bc1d8374d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:54:38 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-5ec88195-6808-45e9-9e6a-d356fdda93cc tempest-ProjectReaderTests-934378749 None] Creating volume ae2ad5fe-e1c2-4ea4-b81d-1eadedd51054 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:54:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5ec88195-6808-45e9-9e6a-d356fdda93cc tempest-ProjectReaderTests-934378749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:54:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5ec88195-6808-45e9-9e6a-d356fdda93cc tempest-ProjectReaderTests-934378749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:54:38 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-5ec88195-6808-45e9-9e6a-d356fdda93cc tempest-ProjectReaderTests-934378749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:54:38 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-5ec88195-6808-45e9-9e6a-d356fdda93cc tempest-ProjectReaderTests-934378749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:54:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5ec88195-6808-45e9-9e6a-d356fdda93cc tempest-ProjectReaderTests-934378749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:54:38 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-5ec88195-6808-45e9-9e6a-d356fdda93cc tempest-ProjectReaderTests-934378749 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:54:38 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-5ec88195-6808-45e9-9e6a-d356fdda93cc tempest-ProjectReaderTests-934378749 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:54:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5ec88195-6808-45e9-9e6a-d356fdda93cc tempest-ProjectReaderTests-934378749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ae2ad5fe-e1c2-4ea4-b81d-1eadedd51054 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:38 devstack sudo[107064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ae2ad5fe-e1c2-4ea4-b81d-1eadedd51054 1073741824
Jul 09 14:54:38 devstack sudo[107064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:38 devstack sudo[107062]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f9637201-d31c-4f9f-bbc9-a3a6201c1834 tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1a948584-ad5a-46ab-b602-be3c72e61272.087e83cb-168f-4152-b301-4f7b15e6e00c" returned: 0 in 0.704s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:38 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f9637201-d31c-4f9f-bbc9-a3a6201c1834 tempest-ProjectMemberTests-1092548551 None] Lock "cinder-quobyte-087e83cb-168f-4152-b301-4f7b15e6e00c" released by "_delete_snapshot" :: held 3.604s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:54:38 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f9637201-d31c-4f9f-bbc9-a3a6201c1834 tempest-ProjectMemberTests-1092548551 None] Lock "cinder-quobyte-1a948584-ad5a-46ab-b602-be3c72e61272" released by "delete_snapshot" :: held 3.639s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:54:38 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-f9637201-d31c-4f9f-bbc9-a3a6201c1834 tempest-ProjectMemberTests-1092548551 None] Created reservations ['29dc3c4d-13ce-4d06-af81-0de814083770', '7ee5eb9b-15a9-472c-9593-fdfd24e1e7e1', 'beb44333-0ccd-411a-987e-2ab351f8f2b4', '780fc48a-606f-4cc7-a694-01e51eb7e987'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:54:38 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-f9637201-d31c-4f9f-bbc9-a3a6201c1834 tempest-ProjectMemberTests-1092548551 None] Delete snapshot completed successfully.
Jul 09 14:54:38 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f9637201-d31c-4f9f-bbc9-a3a6201c1834 tempest-ProjectMemberTests-1092548551 None] Lock "cinder-087e83cb-168f-4152-b301-4f7b15e6e00c-delete_snapshot" released by "delete_snapshot" :: held 3.884s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:54:39 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-07ada270-ae8a-4444-bdee-0d030f78ee0f tempest-ProjectMemberTests-1092548551 None] Acquiring lock "cinder-1a948584-ad5a-46ab-b602-be3c72e61272-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:54:39 devstack sudo[107064]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:39 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-07ada270-ae8a-4444-bdee-0d030f78ee0f tempest-ProjectMemberTests-1092548551 None] Lock "cinder-1a948584-ad5a-46ab-b602-be3c72e61272-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:54:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5ec88195-6808-45e9-9e6a-d356fdda93cc tempest-ProjectReaderTests-934378749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ae2ad5fe-e1c2-4ea4-b81d-1eadedd51054 1073741824" returned: 0 in 1.167s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:39 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-07ada270-ae8a-4444-bdee-0d030f78ee0f tempest-ProjectMemberTests-1092548551 None] Acquiring lock "cinder-quobyte-1a948584-ad5a-46ab-b602-be3c72e61272" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:54:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5ec88195-6808-45e9-9e6a-d356fdda93cc tempest-ProjectReaderTests-934378749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ae2ad5fe-e1c2-4ea4-b81d-1eadedd51054 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:39 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-07ada270-ae8a-4444-bdee-0d030f78ee0f tempest-ProjectMemberTests-1092548551 None] Lock "cinder-quobyte-1a948584-ad5a-46ab-b602-be3c72e61272" acquired by "delete_volume" :: waited 0.029s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:54:39 devstack sudo[107072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ae2ad5fe-e1c2-4ea4-b81d-1eadedd51054
Jul 09 14:54:39 devstack sudo[107072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:39 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e36987d-5536-4819-92d0-6b946a28971e]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:54:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-07ada270-ae8a-4444-bdee-0d030f78ee0f tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1a948584-ad5a-46ab-b602-be3c72e61272 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:39 devstack sudo[107074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1a948584-ad5a-46ab-b602-be3c72e61272
Jul 09 14:54:39 devstack sudo[107074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:39 devstack sudo[107072]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5ec88195-6808-45e9-9e6a-d356fdda93cc tempest-ProjectReaderTests-934378749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ae2ad5fe-e1c2-4ea4-b81d-1eadedd51054" returned: 0 in 0.646s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:39 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-5ec88195-6808-45e9-9e6a-d356fdda93cc tempest-ProjectReaderTests-934378749 None] <== create_volume: return (1872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:54:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5ec88195-6808-45e9-9e6a-d356fdda93cc tempest-ProjectReaderTests-934378749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.875s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:54:39 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5ec88195-6808-45e9-9e6a-d356fdda93cc tempest-ProjectReaderTests-934378749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b681abd5-0baf-4014-ae46-cc84e4ca0554) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae2ad5fe-e1c2-4ea4-b81d-1eadedd51054', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:54:39 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5ec88195-6808-45e9-9e6a-d356fdda93cc tempest-ProjectReaderTests-934378749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4d02de2-1b0b-45cf-9c01-90214ccf4ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:54:40 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-5ec88195-6808-45e9-9e6a-d356fdda93cc tempest-ProjectReaderTests-934378749 None] Volume volume-ae2ad5fe-e1c2-4ea4-b81d-1eadedd51054 (ae2ad5fe-e1c2-4ea4-b81d-1eadedd51054): created successfully
Jul 09 14:54:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5ec88195-6808-45e9-9e6a-d356fdda93cc tempest-ProjectReaderTests-934378749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4d02de2-1b0b-45cf-9c01-90214ccf4ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:54:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5ec88195-6808-45e9-9e6a-d356fdda93cc tempest-ProjectReaderTests-934378749 None] Flow 'volume_create_manager' (5e6776a8-b0f4-4dbe-8dd2-29b6acfaac94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:54:40 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-5ec88195-6808-45e9-9e6a-d356fdda93cc tempest-ProjectReaderTests-934378749 None] Created volume successfully.
Jul 09 14:54:40 devstack sudo[107074]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-07ada270-ae8a-4444-bdee-0d030f78ee0f tempest-ProjectMemberTests-1092548551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1a948584-ad5a-46ab-b602-be3c72e61272" returned: 0 in 0.780s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-07ada270-ae8a-4444-bdee-0d030f78ee0f tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1a948584-ad5a-46ab-b602-be3c72e61272 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:40 devstack sudo[107081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1a948584-ad5a-46ab-b602-be3c72e61272
Jul 09 14:54:40 devstack sudo[107081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-51df6fae-9e46-402c-9871-37891cf6acdf tempest-ProjectReaderTests-934378749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:54:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-51df6fae-9e46-402c-9871-37891cf6acdf tempest-ProjectReaderTests-934378749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:54:40 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-51df6fae-9e46-402c-9871-37891cf6acdf tempest-ProjectReaderTests-934378749 None] Creating offline snapshot 23739ea1-803e-4817-9d91-2228c2f469c2 of volume ae2ad5fe-e1c2-4ea4-b81d-1eadedd51054 {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 14:54:40 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b586424-fb89-45ff-8882-29971fb084ab]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:54:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-51df6fae-9e46-402c-9871-37891cf6acdf tempest-ProjectReaderTests-934378749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ae2ad5fe-e1c2-4ea4-b81d-1eadedd51054 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:40 devstack sudo[107083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ae2ad5fe-e1c2-4ea4-b81d-1eadedd51054
Jul 09 14:54:40 devstack sudo[107083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:40 devstack sudo[107081]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-07ada270-ae8a-4444-bdee-0d030f78ee0f tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1a948584-ad5a-46ab-b602-be3c72e61272" returned: 0 in 0.801s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:41 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-07ada270-ae8a-4444-bdee-0d030f78ee0f tempest-ProjectMemberTests-1092548551 None] Lock "cinder-quobyte-1a948584-ad5a-46ab-b602-be3c72e61272" released by "delete_volume" :: held 1.666s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:54:41 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-07ada270-ae8a-4444-bdee-0d030f78ee0f tempest-ProjectMemberTests-1092548551 None] Created reservations ['0c10d108-3063-4c97-bc38-1aab59cd4904', 'a77868b9-eb89-4889-a5d6-59ed4c4a15bb', '50634b45-25a7-4727-95fd-ec673009e32f', '31afccfc-19c5-4282-9b28-5e218f8819c5'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:54:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-07ada270-ae8a-4444-bdee-0d030f78ee0f tempest-ProjectMemberTests-1092548551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:54:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-07ada270-ae8a-4444-bdee-0d030f78ee0f tempest-ProjectMemberTests-1092548551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:54:41 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-07ada270-ae8a-4444-bdee-0d030f78ee0f tempest-ProjectMemberTests-1092548551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:54:41 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-07ada270-ae8a-4444-bdee-0d030f78ee0f tempest-ProjectMemberTests-1092548551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:54:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-07ada270-ae8a-4444-bdee-0d030f78ee0f tempest-ProjectMemberTests-1092548551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:54:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-07ada270-ae8a-4444-bdee-0d030f78ee0f tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:41 devstack sudo[107087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:54:41 devstack sudo[107087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:41 devstack sudo[107083]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-51df6fae-9e46-402c-9871-37891cf6acdf tempest-ProjectReaderTests-934378749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ae2ad5fe-e1c2-4ea4-b81d-1eadedd51054" returned: 0 in 1.021s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-51df6fae-9e46-402c-9871-37891cf6acdf tempest-ProjectReaderTests-934378749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ae2ad5fe-e1c2-4ea4-b81d-1eadedd51054,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ae2ad5fe-e1c2-4ea4-b81d-1eadedd51054.23739ea1-803e-4817-9d91-2228c2f469c2 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:41 devstack sudo[107092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ae2ad5fe-e1c2-4ea4-b81d-1eadedd51054,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ae2ad5fe-e1c2-4ea4-b81d-1eadedd51054.23739ea1-803e-4817-9d91-2228c2f469c2 1G
Jul 09 14:54:41 devstack sudo[107092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:42 devstack sudo[107087]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-07ada270-ae8a-4444-bdee-0d030f78ee0f tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.903s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:42 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-07ada270-ae8a-4444-bdee-0d030f78ee0f tempest-ProjectMemberTests-1092548551 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:54:42 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-07ada270-ae8a-4444-bdee-0d030f78ee0f tempest-ProjectMemberTests-1092548551 None] Deleted volume successfully.
Jul 09 14:54:42 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-07ada270-ae8a-4444-bdee-0d030f78ee0f tempest-ProjectMemberTests-1092548551 None] Lock "cinder-1a948584-ad5a-46ab-b602-be3c72e61272-delete_volume" released by "delete_volume" :: held 2.879s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:54:42 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-22d4090b-f2e8-4a9b-b970-2f1ff9556c21 tempest-ProjectMemberTests-1092548551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:54:42 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-22d4090b-f2e8-4a9b-b970-2f1ff9556c21 tempest-ProjectMemberTests-1092548551 None] Flow 'volume_create_manager' (7935adbb-a14d-4fad-a156-5491ac731f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:54:42 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-22d4090b-f2e8-4a9b-b970-2f1ff9556c21 tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b8da9b1-8b24-4478-9789-ee41d4e3cccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:54:42 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-22d4090b-f2e8-4a9b-b970-2f1ff9556c21 tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b8da9b1-8b24-4478-9789-ee41d4e3cccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:54:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1572815547',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b67343c-680c-41de-b398-674ef51cf4e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53e3a7b509634eeda7e218e1577efd89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:54:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:54:42Z,use_quota=True,user_id='6f31a0c3fe3e49ccabfa9bdf47df92af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:54:42 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-22d4090b-f2e8-4a9b-b970-2f1ff9556c21 tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f92c658-2d5c-4b91-a18a-508c5d972844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:54:42 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-22d4090b-f2e8-4a9b-b970-2f1ff9556c21 tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f92c658-2d5c-4b91-a18a-508c5d972844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:54:42 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-22d4090b-f2e8-4a9b-b970-2f1ff9556c21 tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec4635e8-1454-4f7c-95d6-8cba782b5dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:54:42 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-22d4090b-f2e8-4a9b-b970-2f1ff9556c21 tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec4635e8-1454-4f7c-95d6-8cba782b5dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b67343c-680c-41de-b398-674ef51cf4e5', 'volume_name': 'volume-8b67343c-680c-41de-b398-674ef51cf4e5', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:54:42 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-22d4090b-f2e8-4a9b-b970-2f1ff9556c21 tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8469ac6-8624-4c81-a04e-1bce5fdc45e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:54:42 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-22d4090b-f2e8-4a9b-b970-2f1ff9556c21 tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8469ac6-8624-4c81-a04e-1bce5fdc45e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:54:42 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-22d4090b-f2e8-4a9b-b970-2f1ff9556c21 tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cada07fd-b45f-46ce-b8f6-bf65de514443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:54:42 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-22d4090b-f2e8-4a9b-b970-2f1ff9556c21 tempest-ProjectMemberTests-1092548551 None] Volume 8b67343c-680c-41de-b398-674ef51cf4e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b67343c-680c-41de-b398-674ef51cf4e5', 'volume_size': 1}
Jul 09 14:54:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-22d4090b-f2e8-4a9b-b970-2f1ff9556c21 tempest-ProjectMemberTests-1092548551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:54:42 devstack sudo[107092]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-51df6fae-9e46-402c-9871-37891cf6acdf tempest-ProjectReaderTests-934378749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ae2ad5fe-e1c2-4ea4-b81d-1eadedd51054,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ae2ad5fe-e1c2-4ea4-b81d-1eadedd51054.23739ea1-803e-4817-9d91-2228c2f469c2 1G" returned: 0 in 0.981s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-51df6fae-9e46-402c-9871-37891cf6acdf tempest-ProjectReaderTests-934378749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae2ad5fe-e1c2-4ea4-b81d-1eadedd51054 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ae2ad5fe-e1c2-4ea4-b81d-1eadedd51054.23739ea1-803e-4817-9d91-2228c2f469c2 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:42 devstack sudo[107099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae2ad5fe-e1c2-4ea4-b81d-1eadedd51054 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ae2ad5fe-e1c2-4ea4-b81d-1eadedd51054.23739ea1-803e-4817-9d91-2228c2f469c2
Jul 09 14:54:42 devstack sudo[107099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:43 devstack sudo[107099]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-51df6fae-9e46-402c-9871-37891cf6acdf tempest-ProjectReaderTests-934378749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae2ad5fe-e1c2-4ea4-b81d-1eadedd51054 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ae2ad5fe-e1c2-4ea4-b81d-1eadedd51054.23739ea1-803e-4817-9d91-2228c2f469c2" returned: 0 in 0.821s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:43 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-51df6fae-9e46-402c-9871-37891cf6acdf tempest-ProjectReaderTests-934378749 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ae2ad5fe-e1c2-4ea4-b81d-1eadedd51054.23739ea1-803e-4817-9d91-2228c2f469c2 is being set with open permissions: ugo+rw
Jul 09 14:54:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-51df6fae-9e46-402c-9871-37891cf6acdf tempest-ProjectReaderTests-934378749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ae2ad5fe-e1c2-4ea4-b81d-1eadedd51054.23739ea1-803e-4817-9d91-2228c2f469c2 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:43 devstack sudo[107105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ae2ad5fe-e1c2-4ea4-b81d-1eadedd51054.23739ea1-803e-4817-9d91-2228c2f469c2
Jul 09 14:54:43 devstack sudo[107105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:44 devstack sudo[107105]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-51df6fae-9e46-402c-9871-37891cf6acdf tempest-ProjectReaderTests-934378749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ae2ad5fe-e1c2-4ea4-b81d-1eadedd51054.23739ea1-803e-4817-9d91-2228c2f469c2" returned: 0 in 0.685s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-51df6fae-9e46-402c-9871-37891cf6acdf tempest-ProjectReaderTests-934378749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ae2ad5fe-e1c2-4ea4-b81d-1eadedd51054.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:44 devstack sudo[107108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ae2ad5fe-e1c2-4ea4-b81d-1eadedd51054.info
Jul 09 14:54:44 devstack sudo[107108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:44 devstack sudo[107108]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-51df6fae-9e46-402c-9871-37891cf6acdf tempest-ProjectReaderTests-934378749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ae2ad5fe-e1c2-4ea4-b81d-1eadedd51054.info" returned: 0 in 0.699s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:44 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-51df6fae-9e46-402c-9871-37891cf6acdf tempest-ProjectReaderTests-934378749 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ae2ad5fe-e1c2-4ea4-b81d-1eadedd51054.info is being set with open permissions: ugo+rw
Jul 09 14:54:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-51df6fae-9e46-402c-9871-37891cf6acdf tempest-ProjectReaderTests-934378749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ae2ad5fe-e1c2-4ea4-b81d-1eadedd51054.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:44 devstack sudo[107111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ae2ad5fe-e1c2-4ea4-b81d-1eadedd51054.info
Jul 09 14:54:44 devstack sudo[107111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:45 devstack sudo[107111]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-51df6fae-9e46-402c-9871-37891cf6acdf tempest-ProjectReaderTests-934378749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ae2ad5fe-e1c2-4ea4-b81d-1eadedd51054.info" returned: 0 in 0.696s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-51df6fae-9e46-402c-9871-37891cf6acdf tempest-ProjectReaderTests-934378749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.030s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:54:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-22d4090b-f2e8-4a9b-b970-2f1ff9556c21 tempest-ProjectMemberTests-1092548551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.203s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:54:45 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-22d4090b-f2e8-4a9b-b970-2f1ff9556c21 tempest-ProjectMemberTests-1092548551 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:54:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1572815547',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b67343c-680c-41de-b398-674ef51cf4e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53e3a7b509634eeda7e218e1577efd89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:54:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:54:42Z,use_quota=True,user_id='6f31a0c3fe3e49ccabfa9bdf47df92af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:54:45 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-22d4090b-f2e8-4a9b-b970-2f1ff9556c21 tempest-ProjectMemberTests-1092548551 None] Creating volume 8b67343c-680c-41de-b398-674ef51cf4e5 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:54:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-22d4090b-f2e8-4a9b-b970-2f1ff9556c21 tempest-ProjectMemberTests-1092548551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:54:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-22d4090b-f2e8-4a9b-b970-2f1ff9556c21 tempest-ProjectMemberTests-1092548551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:54:45 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-22d4090b-f2e8-4a9b-b970-2f1ff9556c21 tempest-ProjectMemberTests-1092548551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:54:45 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-22d4090b-f2e8-4a9b-b970-2f1ff9556c21 tempest-ProjectMemberTests-1092548551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:54:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-22d4090b-f2e8-4a9b-b970-2f1ff9556c21 tempest-ProjectMemberTests-1092548551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:54:45 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-22d4090b-f2e8-4a9b-b970-2f1ff9556c21 tempest-ProjectMemberTests-1092548551 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:54:45 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-22d4090b-f2e8-4a9b-b970-2f1ff9556c21 tempest-ProjectMemberTests-1092548551 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:54:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-22d4090b-f2e8-4a9b-b970-2f1ff9556c21 tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8b67343c-680c-41de-b398-674ef51cf4e5 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:45 devstack sudo[107114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8b67343c-680c-41de-b398-674ef51cf4e5 1073741824
Jul 09 14:54:45 devstack sudo[107114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:45 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-51df6fae-9e46-402c-9871-37891cf6acdf tempest-ProjectReaderTests-934378749 None] Create snapshot completed successfully
Jul 09 14:54:46 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d47a0986-b2ba-4654-805b-c396d40c34a8 tempest-ProjectReaderTests-934378749 None] Acquiring lock "cinder-23739ea1-803e-4817-9d91-2228c2f469c2-delete_snapshot" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:54:46 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d47a0986-b2ba-4654-805b-c396d40c34a8 tempest-ProjectReaderTests-934378749 None] Lock "cinder-23739ea1-803e-4817-9d91-2228c2f469c2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:54:46 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d47a0986-b2ba-4654-805b-c396d40c34a8 tempest-ProjectReaderTests-934378749 None] Acquiring lock "cinder-quobyte-ae2ad5fe-e1c2-4ea4-b81d-1eadedd51054" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:54:46 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d47a0986-b2ba-4654-805b-c396d40c34a8 tempest-ProjectReaderTests-934378749 None] Lock "cinder-quobyte-ae2ad5fe-e1c2-4ea4-b81d-1eadedd51054" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:54:46 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d47a0986-b2ba-4654-805b-c396d40c34a8 tempest-ProjectReaderTests-934378749 None] Acquiring lock "cinder-quobyte-23739ea1-803e-4817-9d91-2228c2f469c2" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:54:46 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d47a0986-b2ba-4654-805b-c396d40c34a8 tempest-ProjectReaderTests-934378749 None] Lock "cinder-quobyte-23739ea1-803e-4817-9d91-2228c2f469c2" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:54:46 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-d47a0986-b2ba-4654-805b-c396d40c34a8 tempest-ProjectReaderTests-934378749 None] Deleting offline snapshot 23739ea1-803e-4817-9d91-2228c2f469c2 of volume ae2ad5fe-e1c2-4ea4-b81d-1eadedd51054 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 14:54:46 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-d47a0986-b2ba-4654-805b-c396d40c34a8 tempest-ProjectReaderTests-934378749 None] snapshot_file for this snap is: volume-ae2ad5fe-e1c2-4ea4-b81d-1eadedd51054.23739ea1-803e-4817-9d91-2228c2f469c2 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 14:54:46 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed49fbd6-83b3-4769-8b07-66d1527547dc]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:54:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d47a0986-b2ba-4654-805b-c396d40c34a8 tempest-ProjectReaderTests-934378749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ae2ad5fe-e1c2-4ea4-b81d-1eadedd51054.23739ea1-803e-4817-9d91-2228c2f469c2 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:46 devstack sudo[107118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ae2ad5fe-e1c2-4ea4-b81d-1eadedd51054.23739ea1-803e-4817-9d91-2228c2f469c2
Jul 09 14:54:46 devstack sudo[107118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:46 devstack sudo[107114]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-22d4090b-f2e8-4a9b-b970-2f1ff9556c21 tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8b67343c-680c-41de-b398-674ef51cf4e5 1073741824" returned: 0 in 1.070s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-22d4090b-f2e8-4a9b-b970-2f1ff9556c21 tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8b67343c-680c-41de-b398-674ef51cf4e5 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:46 devstack sudo[107122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8b67343c-680c-41de-b398-674ef51cf4e5
Jul 09 14:54:46 devstack sudo[107122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:47 devstack sudo[107118]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d47a0986-b2ba-4654-805b-c396d40c34a8 tempest-ProjectReaderTests-934378749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ae2ad5fe-e1c2-4ea4-b81d-1eadedd51054.23739ea1-803e-4817-9d91-2228c2f469c2" returned: 0 in 0.907s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:47 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-d47a0986-b2ba-4654-805b-c396d40c34a8 tempest-ProjectReaderTests-934378749 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae2ad5fe-e1c2-4ea4-b81d-1eadedd51054(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 14:54:47 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[815f564f-d13c-4903-9c35-b29646e13e0b]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:54:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d47a0986-b2ba-4654-805b-c396d40c34a8 tempest-ProjectReaderTests-934378749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ae2ad5fe-e1c2-4ea4-b81d-1eadedd51054 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:47 devstack sudo[107128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ae2ad5fe-e1c2-4ea4-b81d-1eadedd51054
Jul 09 14:54:47 devstack sudo[107128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:47 devstack sudo[107122]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-22d4090b-f2e8-4a9b-b970-2f1ff9556c21 tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8b67343c-680c-41de-b398-674ef51cf4e5" returned: 0 in 0.907s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:47 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-22d4090b-f2e8-4a9b-b970-2f1ff9556c21 tempest-ProjectMemberTests-1092548551 None] <== create_volume: return (2030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:54:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-22d4090b-f2e8-4a9b-b970-2f1ff9556c21 tempest-ProjectMemberTests-1092548551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.033s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:54:47 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-22d4090b-f2e8-4a9b-b970-2f1ff9556c21 tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cada07fd-b45f-46ce-b8f6-bf65de514443) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b67343c-680c-41de-b398-674ef51cf4e5', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:54:47 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-22d4090b-f2e8-4a9b-b970-2f1ff9556c21 tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fa353f1-cd3b-4d41-b01a-47fd19419e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:54:47 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-22d4090b-f2e8-4a9b-b970-2f1ff9556c21 tempest-ProjectMemberTests-1092548551 None] Volume volume-8b67343c-680c-41de-b398-674ef51cf4e5 (8b67343c-680c-41de-b398-674ef51cf4e5): created successfully
Jul 09 14:54:47 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-22d4090b-f2e8-4a9b-b970-2f1ff9556c21 tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fa353f1-cd3b-4d41-b01a-47fd19419e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:54:47 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-22d4090b-f2e8-4a9b-b970-2f1ff9556c21 tempest-ProjectMemberTests-1092548551 None] Flow 'volume_create_manager' (7935adbb-a14d-4fad-a156-5491ac731f00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:54:47 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfb09fdd-0068-46bb-9a0e-6747772c4dd9 tempest-ProjectReaderTests-1890400111 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:54:47 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-cfb09fdd-0068-46bb-9a0e-6747772c4dd9 tempest-ProjectReaderTests-1890400111 None] Flow 'volume_create_manager' (fdb7f570-a8c6-4657-b210-44db45c8a6da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:54:47 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-cfb09fdd-0068-46bb-9a0e-6747772c4dd9 tempest-ProjectReaderTests-1890400111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d4115ea-e2f2-4fb0-abe2-b4bb4d703f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:54:47 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-22d4090b-f2e8-4a9b-b970-2f1ff9556c21 tempest-ProjectMemberTests-1092548551 None] Created volume successfully.
Jul 09 14:54:47 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-cfb09fdd-0068-46bb-9a0e-6747772c4dd9 tempest-ProjectReaderTests-1890400111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d4115ea-e2f2-4fb0-abe2-b4bb4d703f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:54:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1213813698',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b10bfd33-280d-4af9-9a29-ac94fbdc2efe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65c00229f3174f06821db0c8ac3485ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:54:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:54:48Z,use_quota=True,user_id='77387546a5754247a0d40a795e9c12d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:54:47 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-cfb09fdd-0068-46bb-9a0e-6747772c4dd9 tempest-ProjectReaderTests-1890400111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e733b840-bdde-478b-bcc2-99be537e4d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:54:47 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-cfb09fdd-0068-46bb-9a0e-6747772c4dd9 tempest-ProjectReaderTests-1890400111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e733b840-bdde-478b-bcc2-99be537e4d42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:54:47 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-cfb09fdd-0068-46bb-9a0e-6747772c4dd9 tempest-ProjectReaderTests-1890400111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9680e6e-0407-42f8-b783-a0587546e969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:54:47 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-cfb09fdd-0068-46bb-9a0e-6747772c4dd9 tempest-ProjectReaderTests-1890400111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9680e6e-0407-42f8-b783-a0587546e969) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b10bfd33-280d-4af9-9a29-ac94fbdc2efe', 'volume_name': 'volume-b10bfd33-280d-4af9-9a29-ac94fbdc2efe', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:54:47 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-cfb09fdd-0068-46bb-9a0e-6747772c4dd9 tempest-ProjectReaderTests-1890400111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (200eb7fd-360c-436a-a105-3cf57e27cafc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:54:47 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-cfb09fdd-0068-46bb-9a0e-6747772c4dd9 tempest-ProjectReaderTests-1890400111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (200eb7fd-360c-436a-a105-3cf57e27cafc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:54:47 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-cfb09fdd-0068-46bb-9a0e-6747772c4dd9 tempest-ProjectReaderTests-1890400111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5db87445-f089-43ea-81b7-348232e24a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:54:47 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-cfb09fdd-0068-46bb-9a0e-6747772c4dd9 tempest-ProjectReaderTests-1890400111 None] Volume b10bfd33-280d-4af9-9a29-ac94fbdc2efe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b10bfd33-280d-4af9-9a29-ac94fbdc2efe', 'volume_size': 1}
Jul 09 14:54:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-cfb09fdd-0068-46bb-9a0e-6747772c4dd9 tempest-ProjectReaderTests-1890400111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:54:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-cfb09fdd-0068-46bb-9a0e-6747772c4dd9 tempest-ProjectReaderTests-1890400111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:54:47 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-cfb09fdd-0068-46bb-9a0e-6747772c4dd9 tempest-ProjectReaderTests-1890400111 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:54:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1213813698',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b10bfd33-280d-4af9-9a29-ac94fbdc2efe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65c00229f3174f06821db0c8ac3485ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:54:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:54:48Z,use_quota=True,user_id='77387546a5754247a0d40a795e9c12d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:54:47 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-cfb09fdd-0068-46bb-9a0e-6747772c4dd9 tempest-ProjectReaderTests-1890400111 None] Creating volume b10bfd33-280d-4af9-9a29-ac94fbdc2efe {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:54:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-cfb09fdd-0068-46bb-9a0e-6747772c4dd9 tempest-ProjectReaderTests-1890400111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:54:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-cfb09fdd-0068-46bb-9a0e-6747772c4dd9 tempest-ProjectReaderTests-1890400111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:54:47 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-cfb09fdd-0068-46bb-9a0e-6747772c4dd9 tempest-ProjectReaderTests-1890400111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:54:47 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-cfb09fdd-0068-46bb-9a0e-6747772c4dd9 tempest-ProjectReaderTests-1890400111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:54:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-cfb09fdd-0068-46bb-9a0e-6747772c4dd9 tempest-ProjectReaderTests-1890400111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:54:47 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-cfb09fdd-0068-46bb-9a0e-6747772c4dd9 tempest-ProjectReaderTests-1890400111 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:54:47 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-cfb09fdd-0068-46bb-9a0e-6747772c4dd9 tempest-ProjectReaderTests-1890400111 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:54:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-cfb09fdd-0068-46bb-9a0e-6747772c4dd9 tempest-ProjectReaderTests-1890400111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b10bfd33-280d-4af9-9a29-ac94fbdc2efe 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:47 devstack sudo[107131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b10bfd33-280d-4af9-9a29-ac94fbdc2efe 1073741824
Jul 09 14:54:47 devstack sudo[107131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:48 devstack sudo[107128]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d47a0986-b2ba-4654-805b-c396d40c34a8 tempest-ProjectReaderTests-934378749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ae2ad5fe-e1c2-4ea4-b81d-1eadedd51054" returned: 0 in 0.972s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d47a0986-b2ba-4654-805b-c396d40c34a8 tempest-ProjectReaderTests-934378749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ae2ad5fe-e1c2-4ea4-b81d-1eadedd51054.23739ea1-803e-4817-9d91-2228c2f469c2 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:48 devstack sudo[107150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ae2ad5fe-e1c2-4ea4-b81d-1eadedd51054.23739ea1-803e-4817-9d91-2228c2f469c2
Jul 09 14:54:48 devstack sudo[107150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d5f10582-f8eb-4a93-872f-199a41b46ec4 tempest-ProjectMemberTests-1092548551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:54:48 devstack sudo[107131]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-cfb09fdd-0068-46bb-9a0e-6747772c4dd9 tempest-ProjectReaderTests-1890400111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b10bfd33-280d-4af9-9a29-ac94fbdc2efe 1073741824" returned: 0 in 1.254s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-cfb09fdd-0068-46bb-9a0e-6747772c4dd9 tempest-ProjectReaderTests-1890400111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b10bfd33-280d-4af9-9a29-ac94fbdc2efe {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:49 devstack sudo[107184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b10bfd33-280d-4af9-9a29-ac94fbdc2efe
Jul 09 14:54:49 devstack sudo[107184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:49 devstack sudo[107150]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d47a0986-b2ba-4654-805b-c396d40c34a8 tempest-ProjectReaderTests-934378749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ae2ad5fe-e1c2-4ea4-b81d-1eadedd51054.23739ea1-803e-4817-9d91-2228c2f469c2" returned: 0 in 0.992s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d47a0986-b2ba-4654-805b-c396d40c34a8 tempest-ProjectReaderTests-934378749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ae2ad5fe-e1c2-4ea4-b81d-1eadedd51054.23739ea1-803e-4817-9d91-2228c2f469c2 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:49 devstack sudo[107186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ae2ad5fe-e1c2-4ea4-b81d-1eadedd51054.23739ea1-803e-4817-9d91-2228c2f469c2
Jul 09 14:54:49 devstack sudo[107186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:49 devstack sudo[107184]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-cfb09fdd-0068-46bb-9a0e-6747772c4dd9 tempest-ProjectReaderTests-1890400111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b10bfd33-280d-4af9-9a29-ac94fbdc2efe" returned: 0 in 0.685s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:49 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-cfb09fdd-0068-46bb-9a0e-6747772c4dd9 tempest-ProjectReaderTests-1890400111 None] <== create_volume: return (1988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:54:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-cfb09fdd-0068-46bb-9a0e-6747772c4dd9 tempest-ProjectReaderTests-1890400111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.991s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:54:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d5f10582-f8eb-4a93-872f-199a41b46ec4 tempest-ProjectMemberTests-1092548551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.798s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:54:49 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-cfb09fdd-0068-46bb-9a0e-6747772c4dd9 tempest-ProjectReaderTests-1890400111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5db87445-f089-43ea-81b7-348232e24a35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b10bfd33-280d-4af9-9a29-ac94fbdc2efe', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:54:49 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-cfb09fdd-0068-46bb-9a0e-6747772c4dd9 tempest-ProjectReaderTests-1890400111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4523c5d9-8d8a-4f73-a13c-e6a8a2d337e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:54:49 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-d5f10582-f8eb-4a93-872f-199a41b46ec4 tempest-ProjectMemberTests-1092548551 None] Creating offline snapshot 905f1da5-2532-4518-9c5e-a98ff8400649 of volume 8b67343c-680c-41de-b398-674ef51cf4e5 {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 14:54:49 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-cfb09fdd-0068-46bb-9a0e-6747772c4dd9 tempest-ProjectReaderTests-1890400111 None] Volume volume-b10bfd33-280d-4af9-9a29-ac94fbdc2efe (b10bfd33-280d-4af9-9a29-ac94fbdc2efe): created successfully
Jul 09 14:54:49 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-cfb09fdd-0068-46bb-9a0e-6747772c4dd9 tempest-ProjectReaderTests-1890400111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4523c5d9-8d8a-4f73-a13c-e6a8a2d337e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:54:49 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-cfb09fdd-0068-46bb-9a0e-6747772c4dd9 tempest-ProjectReaderTests-1890400111 None] Flow 'volume_create_manager' (fdb7f570-a8c6-4657-b210-44db45c8a6da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:54:49 devstack sudo[107186]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:49 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb483b65-8eae-4341-95eb-1ef513bdb7e7]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:54:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d5f10582-f8eb-4a93-872f-199a41b46ec4 tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8b67343c-680c-41de-b398-674ef51cf4e5 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d47a0986-b2ba-4654-805b-c396d40c34a8 tempest-ProjectReaderTests-934378749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ae2ad5fe-e1c2-4ea4-b81d-1eadedd51054.23739ea1-803e-4817-9d91-2228c2f469c2" returned: 0 in 0.741s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:49 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-cfb09fdd-0068-46bb-9a0e-6747772c4dd9 tempest-ProjectReaderTests-1890400111 None] Created volume successfully.
Jul 09 14:54:49 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d47a0986-b2ba-4654-805b-c396d40c34a8 tempest-ProjectReaderTests-934378749 None] Lock "cinder-quobyte-23739ea1-803e-4817-9d91-2228c2f469c2" released by "_delete_snapshot" :: held 3.737s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:54:49 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d47a0986-b2ba-4654-805b-c396d40c34a8 tempest-ProjectReaderTests-934378749 None] Lock "cinder-quobyte-ae2ad5fe-e1c2-4ea4-b81d-1eadedd51054" released by "delete_snapshot" :: held 3.766s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:54:49 devstack sudo[107190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8b67343c-680c-41de-b398-674ef51cf4e5
Jul 09 14:54:49 devstack sudo[107190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:49 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-d47a0986-b2ba-4654-805b-c396d40c34a8 tempest-ProjectReaderTests-934378749 None] Created reservations ['905dc140-fb57-4e2f-b99c-08d003f9483f', '5b11d8b3-e52d-46aa-a6fc-0ece5bfe004c', '2221fb19-0e05-4568-ad0e-9b696296acbb', '5f6adf3e-295c-46ab-a31e-74935298f341'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:54:49 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-d47a0986-b2ba-4654-805b-c396d40c34a8 tempest-ProjectReaderTests-934378749 None] Delete snapshot completed successfully.
Jul 09 14:54:50 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d47a0986-b2ba-4654-805b-c396d40c34a8 tempest-ProjectReaderTests-934378749 None] Lock "cinder-23739ea1-803e-4817-9d91-2228c2f469c2-delete_snapshot" released by "delete_snapshot" :: held 3.942s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:54:50 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-cb2b94f1-28f5-47b6-92ce-f53bc74ad158 tempest-ProjectReaderTests-934378749 None] Acquiring lock "cinder-ae2ad5fe-e1c2-4ea4-b81d-1eadedd51054-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:54:50 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-cb2b94f1-28f5-47b6-92ce-f53bc74ad158 tempest-ProjectReaderTests-934378749 None] Lock "cinder-ae2ad5fe-e1c2-4ea4-b81d-1eadedd51054-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:54:50 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-cb2b94f1-28f5-47b6-92ce-f53bc74ad158 tempest-ProjectReaderTests-934378749 None] Acquiring lock "cinder-quobyte-ae2ad5fe-e1c2-4ea4-b81d-1eadedd51054" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:54:50 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-cb2b94f1-28f5-47b6-92ce-f53bc74ad158 tempest-ProjectReaderTests-934378749 None] Lock "cinder-quobyte-ae2ad5fe-e1c2-4ea4-b81d-1eadedd51054" acquired by "delete_volume" :: waited 0.022s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:54:50 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7473c08-931b-42ea-ae0c-981dea6eac12]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:54:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-cb2b94f1-28f5-47b6-92ce-f53bc74ad158 tempest-ProjectReaderTests-934378749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ae2ad5fe-e1c2-4ea4-b81d-1eadedd51054 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:50 devstack sudo[107194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ae2ad5fe-e1c2-4ea4-b81d-1eadedd51054
Jul 09 14:54:50 devstack sudo[107194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:50 devstack sudo[107190]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d5f10582-f8eb-4a93-872f-199a41b46ec4 tempest-ProjectMemberTests-1092548551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8b67343c-680c-41de-b398-674ef51cf4e5" returned: 0 in 0.880s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d5f10582-f8eb-4a93-872f-199a41b46ec4 tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8b67343c-680c-41de-b398-674ef51cf4e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8b67343c-680c-41de-b398-674ef51cf4e5.905f1da5-2532-4518-9c5e-a98ff8400649 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:50 devstack sudo[107197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8b67343c-680c-41de-b398-674ef51cf4e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8b67343c-680c-41de-b398-674ef51cf4e5.905f1da5-2532-4518-9c5e-a98ff8400649 1G
Jul 09 14:54:50 devstack sudo[107197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:50 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-ca1542d8-d25d-49bc-a18f-752f5a710cfa tempest-ProjectReaderTests-1890400111 None] Acquiring lock "cinder-b10bfd33-280d-4af9-9a29-ac94fbdc2efe-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:54:51 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-ca1542d8-d25d-49bc-a18f-752f5a710cfa tempest-ProjectReaderTests-1890400111 None] Lock "cinder-b10bfd33-280d-4af9-9a29-ac94fbdc2efe-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:54:51 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-ca1542d8-d25d-49bc-a18f-752f5a710cfa tempest-ProjectReaderTests-1890400111 None] Acquiring lock "cinder-quobyte-b10bfd33-280d-4af9-9a29-ac94fbdc2efe" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:54:51 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-ca1542d8-d25d-49bc-a18f-752f5a710cfa tempest-ProjectReaderTests-1890400111 None] Lock "cinder-quobyte-b10bfd33-280d-4af9-9a29-ac94fbdc2efe" acquired by "delete_volume" :: waited 0.022s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:54:51 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a136c9e-33e4-4ec7-9988-57b0623d4aa0]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:54:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ca1542d8-d25d-49bc-a18f-752f5a710cfa tempest-ProjectReaderTests-1890400111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b10bfd33-280d-4af9-9a29-ac94fbdc2efe {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:51 devstack sudo[107200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b10bfd33-280d-4af9-9a29-ac94fbdc2efe
Jul 09 14:54:51 devstack sudo[107200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:51 devstack sudo[107194]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-cb2b94f1-28f5-47b6-92ce-f53bc74ad158 tempest-ProjectReaderTests-934378749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ae2ad5fe-e1c2-4ea4-b81d-1eadedd51054" returned: 0 in 0.990s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-cb2b94f1-28f5-47b6-92ce-f53bc74ad158 tempest-ProjectReaderTests-934378749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ae2ad5fe-e1c2-4ea4-b81d-1eadedd51054 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:51 devstack sudo[107209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ae2ad5fe-e1c2-4ea4-b81d-1eadedd51054
Jul 09 14:54:51 devstack sudo[107209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:51 devstack sudo[107197]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d5f10582-f8eb-4a93-872f-199a41b46ec4 tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8b67343c-680c-41de-b398-674ef51cf4e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8b67343c-680c-41de-b398-674ef51cf4e5.905f1da5-2532-4518-9c5e-a98ff8400649 1G" returned: 0 in 1.014s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d5f10582-f8eb-4a93-872f-199a41b46ec4 tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b67343c-680c-41de-b398-674ef51cf4e5 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8b67343c-680c-41de-b398-674ef51cf4e5.905f1da5-2532-4518-9c5e-a98ff8400649 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:51 devstack sudo[107211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b67343c-680c-41de-b398-674ef51cf4e5 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8b67343c-680c-41de-b398-674ef51cf4e5.905f1da5-2532-4518-9c5e-a98ff8400649
Jul 09 14:54:51 devstack sudo[107211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:52 devstack sudo[107200]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ca1542d8-d25d-49bc-a18f-752f5a710cfa tempest-ProjectReaderTests-1890400111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b10bfd33-280d-4af9-9a29-ac94fbdc2efe" returned: 0 in 0.962s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ca1542d8-d25d-49bc-a18f-752f5a710cfa tempest-ProjectReaderTests-1890400111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b10bfd33-280d-4af9-9a29-ac94fbdc2efe {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:52 devstack sudo[107216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b10bfd33-280d-4af9-9a29-ac94fbdc2efe
Jul 09 14:54:52 devstack sudo[107216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:52 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 14:54:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:54:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:54:52 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:54:52 devstack sudo[107209]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:52 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:54:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:54:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-cb2b94f1-28f5-47b6-92ce-f53bc74ad158 tempest-ProjectReaderTests-934378749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-ae2ad5fe-e1c2-4ea4-b81d-1eadedd51054" returned: 0 in 0.965s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:52 devstack sudo[107211]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:52 devstack sudo[107223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:54:52 devstack sudo[107223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d5f10582-f8eb-4a93-872f-199a41b46ec4 tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b67343c-680c-41de-b398-674ef51cf4e5 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8b67343c-680c-41de-b398-674ef51cf4e5.905f1da5-2532-4518-9c5e-a98ff8400649" returned: 0 in 0.803s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:52 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-d5f10582-f8eb-4a93-872f-199a41b46ec4 tempest-ProjectMemberTests-1092548551 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8b67343c-680c-41de-b398-674ef51cf4e5.905f1da5-2532-4518-9c5e-a98ff8400649 is being set with open permissions: ugo+rw
Jul 09 14:54:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d5f10582-f8eb-4a93-872f-199a41b46ec4 tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8b67343c-680c-41de-b398-674ef51cf4e5.905f1da5-2532-4518-9c5e-a98ff8400649 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:52 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-cb2b94f1-28f5-47b6-92ce-f53bc74ad158 tempest-ProjectReaderTests-934378749 None] Lock "cinder-quobyte-ae2ad5fe-e1c2-4ea4-b81d-1eadedd51054" released by "delete_volume" :: held 2.046s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:54:52 devstack sudo[107225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8b67343c-680c-41de-b398-674ef51cf4e5.905f1da5-2532-4518-9c5e-a98ff8400649
Jul 09 14:54:52 devstack sudo[107225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:52 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-cb2b94f1-28f5-47b6-92ce-f53bc74ad158 tempest-ProjectReaderTests-934378749 None] Created reservations ['bf7a9d3b-1542-4c77-ae4a-9958d509c34e', 'b4cbb198-6684-4b6b-bf76-c934bfec7fbe', '0b009df5-1bc9-48bc-ab19-c2df861caa75', 'ceca1c01-561b-47c6-8a6b-d474173ad3a5'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:54:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-cb2b94f1-28f5-47b6-92ce-f53bc74ad158 tempest-ProjectReaderTests-934378749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:54:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-cb2b94f1-28f5-47b6-92ce-f53bc74ad158 tempest-ProjectReaderTests-934378749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:54:52 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-cb2b94f1-28f5-47b6-92ce-f53bc74ad158 tempest-ProjectReaderTests-934378749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:54:52 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-cb2b94f1-28f5-47b6-92ce-f53bc74ad158 tempest-ProjectReaderTests-934378749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:54:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-cb2b94f1-28f5-47b6-92ce-f53bc74ad158 tempest-ProjectReaderTests-934378749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:54:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-cb2b94f1-28f5-47b6-92ce-f53bc74ad158 tempest-ProjectReaderTests-934378749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:52 devstack sudo[107227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:54:52 devstack sudo[107227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:53 devstack sudo[107216]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ca1542d8-d25d-49bc-a18f-752f5a710cfa tempest-ProjectReaderTests-1890400111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b10bfd33-280d-4af9-9a29-ac94fbdc2efe" returned: 0 in 1.096s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:53 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-ca1542d8-d25d-49bc-a18f-752f5a710cfa tempest-ProjectReaderTests-1890400111 None] Lock "cinder-quobyte-b10bfd33-280d-4af9-9a29-ac94fbdc2efe" released by "delete_volume" :: held 2.133s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:54:53 devstack sudo[107223]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.851s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:53 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:54:53 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Running periodic task VolumeManager._thread_info {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 14:54:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] thread count: 28 {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 09 14:54:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] thread info: [<_MainThread(MainThread, started 125388812103808)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125388713797504)>, <Thread(Thread-3 (stat_writer), started daemon 125388699995392)>, <Thread(Rabbit-heartbeat, started daemon 125388700522560)>, <Thread(Thread-5 (_runner), started daemon 125388698545216)>, <Thread(Thread-7 (_runner), started daemon 125388698611264)>, <Thread(fd_logger, started daemon 125388703020672)>, <Thread(privsep_reader, started daemon 125388696441088)>, <Thread(tpool_thread_0, started daemon 125388687943360)>, <Thread(tpool_thread_1, started daemon 125388679550656)>, <Thread(tpool_thread_2, started daemon 125388671141568)>, <Thread(tpool_thread_3, started daemon 125388662732480)>, <Thread(tpool_thread_4, started daemon 125388654323392)>, <Thread(tpool_thread_5, started daemon 125388645914304)>, <Thread(tpool_thread_6, started daemon 125388637505216)>, <Thread(tpool_thread_7, started daemon 125388629096128)>, <Thread(tpool_thread_8, started daemon 125388620687040)>, <Thread(tpool_thread_9, started daemon 125388612277952)>, <Thread(tpool_thread_10, started daemon 125388603868864)>, <Thread(tpool_thread_11, started daemon 125388595459776)>, <Thread(tpool_thread_12, started daemon 125388587050688)>, <Thread(tpool_thread_13, started daemon 125388578641600)>, <Thread(tpool_thread_14, started daemon 125388570232512)>, <Thread(tpool_thread_15, started daemon 125388561823424)>, <Thread(tpool_thread_16, started daemon 125388553414336)>, <Thread(tpool_thread_17, started daemon 125388545005248)>, <Thread(tpool_thread_18, started daemon 125388536596160)>, <Thread(tpool_thread_19, started daemon 125388528187072)>] {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 09 14:54:53 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-ca1542d8-d25d-49bc-a18f-752f5a710cfa tempest-ProjectReaderTests-1890400111 None] Created reservations ['18dfec43-3739-43b1-b911-a35a59571049', 'a108a269-1470-4810-a3d4-8b5eae53c189', '95f7d13f-4949-4e0d-b593-39b1039612b3', '4aa76c7a-8125-487c-a35d-2b43cb9a61fc'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:54:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-ca1542d8-d25d-49bc-a18f-752f5a710cfa tempest-ProjectReaderTests-1890400111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:54:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-ca1542d8-d25d-49bc-a18f-752f5a710cfa tempest-ProjectReaderTests-1890400111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:54:53 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-ca1542d8-d25d-49bc-a18f-752f5a710cfa tempest-ProjectReaderTests-1890400111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:54:53 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-ca1542d8-d25d-49bc-a18f-752f5a710cfa tempest-ProjectReaderTests-1890400111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:54:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-ca1542d8-d25d-49bc-a18f-752f5a710cfa tempest-ProjectReaderTests-1890400111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:54:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ca1542d8-d25d-49bc-a18f-752f5a710cfa tempest-ProjectReaderTests-1890400111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:53 devstack sudo[107232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:54:53 devstack sudo[107232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:53 devstack sudo[107227]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-cb2b94f1-28f5-47b6-92ce-f53bc74ad158 tempest-ProjectReaderTests-934378749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.785s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:53 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-cb2b94f1-28f5-47b6-92ce-f53bc74ad158 tempest-ProjectReaderTests-934378749 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:54:53 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-cb2b94f1-28f5-47b6-92ce-f53bc74ad158 tempest-ProjectReaderTests-934378749 None] Deleted volume successfully.
Jul 09 14:54:53 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-cb2b94f1-28f5-47b6-92ce-f53bc74ad158 tempest-ProjectReaderTests-934378749 None] Lock "cinder-ae2ad5fe-e1c2-4ea4-b81d-1eadedd51054-delete_volume" released by "delete_volume" :: held 3.182s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:54:53 devstack sudo[107225]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d5f10582-f8eb-4a93-872f-199a41b46ec4 tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8b67343c-680c-41de-b398-674ef51cf4e5.905f1da5-2532-4518-9c5e-a98ff8400649" returned: 0 in 1.094s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d5f10582-f8eb-4a93-872f-199a41b46ec4 tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8b67343c-680c-41de-b398-674ef51cf4e5.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:53 devstack sudo[107235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8b67343c-680c-41de-b398-674ef51cf4e5.info
Jul 09 14:54:53 devstack sudo[107235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:54 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-df660631-78af-46c0-bf2b-ef9601818840 tempest-ProjectReaderTests-934378749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:54:54 devstack sudo[107232]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-df660631-78af-46c0-bf2b-ef9601818840 tempest-ProjectReaderTests-934378749 None] Flow 'volume_create_manager' (6fc63972-ca6a-4dc9-b28c-28d687f40f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:54:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-df660631-78af-46c0-bf2b-ef9601818840 tempest-ProjectReaderTests-934378749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7234c66b-e409-4372-9ff0-eeeb1a07b8a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:54:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ca1542d8-d25d-49bc-a18f-752f5a710cfa tempest-ProjectReaderTests-1890400111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.957s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:54 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-ca1542d8-d25d-49bc-a18f-752f5a710cfa tempest-ProjectReaderTests-1890400111 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:54:54 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-ca1542d8-d25d-49bc-a18f-752f5a710cfa tempest-ProjectReaderTests-1890400111 None] Deleted volume successfully.
Jul 09 14:54:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-df660631-78af-46c0-bf2b-ef9601818840 tempest-ProjectReaderTests-934378749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7234c66b-e409-4372-9ff0-eeeb1a07b8a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:54:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-640530476',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=874bc7fc-02c7-4919-bc44-a1f2d563762e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20599830728f47858cc21c11b6e6bbac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:54:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:54:54Z,use_quota=True,user_id='a49bf6be1b4b4e2d810713bc1d8374d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:54:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-df660631-78af-46c0-bf2b-ef9601818840 tempest-ProjectReaderTests-934378749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4abd5366-3822-47db-9fee-1a58365f691e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:54:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-df660631-78af-46c0-bf2b-ef9601818840 tempest-ProjectReaderTests-934378749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4abd5366-3822-47db-9fee-1a58365f691e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:54:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-df660631-78af-46c0-bf2b-ef9601818840 tempest-ProjectReaderTests-934378749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b880c22-79d5-4b7f-b5e7-3346d2f8cef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:54:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-df660631-78af-46c0-bf2b-ef9601818840 tempest-ProjectReaderTests-934378749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b880c22-79d5-4b7f-b5e7-3346d2f8cef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '874bc7fc-02c7-4919-bc44-a1f2d563762e', 'volume_name': 'volume-874bc7fc-02c7-4919-bc44-a1f2d563762e', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:54:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-df660631-78af-46c0-bf2b-ef9601818840 tempest-ProjectReaderTests-934378749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95481cf7-b135-4416-a294-e5b7d783085e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:54:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-df660631-78af-46c0-bf2b-ef9601818840 tempest-ProjectReaderTests-934378749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95481cf7-b135-4416-a294-e5b7d783085e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:54:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-df660631-78af-46c0-bf2b-ef9601818840 tempest-ProjectReaderTests-934378749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ecf9f1a-60ca-45ed-9ee0-70b06eaaf2ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:54:54 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-df660631-78af-46c0-bf2b-ef9601818840 tempest-ProjectReaderTests-934378749 None] Volume 874bc7fc-02c7-4919-bc44-a1f2d563762e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-874bc7fc-02c7-4919-bc44-a1f2d563762e', 'volume_size': 1}
Jul 09 14:54:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-df660631-78af-46c0-bf2b-ef9601818840 tempest-ProjectReaderTests-934378749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:54:54 devstack sudo[107235]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:54 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-ca1542d8-d25d-49bc-a18f-752f5a710cfa tempest-ProjectReaderTests-1890400111 None] Lock "cinder-b10bfd33-280d-4af9-9a29-ac94fbdc2efe-delete_volume" released by "delete_volume" :: held 3.432s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:54:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d5f10582-f8eb-4a93-872f-199a41b46ec4 tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8b67343c-680c-41de-b398-674ef51cf4e5.info" returned: 0 in 0.847s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:54 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-d5f10582-f8eb-4a93-872f-199a41b46ec4 tempest-ProjectMemberTests-1092548551 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8b67343c-680c-41de-b398-674ef51cf4e5.info is being set with open permissions: ugo+rw
Jul 09 14:54:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d5f10582-f8eb-4a93-872f-199a41b46ec4 tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8b67343c-680c-41de-b398-674ef51cf4e5.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:54 devstack sudo[107239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8b67343c-680c-41de-b398-674ef51cf4e5.info
Jul 09 14:54:54 devstack sudo[107239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:54 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea3567d9-d3dc-4881-8a41-58e66061ef94 tempest-ProjectReaderTests-1890400111 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:54:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ea3567d9-d3dc-4881-8a41-58e66061ef94 tempest-ProjectReaderTests-1890400111 None] Flow 'volume_create_manager' (7e3651f5-5a83-4dee-b76b-179aeb71de49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:54:55 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ea3567d9-d3dc-4881-8a41-58e66061ef94 tempest-ProjectReaderTests-1890400111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f52ca4d-5754-4e82-bcee-f175413ff351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:54:55 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ea3567d9-d3dc-4881-8a41-58e66061ef94 tempest-ProjectReaderTests-1890400111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f52ca4d-5754-4e82-bcee-f175413ff351) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:54:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1498882304',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=453c1aff-922f-4b8f-9241-066c1ec7ac55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65c00229f3174f06821db0c8ac3485ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:54:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:54:55Z,use_quota=True,user_id='77387546a5754247a0d40a795e9c12d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:54:55 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ea3567d9-d3dc-4881-8a41-58e66061ef94 tempest-ProjectReaderTests-1890400111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3e4ed3a-02f3-43b7-becb-3e1e55066093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:54:55 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ea3567d9-d3dc-4881-8a41-58e66061ef94 tempest-ProjectReaderTests-1890400111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3e4ed3a-02f3-43b7-becb-3e1e55066093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:54:55 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ea3567d9-d3dc-4881-8a41-58e66061ef94 tempest-ProjectReaderTests-1890400111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0d23642-2f0d-4c47-abca-515fa5cdcb56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:54:55 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ea3567d9-d3dc-4881-8a41-58e66061ef94 tempest-ProjectReaderTests-1890400111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0d23642-2f0d-4c47-abca-515fa5cdcb56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '453c1aff-922f-4b8f-9241-066c1ec7ac55', 'volume_name': 'volume-453c1aff-922f-4b8f-9241-066c1ec7ac55', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:54:55 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ea3567d9-d3dc-4881-8a41-58e66061ef94 tempest-ProjectReaderTests-1890400111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a135dff-b753-464d-824c-92ef5c5353b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:54:55 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ea3567d9-d3dc-4881-8a41-58e66061ef94 tempest-ProjectReaderTests-1890400111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a135dff-b753-464d-824c-92ef5c5353b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:54:55 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ea3567d9-d3dc-4881-8a41-58e66061ef94 tempest-ProjectReaderTests-1890400111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0176b7b3-7374-4da9-8181-43873c581be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:54:55 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-ea3567d9-d3dc-4881-8a41-58e66061ef94 tempest-ProjectReaderTests-1890400111 None] Volume 453c1aff-922f-4b8f-9241-066c1ec7ac55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-453c1aff-922f-4b8f-9241-066c1ec7ac55', 'volume_size': 1}
Jul 09 14:54:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-ea3567d9-d3dc-4881-8a41-58e66061ef94 tempest-ProjectReaderTests-1890400111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:54:55 devstack sudo[107239]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d5f10582-f8eb-4a93-872f-199a41b46ec4 tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8b67343c-680c-41de-b398-674ef51cf4e5.info" returned: 0 in 0.866s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d5f10582-f8eb-4a93-872f-199a41b46ec4 tempest-ProjectMemberTests-1092548551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.620s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:54:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-df660631-78af-46c0-bf2b-ef9601818840 tempest-ProjectReaderTests-934378749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.915s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:54:55 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-df660631-78af-46c0-bf2b-ef9601818840 tempest-ProjectReaderTests-934378749 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:54:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-640530476',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=874bc7fc-02c7-4919-bc44-a1f2d563762e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20599830728f47858cc21c11b6e6bbac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:54:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:54:54Z,use_quota=True,user_id='a49bf6be1b4b4e2d810713bc1d8374d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:54:55 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-df660631-78af-46c0-bf2b-ef9601818840 tempest-ProjectReaderTests-934378749 None] Creating volume 874bc7fc-02c7-4919-bc44-a1f2d563762e {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:54:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-df660631-78af-46c0-bf2b-ef9601818840 tempest-ProjectReaderTests-934378749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:54:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-df660631-78af-46c0-bf2b-ef9601818840 tempest-ProjectReaderTests-934378749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:54:55 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-df660631-78af-46c0-bf2b-ef9601818840 tempest-ProjectReaderTests-934378749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:54:55 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-df660631-78af-46c0-bf2b-ef9601818840 tempest-ProjectReaderTests-934378749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:54:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-df660631-78af-46c0-bf2b-ef9601818840 tempest-ProjectReaderTests-934378749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:54:55 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-df660631-78af-46c0-bf2b-ef9601818840 tempest-ProjectReaderTests-934378749 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:54:55 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-df660631-78af-46c0-bf2b-ef9601818840 tempest-ProjectReaderTests-934378749 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:54:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-df660631-78af-46c0-bf2b-ef9601818840 tempest-ProjectReaderTests-934378749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-874bc7fc-02c7-4919-bc44-a1f2d563762e 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:55 devstack sudo[107242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-874bc7fc-02c7-4919-bc44-a1f2d563762e 1073741824
Jul 09 14:54:55 devstack sudo[107242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:55 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-d5f10582-f8eb-4a93-872f-199a41b46ec4 tempest-ProjectMemberTests-1092548551 None] Create snapshot completed successfully
Jul 09 14:54:56 devstack sudo[107242]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-df660631-78af-46c0-bf2b-ef9601818840 tempest-ProjectReaderTests-934378749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-874bc7fc-02c7-4919-bc44-a1f2d563762e 1073741824" returned: 0 in 0.879s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-df660631-78af-46c0-bf2b-ef9601818840 tempest-ProjectReaderTests-934378749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-874bc7fc-02c7-4919-bc44-a1f2d563762e {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:56 devstack sudo[107248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-874bc7fc-02c7-4919-bc44-a1f2d563762e
Jul 09 14:54:56 devstack sudo[107248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:56 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f4e998cb-6a64-40ed-a5b6-fa4a4a1be35e tempest-ProjectMemberTests-1092548551 None] Acquiring lock "cinder-905f1da5-2532-4518-9c5e-a98ff8400649-delete_snapshot" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:54:56 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f4e998cb-6a64-40ed-a5b6-fa4a4a1be35e tempest-ProjectMemberTests-1092548551 None] Lock "cinder-905f1da5-2532-4518-9c5e-a98ff8400649-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:54:56 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f4e998cb-6a64-40ed-a5b6-fa4a4a1be35e tempest-ProjectMemberTests-1092548551 None] Acquiring lock "cinder-quobyte-8b67343c-680c-41de-b398-674ef51cf4e5" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:54:56 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f4e998cb-6a64-40ed-a5b6-fa4a4a1be35e tempest-ProjectMemberTests-1092548551 None] Lock "cinder-quobyte-8b67343c-680c-41de-b398-674ef51cf4e5" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:54:56 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f4e998cb-6a64-40ed-a5b6-fa4a4a1be35e tempest-ProjectMemberTests-1092548551 None] Acquiring lock "cinder-quobyte-905f1da5-2532-4518-9c5e-a98ff8400649" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:54:56 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f4e998cb-6a64-40ed-a5b6-fa4a4a1be35e tempest-ProjectMemberTests-1092548551 None] Lock "cinder-quobyte-905f1da5-2532-4518-9c5e-a98ff8400649" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:54:56 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-f4e998cb-6a64-40ed-a5b6-fa4a4a1be35e tempest-ProjectMemberTests-1092548551 None] Deleting offline snapshot 905f1da5-2532-4518-9c5e-a98ff8400649 of volume 8b67343c-680c-41de-b398-674ef51cf4e5 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 14:54:56 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-f4e998cb-6a64-40ed-a5b6-fa4a4a1be35e tempest-ProjectMemberTests-1092548551 None] snapshot_file for this snap is: volume-8b67343c-680c-41de-b398-674ef51cf4e5.905f1da5-2532-4518-9c5e-a98ff8400649 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 14:54:56 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf8e3e0-1184-421b-b7ad-c0bda45e31a1]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:54:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f4e998cb-6a64-40ed-a5b6-fa4a4a1be35e tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8b67343c-680c-41de-b398-674ef51cf4e5.905f1da5-2532-4518-9c5e-a98ff8400649 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:56 devstack sudo[107256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8b67343c-680c-41de-b398-674ef51cf4e5.905f1da5-2532-4518-9c5e-a98ff8400649
Jul 09 14:54:56 devstack sudo[107256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:57 devstack sudo[107248]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-df660631-78af-46c0-bf2b-ef9601818840 tempest-ProjectReaderTests-934378749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-874bc7fc-02c7-4919-bc44-a1f2d563762e" returned: 0 in 0.775s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:57 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-df660631-78af-46c0-bf2b-ef9601818840 tempest-ProjectReaderTests-934378749 None] <== create_volume: return (1711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:54:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-df660631-78af-46c0-bf2b-ef9601818840 tempest-ProjectReaderTests-934378749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.714s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:54:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-ea3567d9-d3dc-4881-8a41-58e66061ef94 tempest-ProjectReaderTests-1890400111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.997s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:54:57 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-ea3567d9-d3dc-4881-8a41-58e66061ef94 tempest-ProjectReaderTests-1890400111 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:54:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1498882304',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=453c1aff-922f-4b8f-9241-066c1ec7ac55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65c00229f3174f06821db0c8ac3485ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:54:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:54:55Z,use_quota=True,user_id='77387546a5754247a0d40a795e9c12d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:54:57 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-ea3567d9-d3dc-4881-8a41-58e66061ef94 tempest-ProjectReaderTests-1890400111 None] Creating volume 453c1aff-922f-4b8f-9241-066c1ec7ac55 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:54:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-ea3567d9-d3dc-4881-8a41-58e66061ef94 tempest-ProjectReaderTests-1890400111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:54:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-ea3567d9-d3dc-4881-8a41-58e66061ef94 tempest-ProjectReaderTests-1890400111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:54:57 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-ea3567d9-d3dc-4881-8a41-58e66061ef94 tempest-ProjectReaderTests-1890400111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:54:57 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-ea3567d9-d3dc-4881-8a41-58e66061ef94 tempest-ProjectReaderTests-1890400111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:54:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-ea3567d9-d3dc-4881-8a41-58e66061ef94 tempest-ProjectReaderTests-1890400111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:54:57 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-ea3567d9-d3dc-4881-8a41-58e66061ef94 tempest-ProjectReaderTests-1890400111 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:54:57 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-ea3567d9-d3dc-4881-8a41-58e66061ef94 tempest-ProjectReaderTests-1890400111 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:54:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ea3567d9-d3dc-4881-8a41-58e66061ef94 tempest-ProjectReaderTests-1890400111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-453c1aff-922f-4b8f-9241-066c1ec7ac55 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:57 devstack sudo[107259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-453c1aff-922f-4b8f-9241-066c1ec7ac55 1073741824
Jul 09 14:54:57 devstack sudo[107259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:57 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-df660631-78af-46c0-bf2b-ef9601818840 tempest-ProjectReaderTests-934378749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ecf9f1a-60ca-45ed-9ee0-70b06eaaf2ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-874bc7fc-02c7-4919-bc44-a1f2d563762e', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:54:57 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-df660631-78af-46c0-bf2b-ef9601818840 tempest-ProjectReaderTests-934378749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd67ba0c-7ee9-4b54-8b96-fda4b26d4ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:54:57 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-df660631-78af-46c0-bf2b-ef9601818840 tempest-ProjectReaderTests-934378749 None] Volume volume-874bc7fc-02c7-4919-bc44-a1f2d563762e (874bc7fc-02c7-4919-bc44-a1f2d563762e): created successfully
Jul 09 14:54:57 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-df660631-78af-46c0-bf2b-ef9601818840 tempest-ProjectReaderTests-934378749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd67ba0c-7ee9-4b54-8b96-fda4b26d4ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:54:57 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-df660631-78af-46c0-bf2b-ef9601818840 tempest-ProjectReaderTests-934378749 None] Flow 'volume_create_manager' (6fc63972-ca6a-4dc9-b28c-28d687f40f62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:54:57 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-df660631-78af-46c0-bf2b-ef9601818840 tempest-ProjectReaderTests-934378749 None] Created volume successfully.
Jul 09 14:54:57 devstack sudo[107256]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f4e998cb-6a64-40ed-a5b6-fa4a4a1be35e tempest-ProjectMemberTests-1092548551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8b67343c-680c-41de-b398-674ef51cf4e5.905f1da5-2532-4518-9c5e-a98ff8400649" returned: 0 in 0.914s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:57 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-f4e998cb-6a64-40ed-a5b6-fa4a4a1be35e tempest-ProjectMemberTests-1092548551 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b67343c-680c-41de-b398-674ef51cf4e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 14:54:57 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[732bd495-b67c-4cd0-bf5e-623ed8b688d7]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:54:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f4e998cb-6a64-40ed-a5b6-fa4a4a1be35e tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8b67343c-680c-41de-b398-674ef51cf4e5 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:57 devstack sudo[107264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8b67343c-680c-41de-b398-674ef51cf4e5
Jul 09 14:54:57 devstack sudo[107264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-180740d6-cfb7-46de-a2df-f5d5ebbf7721 tempest-ProjectReaderTests-934378749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:54:58 devstack sudo[107259]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ea3567d9-d3dc-4881-8a41-58e66061ef94 tempest-ProjectReaderTests-1890400111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-453c1aff-922f-4b8f-9241-066c1ec7ac55 1073741824" returned: 0 in 0.998s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ea3567d9-d3dc-4881-8a41-58e66061ef94 tempest-ProjectReaderTests-1890400111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-453c1aff-922f-4b8f-9241-066c1ec7ac55 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:58 devstack sudo[107270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-453c1aff-922f-4b8f-9241-066c1ec7ac55
Jul 09 14:54:58 devstack sudo[107270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:58 devstack sudo[107264]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f4e998cb-6a64-40ed-a5b6-fa4a4a1be35e tempest-ProjectMemberTests-1092548551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8b67343c-680c-41de-b398-674ef51cf4e5" returned: 0 in 0.896s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f4e998cb-6a64-40ed-a5b6-fa4a4a1be35e tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8b67343c-680c-41de-b398-674ef51cf4e5.905f1da5-2532-4518-9c5e-a98ff8400649 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:58 devstack sudo[107275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8b67343c-680c-41de-b398-674ef51cf4e5.905f1da5-2532-4518-9c5e-a98ff8400649
Jul 09 14:54:58 devstack sudo[107275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:58 devstack sudo[107270]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ea3567d9-d3dc-4881-8a41-58e66061ef94 tempest-ProjectReaderTests-1890400111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-453c1aff-922f-4b8f-9241-066c1ec7ac55" returned: 0 in 0.696s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:58 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-ea3567d9-d3dc-4881-8a41-58e66061ef94 tempest-ProjectReaderTests-1890400111 None] <== create_volume: return (1746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:54:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-ea3567d9-d3dc-4881-8a41-58e66061ef94 tempest-ProjectReaderTests-1890400111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.750s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:54:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-180740d6-cfb7-46de-a2df-f5d5ebbf7721 tempest-ProjectReaderTests-934378749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.088s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:54:58 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-180740d6-cfb7-46de-a2df-f5d5ebbf7721 tempest-ProjectReaderTests-934378749 None] Creating offline snapshot 163808ef-083d-417a-840d-1e4fc14c81f7 of volume 874bc7fc-02c7-4919-bc44-a1f2d563762e {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 14:54:58 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ea3567d9-d3dc-4881-8a41-58e66061ef94 tempest-ProjectReaderTests-1890400111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0176b7b3-7374-4da9-8181-43873c581be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-453c1aff-922f-4b8f-9241-066c1ec7ac55', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:54:58 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ea3567d9-d3dc-4881-8a41-58e66061ef94 tempest-ProjectReaderTests-1890400111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2edf3606-3186-4a88-be61-e711bb72e1bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:54:58 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3220e92-0737-47d1-a338-b79648d2f2fa]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:54:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-180740d6-cfb7-46de-a2df-f5d5ebbf7721 tempest-ProjectReaderTests-934378749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-874bc7fc-02c7-4919-bc44-a1f2d563762e {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:58 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-ea3567d9-d3dc-4881-8a41-58e66061ef94 tempest-ProjectReaderTests-1890400111 None] Volume volume-453c1aff-922f-4b8f-9241-066c1ec7ac55 (453c1aff-922f-4b8f-9241-066c1ec7ac55): created successfully
Jul 09 14:54:58 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ea3567d9-d3dc-4881-8a41-58e66061ef94 tempest-ProjectReaderTests-1890400111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2edf3606-3186-4a88-be61-e711bb72e1bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:54:58 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ea3567d9-d3dc-4881-8a41-58e66061ef94 tempest-ProjectReaderTests-1890400111 None] Flow 'volume_create_manager' (7e3651f5-5a83-4dee-b76b-179aeb71de49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:54:58 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-ea3567d9-d3dc-4881-8a41-58e66061ef94 tempest-ProjectReaderTests-1890400111 None] Created volume successfully.
Jul 09 14:54:58 devstack sudo[107278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-874bc7fc-02c7-4919-bc44-a1f2d563762e
Jul 09 14:54:58 devstack sudo[107278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:59 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-533216b2-f3f5-4643-ac7e-27b6c76535dd tempest-ProjectReaderTests-1890400111 None] Acquiring lock "cinder-453c1aff-922f-4b8f-9241-066c1ec7ac55-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:54:59 devstack sudo[107275]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f4e998cb-6a64-40ed-a5b6-fa4a4a1be35e tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8b67343c-680c-41de-b398-674ef51cf4e5.905f1da5-2532-4518-9c5e-a98ff8400649" returned: 0 in 0.973s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f4e998cb-6a64-40ed-a5b6-fa4a4a1be35e tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8b67343c-680c-41de-b398-674ef51cf4e5.905f1da5-2532-4518-9c5e-a98ff8400649 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:59 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-533216b2-f3f5-4643-ac7e-27b6c76535dd tempest-ProjectReaderTests-1890400111 None] Lock "cinder-453c1aff-922f-4b8f-9241-066c1ec7ac55-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:54:59 devstack sudo[107283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8b67343c-680c-41de-b398-674ef51cf4e5.905f1da5-2532-4518-9c5e-a98ff8400649
Jul 09 14:54:59 devstack sudo[107283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:59 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-533216b2-f3f5-4643-ac7e-27b6c76535dd tempest-ProjectReaderTests-1890400111 None] Acquiring lock "cinder-quobyte-453c1aff-922f-4b8f-9241-066c1ec7ac55" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:54:59 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-533216b2-f3f5-4643-ac7e-27b6c76535dd tempest-ProjectReaderTests-1890400111 None] Lock "cinder-quobyte-453c1aff-922f-4b8f-9241-066c1ec7ac55" acquired by "delete_volume" :: waited 0.028s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:54:59 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[26eef7f9-588f-4279-8ed0-9f3dd6dfdc4d]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:54:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-533216b2-f3f5-4643-ac7e-27b6c76535dd tempest-ProjectReaderTests-1890400111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-453c1aff-922f-4b8f-9241-066c1ec7ac55 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:59 devstack sudo[107285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-453c1aff-922f-4b8f-9241-066c1ec7ac55
Jul 09 14:54:59 devstack sudo[107285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:54:59 devstack sudo[107278]: pam_unix(sudo:session): session closed for user root
Jul 09 14:54:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-180740d6-cfb7-46de-a2df-f5d5ebbf7721 tempest-ProjectReaderTests-934378749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-874bc7fc-02c7-4919-bc44-a1f2d563762e" returned: 0 in 1.023s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:54:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-180740d6-cfb7-46de-a2df-f5d5ebbf7721 tempest-ProjectReaderTests-934378749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-874bc7fc-02c7-4919-bc44-a1f2d563762e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-874bc7fc-02c7-4919-bc44-a1f2d563762e.163808ef-083d-417a-840d-1e4fc14c81f7 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:54:59 devstack sudo[107290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-874bc7fc-02c7-4919-bc44-a1f2d563762e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-874bc7fc-02c7-4919-bc44-a1f2d563762e.163808ef-083d-417a-840d-1e4fc14c81f7 1G
Jul 09 14:54:59 devstack sudo[107290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:00 devstack sudo[107283]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f4e998cb-6a64-40ed-a5b6-fa4a4a1be35e tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8b67343c-680c-41de-b398-674ef51cf4e5.905f1da5-2532-4518-9c5e-a98ff8400649" returned: 0 in 0.836s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:00 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f4e998cb-6a64-40ed-a5b6-fa4a4a1be35e tempest-ProjectMemberTests-1092548551 None] Lock "cinder-quobyte-905f1da5-2532-4518-9c5e-a98ff8400649" released by "_delete_snapshot" :: held 3.760s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:55:00 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f4e998cb-6a64-40ed-a5b6-fa4a4a1be35e tempest-ProjectMemberTests-1092548551 None] Lock "cinder-quobyte-8b67343c-680c-41de-b398-674ef51cf4e5" released by "delete_snapshot" :: held 3.791s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:55:00 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:UPDATE=198,cinder:SELECT=144,cinder:INSERT=50,cinder:DELETE=21 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 14:55:00 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-f4e998cb-6a64-40ed-a5b6-fa4a4a1be35e tempest-ProjectMemberTests-1092548551 None] Created reservations ['be8b5ec2-2241-4632-a376-baabff0503d0', '3ce64feb-bcff-47ed-b662-3c4e0f8414a5', '639c5032-ec86-4e77-8dfe-1fef0c8cc5b9', '98e357d5-9fd6-4659-aa88-a2e995399355'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:55:00 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:UPDATE=214,cinder:INSERT=63,cinder:SELECT=150,cinder:DELETE=14 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 14:55:00 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-f4e998cb-6a64-40ed-a5b6-fa4a4a1be35e tempest-ProjectMemberTests-1092548551 None] Delete snapshot completed successfully.
Jul 09 14:55:00 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f4e998cb-6a64-40ed-a5b6-fa4a4a1be35e tempest-ProjectMemberTests-1092548551 None] Lock "cinder-905f1da5-2532-4518-9c5e-a98ff8400649-delete_snapshot" released by "delete_snapshot" :: held 3.983s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:55:00 devstack sudo[107285]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-533216b2-f3f5-4643-ac7e-27b6c76535dd tempest-ProjectReaderTests-1890400111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-453c1aff-922f-4b8f-9241-066c1ec7ac55" returned: 0 in 0.929s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-533216b2-f3f5-4643-ac7e-27b6c76535dd tempest-ProjectReaderTests-1890400111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-453c1aff-922f-4b8f-9241-066c1ec7ac55 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:00 devstack sudo[107299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-453c1aff-922f-4b8f-9241-066c1ec7ac55
Jul 09 14:55:00 devstack sudo[107299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:00 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-cabb5da7-e492-4cf4-965e-59986fc45216 tempest-ProjectMemberTests-1092548551 None] Acquiring lock "cinder-8b67343c-680c-41de-b398-674ef51cf4e5-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:55:00 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-cabb5da7-e492-4cf4-965e-59986fc45216 tempest-ProjectMemberTests-1092548551 None] Lock "cinder-8b67343c-680c-41de-b398-674ef51cf4e5-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:55:00 devstack sudo[107290]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-180740d6-cfb7-46de-a2df-f5d5ebbf7721 tempest-ProjectReaderTests-934378749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-874bc7fc-02c7-4919-bc44-a1f2d563762e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-874bc7fc-02c7-4919-bc44-a1f2d563762e.163808ef-083d-417a-840d-1e4fc14c81f7 1G" returned: 0 in 0.841s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-180740d6-cfb7-46de-a2df-f5d5ebbf7721 tempest-ProjectReaderTests-934378749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-874bc7fc-02c7-4919-bc44-a1f2d563762e -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-874bc7fc-02c7-4919-bc44-a1f2d563762e.163808ef-083d-417a-840d-1e4fc14c81f7 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:00 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-cabb5da7-e492-4cf4-965e-59986fc45216 tempest-ProjectMemberTests-1092548551 None] Acquiring lock "cinder-quobyte-8b67343c-680c-41de-b398-674ef51cf4e5" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:55:00 devstack sudo[107303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-874bc7fc-02c7-4919-bc44-a1f2d563762e -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-874bc7fc-02c7-4919-bc44-a1f2d563762e.163808ef-083d-417a-840d-1e4fc14c81f7
Jul 09 14:55:00 devstack sudo[107303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:00 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-cabb5da7-e492-4cf4-965e-59986fc45216 tempest-ProjectMemberTests-1092548551 None] Lock "cinder-quobyte-8b67343c-680c-41de-b398-674ef51cf4e5" acquired by "delete_volume" :: waited 0.019s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:55:00 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[79fd0f2f-51d8-4616-a257-d7c5abee7e18]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:55:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-cabb5da7-e492-4cf4-965e-59986fc45216 tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8b67343c-680c-41de-b398-674ef51cf4e5 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:00 devstack sudo[107305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8b67343c-680c-41de-b398-674ef51cf4e5
Jul 09 14:55:00 devstack sudo[107305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:01 devstack sudo[107299]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-533216b2-f3f5-4643-ac7e-27b6c76535dd tempest-ProjectReaderTests-1890400111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-453c1aff-922f-4b8f-9241-066c1ec7ac55" returned: 0 in 0.765s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:01 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-533216b2-f3f5-4643-ac7e-27b6c76535dd tempest-ProjectReaderTests-1890400111 None] Lock "cinder-quobyte-453c1aff-922f-4b8f-9241-066c1ec7ac55" released by "delete_volume" :: held 1.739s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:55:01 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-533216b2-f3f5-4643-ac7e-27b6c76535dd tempest-ProjectReaderTests-1890400111 None] Created reservations ['360612a4-0324-4130-9ff4-30668f94bab7', '26ff8069-6735-4ba5-ad37-f70484fea6f9', 'fe657d47-135b-4da3-a73e-52dbb7688ac2', '27b61ebd-446a-4d9a-9601-302f4954cca3'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:55:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-533216b2-f3f5-4643-ac7e-27b6c76535dd tempest-ProjectReaderTests-1890400111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:55:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-533216b2-f3f5-4643-ac7e-27b6c76535dd tempest-ProjectReaderTests-1890400111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:55:01 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-533216b2-f3f5-4643-ac7e-27b6c76535dd tempest-ProjectReaderTests-1890400111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:55:01 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-533216b2-f3f5-4643-ac7e-27b6c76535dd tempest-ProjectReaderTests-1890400111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:55:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-533216b2-f3f5-4643-ac7e-27b6c76535dd tempest-ProjectReaderTests-1890400111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:55:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-533216b2-f3f5-4643-ac7e-27b6c76535dd tempest-ProjectReaderTests-1890400111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:01 devstack sudo[107312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:55:01 devstack sudo[107312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:01 devstack sudo[107303]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-180740d6-cfb7-46de-a2df-f5d5ebbf7721 tempest-ProjectReaderTests-934378749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-874bc7fc-02c7-4919-bc44-a1f2d563762e -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-874bc7fc-02c7-4919-bc44-a1f2d563762e.163808ef-083d-417a-840d-1e4fc14c81f7" returned: 0 in 0.735s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:01 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-180740d6-cfb7-46de-a2df-f5d5ebbf7721 tempest-ProjectReaderTests-934378749 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-874bc7fc-02c7-4919-bc44-a1f2d563762e.163808ef-083d-417a-840d-1e4fc14c81f7 is being set with open permissions: ugo+rw
Jul 09 14:55:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-180740d6-cfb7-46de-a2df-f5d5ebbf7721 tempest-ProjectReaderTests-934378749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-874bc7fc-02c7-4919-bc44-a1f2d563762e.163808ef-083d-417a-840d-1e4fc14c81f7 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:01 devstack sudo[107317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-874bc7fc-02c7-4919-bc44-a1f2d563762e.163808ef-083d-417a-840d-1e4fc14c81f7
Jul 09 14:55:01 devstack sudo[107317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:01 devstack sudo[107305]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-cabb5da7-e492-4cf4-965e-59986fc45216 tempest-ProjectMemberTests-1092548551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8b67343c-680c-41de-b398-674ef51cf4e5" returned: 0 in 0.877s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-cabb5da7-e492-4cf4-965e-59986fc45216 tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8b67343c-680c-41de-b398-674ef51cf4e5 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:01 devstack sudo[107322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8b67343c-680c-41de-b398-674ef51cf4e5
Jul 09 14:55:01 devstack sudo[107322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:02 devstack sudo[107312]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-533216b2-f3f5-4643-ac7e-27b6c76535dd tempest-ProjectReaderTests-1890400111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.776s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:02 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-533216b2-f3f5-4643-ac7e-27b6c76535dd tempest-ProjectReaderTests-1890400111 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:55:02 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-533216b2-f3f5-4643-ac7e-27b6c76535dd tempest-ProjectReaderTests-1890400111 None] Deleted volume successfully.
Jul 09 14:55:02 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-533216b2-f3f5-4643-ac7e-27b6c76535dd tempest-ProjectReaderTests-1890400111 None] Lock "cinder-453c1aff-922f-4b8f-9241-066c1ec7ac55-delete_volume" released by "delete_volume" :: held 2.787s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:55:02 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1c24ab2-cd6f-463a-96a2-77315925d9b2 tempest-ProjectReaderTests-1890400111 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:55:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b1c24ab2-cd6f-463a-96a2-77315925d9b2 tempest-ProjectReaderTests-1890400111 None] Flow 'volume_create_manager' (18d4333d-fd30-45c6-a727-e1a9cb2bef59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:55:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b1c24ab2-cd6f-463a-96a2-77315925d9b2 tempest-ProjectReaderTests-1890400111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5e91939-1865-43c9-b089-d0ac50f4f03f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:55:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b1c24ab2-cd6f-463a-96a2-77315925d9b2 tempest-ProjectReaderTests-1890400111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5e91939-1865-43c9-b089-d0ac50f4f03f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:55:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-516056080',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e942d138-3199-4b29-8c12-148b8613e76e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65c00229f3174f06821db0c8ac3485ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:55:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:55:02Z,use_quota=True,user_id='77387546a5754247a0d40a795e9c12d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:55:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b1c24ab2-cd6f-463a-96a2-77315925d9b2 tempest-ProjectReaderTests-1890400111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f2c80e0-5731-4c81-b7fd-f1d2f6838f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:55:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b1c24ab2-cd6f-463a-96a2-77315925d9b2 tempest-ProjectReaderTests-1890400111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f2c80e0-5731-4c81-b7fd-f1d2f6838f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:55:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b1c24ab2-cd6f-463a-96a2-77315925d9b2 tempest-ProjectReaderTests-1890400111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (335e5950-2aa5-4488-9c00-2b87132bf7ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:55:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b1c24ab2-cd6f-463a-96a2-77315925d9b2 tempest-ProjectReaderTests-1890400111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (335e5950-2aa5-4488-9c00-2b87132bf7ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e942d138-3199-4b29-8c12-148b8613e76e', 'volume_name': 'volume-e942d138-3199-4b29-8c12-148b8613e76e', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:55:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b1c24ab2-cd6f-463a-96a2-77315925d9b2 tempest-ProjectReaderTests-1890400111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84b85b7c-bc0d-47a8-a03f-852beed5b31d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:55:02 devstack sudo[107317]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b1c24ab2-cd6f-463a-96a2-77315925d9b2 tempest-ProjectReaderTests-1890400111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84b85b7c-bc0d-47a8-a03f-852beed5b31d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:55:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b1c24ab2-cd6f-463a-96a2-77315925d9b2 tempest-ProjectReaderTests-1890400111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cabcf2ed-c953-4354-8ed1-2b9b828492a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:55:02 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-b1c24ab2-cd6f-463a-96a2-77315925d9b2 tempest-ProjectReaderTests-1890400111 None] Volume e942d138-3199-4b29-8c12-148b8613e76e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e942d138-3199-4b29-8c12-148b8613e76e', 'volume_size': 1}
Jul 09 14:55:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b1c24ab2-cd6f-463a-96a2-77315925d9b2 tempest-ProjectReaderTests-1890400111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:55:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-180740d6-cfb7-46de-a2df-f5d5ebbf7721 tempest-ProjectReaderTests-934378749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-874bc7fc-02c7-4919-bc44-a1f2d563762e.163808ef-083d-417a-840d-1e4fc14c81f7" returned: 0 in 0.824s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-180740d6-cfb7-46de-a2df-f5d5ebbf7721 tempest-ProjectReaderTests-934378749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-874bc7fc-02c7-4919-bc44-a1f2d563762e.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:02 devstack sudo[107326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-874bc7fc-02c7-4919-bc44-a1f2d563762e.info
Jul 09 14:55:02 devstack sudo[107326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:02 devstack sudo[107322]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-cabb5da7-e492-4cf4-965e-59986fc45216 tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-8b67343c-680c-41de-b398-674ef51cf4e5" returned: 0 in 0.841s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:02 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-cabb5da7-e492-4cf4-965e-59986fc45216 tempest-ProjectMemberTests-1092548551 None] Lock "cinder-quobyte-8b67343c-680c-41de-b398-674ef51cf4e5" released by "delete_volume" :: held 1.793s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:55:02 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-cabb5da7-e492-4cf4-965e-59986fc45216 tempest-ProjectMemberTests-1092548551 None] Created reservations ['1bdaf517-7631-4138-abc5-9a1e397d9133', 'e8bd4736-16ee-4841-87ba-8cdb464677ac', '3ceded6e-4e9d-4afc-bc5c-388d8c66ca30', 'd244965c-f6d5-4d7c-801b-c62a57595320'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:55:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-cabb5da7-e492-4cf4-965e-59986fc45216 tempest-ProjectMemberTests-1092548551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:55:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-cabb5da7-e492-4cf4-965e-59986fc45216 tempest-ProjectMemberTests-1092548551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:55:02 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-cabb5da7-e492-4cf4-965e-59986fc45216 tempest-ProjectMemberTests-1092548551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:55:02 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-cabb5da7-e492-4cf4-965e-59986fc45216 tempest-ProjectMemberTests-1092548551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:55:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-cabb5da7-e492-4cf4-965e-59986fc45216 tempest-ProjectMemberTests-1092548551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:55:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-cabb5da7-e492-4cf4-965e-59986fc45216 tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:02 devstack sudo[107329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:55:02 devstack sudo[107329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:03 devstack sudo[107326]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-180740d6-cfb7-46de-a2df-f5d5ebbf7721 tempest-ProjectReaderTests-934378749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-874bc7fc-02c7-4919-bc44-a1f2d563762e.info" returned: 0 in 0.714s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:03 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-180740d6-cfb7-46de-a2df-f5d5ebbf7721 tempest-ProjectReaderTests-934378749 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-874bc7fc-02c7-4919-bc44-a1f2d563762e.info is being set with open permissions: ugo+rw
Jul 09 14:55:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-180740d6-cfb7-46de-a2df-f5d5ebbf7721 tempest-ProjectReaderTests-934378749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-874bc7fc-02c7-4919-bc44-a1f2d563762e.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:03 devstack sudo[107332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-874bc7fc-02c7-4919-bc44-a1f2d563762e.info
Jul 09 14:55:03 devstack sudo[107332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:03 devstack sudo[107329]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-cabb5da7-e492-4cf4-965e-59986fc45216 tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.661s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:03 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-cabb5da7-e492-4cf4-965e-59986fc45216 tempest-ProjectMemberTests-1092548551 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:55:03 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-cabb5da7-e492-4cf4-965e-59986fc45216 tempest-ProjectMemberTests-1092548551 None] Deleted volume successfully.
Jul 09 14:55:03 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-cabb5da7-e492-4cf4-965e-59986fc45216 tempest-ProjectMemberTests-1092548551 None] Lock "cinder-8b67343c-680c-41de-b398-674ef51cf4e5-delete_volume" released by "delete_volume" :: held 2.696s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:55:03 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-35b02b12-9536-4390-9c3a-20e9b2b0e4d3 tempest-ProjectMemberTests-1092548551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:55:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-35b02b12-9536-4390-9c3a-20e9b2b0e4d3 tempest-ProjectMemberTests-1092548551 None] Flow 'volume_create_manager' (181c8c6b-84ca-4136-aac4-2360ae8515ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:55:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-35b02b12-9536-4390-9c3a-20e9b2b0e4d3 tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f62f706-33ad-46c0-8f0d-2f784c084f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:55:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-35b02b12-9536-4390-9c3a-20e9b2b0e4d3 tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f62f706-33ad-46c0-8f0d-2f784c084f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:55:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1370008586',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d995214-783a-4112-8f95-6d13507320c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53e3a7b509634eeda7e218e1577efd89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:55:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:55:03Z,use_quota=True,user_id='6f31a0c3fe3e49ccabfa9bdf47df92af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:55:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-35b02b12-9536-4390-9c3a-20e9b2b0e4d3 tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3fcab11-a15e-471c-bc04-d88e75e5d13e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:55:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-35b02b12-9536-4390-9c3a-20e9b2b0e4d3 tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3fcab11-a15e-471c-bc04-d88e75e5d13e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:55:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-35b02b12-9536-4390-9c3a-20e9b2b0e4d3 tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18670d37-ee2f-4706-8920-f427551dd4c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:55:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-35b02b12-9536-4390-9c3a-20e9b2b0e4d3 tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18670d37-ee2f-4706-8920-f427551dd4c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d995214-783a-4112-8f95-6d13507320c4', 'volume_name': 'volume-1d995214-783a-4112-8f95-6d13507320c4', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:55:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-35b02b12-9536-4390-9c3a-20e9b2b0e4d3 tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc32750c-9827-4604-ad17-34a251936a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:55:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-35b02b12-9536-4390-9c3a-20e9b2b0e4d3 tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc32750c-9827-4604-ad17-34a251936a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:55:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-35b02b12-9536-4390-9c3a-20e9b2b0e4d3 tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03901ebb-da9c-46f6-8e48-3fc1c51ff8e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:55:03 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-35b02b12-9536-4390-9c3a-20e9b2b0e4d3 tempest-ProjectMemberTests-1092548551 None] Volume 1d995214-783a-4112-8f95-6d13507320c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d995214-783a-4112-8f95-6d13507320c4', 'volume_size': 1}
Jul 09 14:55:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-35b02b12-9536-4390-9c3a-20e9b2b0e4d3 tempest-ProjectMemberTests-1092548551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:55:03 devstack sudo[107332]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-180740d6-cfb7-46de-a2df-f5d5ebbf7721 tempest-ProjectReaderTests-934378749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-874bc7fc-02c7-4919-bc44-a1f2d563762e.info" returned: 0 in 0.701s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-180740d6-cfb7-46de-a2df-f5d5ebbf7721 tempest-ProjectReaderTests-934378749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.945s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:55:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b1c24ab2-cd6f-463a-96a2-77315925d9b2 tempest-ProjectReaderTests-1890400111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.465s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:55:03 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b1c24ab2-cd6f-463a-96a2-77315925d9b2 tempest-ProjectReaderTests-1890400111 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:55:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-516056080',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e942d138-3199-4b29-8c12-148b8613e76e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65c00229f3174f06821db0c8ac3485ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:55:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:55:02Z,use_quota=True,user_id='77387546a5754247a0d40a795e9c12d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:55:03 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-b1c24ab2-cd6f-463a-96a2-77315925d9b2 tempest-ProjectReaderTests-1890400111 None] Creating volume e942d138-3199-4b29-8c12-148b8613e76e {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:55:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b1c24ab2-cd6f-463a-96a2-77315925d9b2 tempest-ProjectReaderTests-1890400111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:55:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b1c24ab2-cd6f-463a-96a2-77315925d9b2 tempest-ProjectReaderTests-1890400111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:55:03 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b1c24ab2-cd6f-463a-96a2-77315925d9b2 tempest-ProjectReaderTests-1890400111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:55:03 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b1c24ab2-cd6f-463a-96a2-77315925d9b2 tempest-ProjectReaderTests-1890400111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:55:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b1c24ab2-cd6f-463a-96a2-77315925d9b2 tempest-ProjectReaderTests-1890400111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:55:03 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b1c24ab2-cd6f-463a-96a2-77315925d9b2 tempest-ProjectReaderTests-1890400111 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:55:03 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-b1c24ab2-cd6f-463a-96a2-77315925d9b2 tempest-ProjectReaderTests-1890400111 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:55:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b1c24ab2-cd6f-463a-96a2-77315925d9b2 tempest-ProjectReaderTests-1890400111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e942d138-3199-4b29-8c12-148b8613e76e 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:03 devstack sudo[107336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e942d138-3199-4b29-8c12-148b8613e76e 1073741824
Jul 09 14:55:03 devstack sudo[107336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:03 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-180740d6-cfb7-46de-a2df-f5d5ebbf7721 tempest-ProjectReaderTests-934378749 None] Create snapshot completed successfully
Jul 09 14:55:04 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1130fc5f-ca11-46b0-9b73-20adfe12929b tempest-ProjectReaderTests-934378749 None] Acquiring lock "cinder-163808ef-083d-417a-840d-1e4fc14c81f7-delete_snapshot" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:55:04 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1130fc5f-ca11-46b0-9b73-20adfe12929b tempest-ProjectReaderTests-934378749 None] Lock "cinder-163808ef-083d-417a-840d-1e4fc14c81f7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:55:04 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1130fc5f-ca11-46b0-9b73-20adfe12929b tempest-ProjectReaderTests-934378749 None] Acquiring lock "cinder-quobyte-874bc7fc-02c7-4919-bc44-a1f2d563762e" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:55:04 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1130fc5f-ca11-46b0-9b73-20adfe12929b tempest-ProjectReaderTests-934378749 None] Lock "cinder-quobyte-874bc7fc-02c7-4919-bc44-a1f2d563762e" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:55:04 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1130fc5f-ca11-46b0-9b73-20adfe12929b tempest-ProjectReaderTests-934378749 None] Acquiring lock "cinder-quobyte-163808ef-083d-417a-840d-1e4fc14c81f7" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:55:04 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1130fc5f-ca11-46b0-9b73-20adfe12929b tempest-ProjectReaderTests-934378749 None] Lock "cinder-quobyte-163808ef-083d-417a-840d-1e4fc14c81f7" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:55:04 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-1130fc5f-ca11-46b0-9b73-20adfe12929b tempest-ProjectReaderTests-934378749 None] Deleting offline snapshot 163808ef-083d-417a-840d-1e4fc14c81f7 of volume 874bc7fc-02c7-4919-bc44-a1f2d563762e {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 14:55:04 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-1130fc5f-ca11-46b0-9b73-20adfe12929b tempest-ProjectReaderTests-934378749 None] snapshot_file for this snap is: volume-874bc7fc-02c7-4919-bc44-a1f2d563762e.163808ef-083d-417a-840d-1e4fc14c81f7 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 14:55:04 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed28115f-c45d-4647-83a8-876451548bd7]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:55:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1130fc5f-ca11-46b0-9b73-20adfe12929b tempest-ProjectReaderTests-934378749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-874bc7fc-02c7-4919-bc44-a1f2d563762e.163808ef-083d-417a-840d-1e4fc14c81f7 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:04 devstack sudo[107338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-874bc7fc-02c7-4919-bc44-a1f2d563762e.163808ef-083d-417a-840d-1e4fc14c81f7
Jul 09 14:55:04 devstack sudo[107338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:04 devstack sudo[107336]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b1c24ab2-cd6f-463a-96a2-77315925d9b2 tempest-ProjectReaderTests-1890400111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e942d138-3199-4b29-8c12-148b8613e76e 1073741824" returned: 0 in 0.832s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b1c24ab2-cd6f-463a-96a2-77315925d9b2 tempest-ProjectReaderTests-1890400111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e942d138-3199-4b29-8c12-148b8613e76e {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:04 devstack sudo[107343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e942d138-3199-4b29-8c12-148b8613e76e
Jul 09 14:55:04 devstack sudo[107343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:05 devstack sudo[107338]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1130fc5f-ca11-46b0-9b73-20adfe12929b tempest-ProjectReaderTests-934378749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-874bc7fc-02c7-4919-bc44-a1f2d563762e.163808ef-083d-417a-840d-1e4fc14c81f7" returned: 0 in 0.809s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:05 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-1130fc5f-ca11-46b0-9b73-20adfe12929b tempest-ProjectReaderTests-934378749 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-874bc7fc-02c7-4919-bc44-a1f2d563762e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 14:55:05 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[e95e728b-f63f-45ce-bf46-d55914f2c693]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:55:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1130fc5f-ca11-46b0-9b73-20adfe12929b tempest-ProjectReaderTests-934378749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-874bc7fc-02c7-4919-bc44-a1f2d563762e {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:05 devstack sudo[107348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-874bc7fc-02c7-4919-bc44-a1f2d563762e
Jul 09 14:55:05 devstack sudo[107348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:05 devstack sudo[107343]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b1c24ab2-cd6f-463a-96a2-77315925d9b2 tempest-ProjectReaderTests-1890400111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e942d138-3199-4b29-8c12-148b8613e76e" returned: 0 in 0.703s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:05 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b1c24ab2-cd6f-463a-96a2-77315925d9b2 tempest-ProjectReaderTests-1890400111 None] <== create_volume: return (1588ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:55:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b1c24ab2-cd6f-463a-96a2-77315925d9b2 tempest-ProjectReaderTests-1890400111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.592s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:55:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-35b02b12-9536-4390-9c3a-20e9b2b0e4d3 tempest-ProjectMemberTests-1092548551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.806s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:55:05 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-35b02b12-9536-4390-9c3a-20e9b2b0e4d3 tempest-ProjectMemberTests-1092548551 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:55:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1370008586',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d995214-783a-4112-8f95-6d13507320c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53e3a7b509634eeda7e218e1577efd89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:55:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:55:03Z,use_quota=True,user_id='6f31a0c3fe3e49ccabfa9bdf47df92af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:55:05 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-35b02b12-9536-4390-9c3a-20e9b2b0e4d3 tempest-ProjectMemberTests-1092548551 None] Creating volume 1d995214-783a-4112-8f95-6d13507320c4 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:55:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-35b02b12-9536-4390-9c3a-20e9b2b0e4d3 tempest-ProjectMemberTests-1092548551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:55:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-35b02b12-9536-4390-9c3a-20e9b2b0e4d3 tempest-ProjectMemberTests-1092548551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:55:05 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-35b02b12-9536-4390-9c3a-20e9b2b0e4d3 tempest-ProjectMemberTests-1092548551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:55:05 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-35b02b12-9536-4390-9c3a-20e9b2b0e4d3 tempest-ProjectMemberTests-1092548551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:55:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-35b02b12-9536-4390-9c3a-20e9b2b0e4d3 tempest-ProjectMemberTests-1092548551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:55:05 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-35b02b12-9536-4390-9c3a-20e9b2b0e4d3 tempest-ProjectMemberTests-1092548551 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:55:05 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-35b02b12-9536-4390-9c3a-20e9b2b0e4d3 tempest-ProjectMemberTests-1092548551 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:55:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-35b02b12-9536-4390-9c3a-20e9b2b0e4d3 tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1d995214-783a-4112-8f95-6d13507320c4 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:05 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b1c24ab2-cd6f-463a-96a2-77315925d9b2 tempest-ProjectReaderTests-1890400111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cabcf2ed-c953-4354-8ed1-2b9b828492a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e942d138-3199-4b29-8c12-148b8613e76e', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:55:05 devstack sudo[107351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1d995214-783a-4112-8f95-6d13507320c4 1073741824
Jul 09 14:55:05 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b1c24ab2-cd6f-463a-96a2-77315925d9b2 tempest-ProjectReaderTests-1890400111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b12d13c6-bf1f-4ab5-ba1c-f30bd026c1da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:55:05 devstack sudo[107351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:05 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-b1c24ab2-cd6f-463a-96a2-77315925d9b2 tempest-ProjectReaderTests-1890400111 None] Volume volume-e942d138-3199-4b29-8c12-148b8613e76e (e942d138-3199-4b29-8c12-148b8613e76e): created successfully
Jul 09 14:55:05 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b1c24ab2-cd6f-463a-96a2-77315925d9b2 tempest-ProjectReaderTests-1890400111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b12d13c6-bf1f-4ab5-ba1c-f30bd026c1da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:55:05 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b1c24ab2-cd6f-463a-96a2-77315925d9b2 tempest-ProjectReaderTests-1890400111 None] Flow 'volume_create_manager' (18d4333d-fd30-45c6-a727-e1a9cb2bef59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:55:05 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-b1c24ab2-cd6f-463a-96a2-77315925d9b2 tempest-ProjectReaderTests-1890400111 None] Created volume successfully.
Jul 09 14:55:05 devstack sudo[107348]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1130fc5f-ca11-46b0-9b73-20adfe12929b tempest-ProjectReaderTests-934378749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-874bc7fc-02c7-4919-bc44-a1f2d563762e" returned: 0 in 0.796s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1130fc5f-ca11-46b0-9b73-20adfe12929b tempest-ProjectReaderTests-934378749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-874bc7fc-02c7-4919-bc44-a1f2d563762e.163808ef-083d-417a-840d-1e4fc14c81f7 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:05 devstack sudo[107356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-874bc7fc-02c7-4919-bc44-a1f2d563762e.163808ef-083d-417a-840d-1e4fc14c81f7
Jul 09 14:55:05 devstack sudo[107356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:06 devstack sudo[107351]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-35b02b12-9536-4390-9c3a-20e9b2b0e4d3 tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1d995214-783a-4112-8f95-6d13507320c4 1073741824" returned: 0 in 0.836s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-35b02b12-9536-4390-9c3a-20e9b2b0e4d3 tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1d995214-783a-4112-8f95-6d13507320c4 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:06 devstack sudo[107361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1d995214-783a-4112-8f95-6d13507320c4
Jul 09 14:55:06 devstack sudo[107361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:06 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d7401a89-7f1c-48e4-a80d-c1c1a461ecc2 tempest-ProjectReaderTests-1890400111 None] Acquiring lock "cinder-e942d138-3199-4b29-8c12-148b8613e76e-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:55:06 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d7401a89-7f1c-48e4-a80d-c1c1a461ecc2 tempest-ProjectReaderTests-1890400111 None] Lock "cinder-e942d138-3199-4b29-8c12-148b8613e76e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:55:06 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d7401a89-7f1c-48e4-a80d-c1c1a461ecc2 tempest-ProjectReaderTests-1890400111 None] Acquiring lock "cinder-quobyte-e942d138-3199-4b29-8c12-148b8613e76e" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:55:06 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d7401a89-7f1c-48e4-a80d-c1c1a461ecc2 tempest-ProjectReaderTests-1890400111 None] Lock "cinder-quobyte-e942d138-3199-4b29-8c12-148b8613e76e" acquired by "delete_volume" :: waited 0.017s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:55:06 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[52fa997d-ef75-4879-b742-e2791d924939]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:55:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d7401a89-7f1c-48e4-a80d-c1c1a461ecc2 tempest-ProjectReaderTests-1890400111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e942d138-3199-4b29-8c12-148b8613e76e {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:06 devstack sudo[107367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e942d138-3199-4b29-8c12-148b8613e76e
Jul 09 14:55:06 devstack sudo[107367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:06 devstack sudo[107356]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1130fc5f-ca11-46b0-9b73-20adfe12929b tempest-ProjectReaderTests-934378749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-874bc7fc-02c7-4919-bc44-a1f2d563762e.163808ef-083d-417a-840d-1e4fc14c81f7" returned: 0 in 0.899s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1130fc5f-ca11-46b0-9b73-20adfe12929b tempest-ProjectReaderTests-934378749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-874bc7fc-02c7-4919-bc44-a1f2d563762e.163808ef-083d-417a-840d-1e4fc14c81f7 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:06 devstack sudo[107369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-874bc7fc-02c7-4919-bc44-a1f2d563762e.163808ef-083d-417a-840d-1e4fc14c81f7
Jul 09 14:55:06 devstack sudo[107369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:06 devstack sudo[107361]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-35b02b12-9536-4390-9c3a-20e9b2b0e4d3 tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1d995214-783a-4112-8f95-6d13507320c4" returned: 0 in 0.746s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:06 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-35b02b12-9536-4390-9c3a-20e9b2b0e4d3 tempest-ProjectMemberTests-1092548551 None] <== create_volume: return (1627ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:55:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-35b02b12-9536-4390-9c3a-20e9b2b0e4d3 tempest-ProjectMemberTests-1092548551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.630s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:55:07 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-35b02b12-9536-4390-9c3a-20e9b2b0e4d3 tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03901ebb-da9c-46f6-8e48-3fc1c51ff8e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d995214-783a-4112-8f95-6d13507320c4', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:55:07 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-35b02b12-9536-4390-9c3a-20e9b2b0e4d3 tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e24253ac-c92a-4033-9536-ac81cacf85f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:55:07 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-35b02b12-9536-4390-9c3a-20e9b2b0e4d3 tempest-ProjectMemberTests-1092548551 None] Volume volume-1d995214-783a-4112-8f95-6d13507320c4 (1d995214-783a-4112-8f95-6d13507320c4): created successfully
Jul 09 14:55:07 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-35b02b12-9536-4390-9c3a-20e9b2b0e4d3 tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e24253ac-c92a-4033-9536-ac81cacf85f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:55:07 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-35b02b12-9536-4390-9c3a-20e9b2b0e4d3 tempest-ProjectMemberTests-1092548551 None] Flow 'volume_create_manager' (181c8c6b-84ca-4136-aac4-2360ae8515ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:55:07 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-35b02b12-9536-4390-9c3a-20e9b2b0e4d3 tempest-ProjectMemberTests-1092548551 None] Created volume successfully.
Jul 09 14:55:07 devstack sudo[107367]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d7401a89-7f1c-48e4-a80d-c1c1a461ecc2 tempest-ProjectReaderTests-1890400111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e942d138-3199-4b29-8c12-148b8613e76e" returned: 0 in 0.810s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d7401a89-7f1c-48e4-a80d-c1c1a461ecc2 tempest-ProjectReaderTests-1890400111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e942d138-3199-4b29-8c12-148b8613e76e {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:07 devstack sudo[107376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e942d138-3199-4b29-8c12-148b8613e76e
Jul 09 14:55:07 devstack sudo[107376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:07 devstack sudo[107369]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1130fc5f-ca11-46b0-9b73-20adfe12929b tempest-ProjectReaderTests-934378749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-874bc7fc-02c7-4919-bc44-a1f2d563762e.163808ef-083d-417a-840d-1e4fc14c81f7" returned: 0 in 0.692s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:07 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1130fc5f-ca11-46b0-9b73-20adfe12929b tempest-ProjectReaderTests-934378749 None] Lock "cinder-quobyte-163808ef-083d-417a-840d-1e4fc14c81f7" released by "_delete_snapshot" :: held 3.306s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:55:07 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1130fc5f-ca11-46b0-9b73-20adfe12929b tempest-ProjectReaderTests-934378749 None] Lock "cinder-quobyte-874bc7fc-02c7-4919-bc44-a1f2d563762e" released by "delete_snapshot" :: held 3.332s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:55:07 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-1130fc5f-ca11-46b0-9b73-20adfe12929b tempest-ProjectReaderTests-934378749 None] Created reservations ['b2077692-3d78-4057-955f-74b779bf73ef', 'ba23480a-b67b-4edf-bffc-1f3f97c61a63', 'e0e71e68-7789-4698-994b-5c790e85b5b7', 'f453219a-2144-4083-84bd-a74311b1307a'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:55:07 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-1130fc5f-ca11-46b0-9b73-20adfe12929b tempest-ProjectReaderTests-934378749 None] Delete snapshot completed successfully.
Jul 09 14:55:07 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1130fc5f-ca11-46b0-9b73-20adfe12929b tempest-ProjectReaderTests-934378749 None] Lock "cinder-163808ef-083d-417a-840d-1e4fc14c81f7-delete_snapshot" released by "delete_snapshot" :: held 3.490s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:55:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-291150a9-2f1d-4c8d-8947-c9aa4243ca45 tempest-ProjectMemberTests-1092548551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:55:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-291150a9-2f1d-4c8d-8947-c9aa4243ca45 tempest-ProjectMemberTests-1092548551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:55:07 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-291150a9-2f1d-4c8d-8947-c9aa4243ca45 tempest-ProjectMemberTests-1092548551 None] Creating offline snapshot 5ad0880a-29bc-4b85-afe1-1a321d53251e of volume 1d995214-783a-4112-8f95-6d13507320c4 {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 14:55:07 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c19e7d4-084c-4c94-ac8c-553e617fc3a2]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:55:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-291150a9-2f1d-4c8d-8947-c9aa4243ca45 tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1d995214-783a-4112-8f95-6d13507320c4 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:08 devstack sudo[107378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1d995214-783a-4112-8f95-6d13507320c4
Jul 09 14:55:08 devstack sudo[107378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:08 devstack sudo[107376]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d7401a89-7f1c-48e4-a80d-c1c1a461ecc2 tempest-ProjectReaderTests-1890400111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e942d138-3199-4b29-8c12-148b8613e76e" returned: 0 in 0.657s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:08 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d7401a89-7f1c-48e4-a80d-c1c1a461ecc2 tempest-ProjectReaderTests-1890400111 None] Lock "cinder-quobyte-e942d138-3199-4b29-8c12-148b8613e76e" released by "delete_volume" :: held 1.512s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:55:08 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-d7401a89-7f1c-48e4-a80d-c1c1a461ecc2 tempest-ProjectReaderTests-1890400111 None] Created reservations ['f3c70f7c-994f-4dbb-94fa-77a0deb7bfe8', 'd46ca95c-4107-4fec-8de9-56e6a96b6c6b', '883e5555-d01c-4209-a2f9-2f929b0d554e', '01be328b-249a-415a-bf64-8eced17bd0a6'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:55:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d7401a89-7f1c-48e4-a80d-c1c1a461ecc2 tempest-ProjectReaderTests-1890400111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:55:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d7401a89-7f1c-48e4-a80d-c1c1a461ecc2 tempest-ProjectReaderTests-1890400111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:55:08 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-d7401a89-7f1c-48e4-a80d-c1c1a461ecc2 tempest-ProjectReaderTests-1890400111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:55:08 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-d7401a89-7f1c-48e4-a80d-c1c1a461ecc2 tempest-ProjectReaderTests-1890400111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:55:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d7401a89-7f1c-48e4-a80d-c1c1a461ecc2 tempest-ProjectReaderTests-1890400111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:55:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d7401a89-7f1c-48e4-a80d-c1c1a461ecc2 tempest-ProjectReaderTests-1890400111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:08 devstack sudo[107381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:55:08 devstack sudo[107381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:08 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-ad6774a6-ad69-46a1-9070-6d1ae229bb61 tempest-ProjectReaderTests-934378749 None] Acquiring lock "cinder-874bc7fc-02c7-4919-bc44-a1f2d563762e-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:55:08 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-ad6774a6-ad69-46a1-9070-6d1ae229bb61 tempest-ProjectReaderTests-934378749 None] Lock "cinder-874bc7fc-02c7-4919-bc44-a1f2d563762e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:55:08 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-ad6774a6-ad69-46a1-9070-6d1ae229bb61 tempest-ProjectReaderTests-934378749 None] Acquiring lock "cinder-quobyte-874bc7fc-02c7-4919-bc44-a1f2d563762e" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:55:08 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-ad6774a6-ad69-46a1-9070-6d1ae229bb61 tempest-ProjectReaderTests-934378749 None] Lock "cinder-quobyte-874bc7fc-02c7-4919-bc44-a1f2d563762e" acquired by "delete_volume" :: waited 0.024s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:55:08 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad091a7-982b-462d-a192-3a110773867c]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:55:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ad6774a6-ad69-46a1-9070-6d1ae229bb61 tempest-ProjectReaderTests-934378749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-874bc7fc-02c7-4919-bc44-a1f2d563762e {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:08 devstack sudo[107383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-874bc7fc-02c7-4919-bc44-a1f2d563762e
Jul 09 14:55:08 devstack sudo[107383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:08 devstack sudo[107378]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-291150a9-2f1d-4c8d-8947-c9aa4243ca45 tempest-ProjectMemberTests-1092548551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1d995214-783a-4112-8f95-6d13507320c4" returned: 0 in 0.911s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-291150a9-2f1d-4c8d-8947-c9aa4243ca45 tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1d995214-783a-4112-8f95-6d13507320c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1d995214-783a-4112-8f95-6d13507320c4.5ad0880a-29bc-4b85-afe1-1a321d53251e 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:08 devstack sudo[107388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1d995214-783a-4112-8f95-6d13507320c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1d995214-783a-4112-8f95-6d13507320c4.5ad0880a-29bc-4b85-afe1-1a321d53251e 1G
Jul 09 14:55:08 devstack sudo[107388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:09 devstack sudo[107381]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d7401a89-7f1c-48e4-a80d-c1c1a461ecc2 tempest-ProjectReaderTests-1890400111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.823s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:09 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-d7401a89-7f1c-48e4-a80d-c1c1a461ecc2 tempest-ProjectReaderTests-1890400111 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:55:09 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-d7401a89-7f1c-48e4-a80d-c1c1a461ecc2 tempest-ProjectReaderTests-1890400111 None] Deleted volume successfully.
Jul 09 14:55:09 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d7401a89-7f1c-48e4-a80d-c1c1a461ecc2 tempest-ProjectReaderTests-1890400111 None] Lock "cinder-e942d138-3199-4b29-8c12-148b8613e76e-delete_volume" released by "delete_volume" :: held 2.591s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:55:09 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-cac18051-5bac-44a0-bec9-491582788fc2 tempest-ProjectReaderTests-1890400111 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:55:09 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-cac18051-5bac-44a0-bec9-491582788fc2 tempest-ProjectReaderTests-1890400111 None] Flow 'volume_create_manager' (60846e2a-efde-484e-b41e-0278ed9f230f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:55:09 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-cac18051-5bac-44a0-bec9-491582788fc2 tempest-ProjectReaderTests-1890400111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b34cd127-0603-44ea-b6a0-d05ed5586234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:55:09 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-cac18051-5bac-44a0-bec9-491582788fc2 tempest-ProjectReaderTests-1890400111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b34cd127-0603-44ea-b6a0-d05ed5586234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:55:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-472787104',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88cc6333-bb7f-46e7-aa60-99d8c108527d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65c00229f3174f06821db0c8ac3485ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:55:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:55:09Z,use_quota=True,user_id='77387546a5754247a0d40a795e9c12d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:55:09 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-cac18051-5bac-44a0-bec9-491582788fc2 tempest-ProjectReaderTests-1890400111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e18ed2f-466c-4c42-a192-39808c265c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:55:09 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-cac18051-5bac-44a0-bec9-491582788fc2 tempest-ProjectReaderTests-1890400111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e18ed2f-466c-4c42-a192-39808c265c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:55:09 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-cac18051-5bac-44a0-bec9-491582788fc2 tempest-ProjectReaderTests-1890400111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c789cd03-2f6c-4c76-bd8b-03c17184f803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:55:09 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-cac18051-5bac-44a0-bec9-491582788fc2 tempest-ProjectReaderTests-1890400111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c789cd03-2f6c-4c76-bd8b-03c17184f803) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88cc6333-bb7f-46e7-aa60-99d8c108527d', 'volume_name': 'volume-88cc6333-bb7f-46e7-aa60-99d8c108527d', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:55:09 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-cac18051-5bac-44a0-bec9-491582788fc2 tempest-ProjectReaderTests-1890400111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d85faeb9-6e5b-4a0a-adcc-2234fb08f016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:55:09 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-cac18051-5bac-44a0-bec9-491582788fc2 tempest-ProjectReaderTests-1890400111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d85faeb9-6e5b-4a0a-adcc-2234fb08f016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:55:09 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-cac18051-5bac-44a0-bec9-491582788fc2 tempest-ProjectReaderTests-1890400111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d69062c-ba9b-4d27-a260-0ce520767531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:55:09 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-cac18051-5bac-44a0-bec9-491582788fc2 tempest-ProjectReaderTests-1890400111 None] Volume 88cc6333-bb7f-46e7-aa60-99d8c108527d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88cc6333-bb7f-46e7-aa60-99d8c108527d', 'volume_size': 1}
Jul 09 14:55:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-cac18051-5bac-44a0-bec9-491582788fc2 tempest-ProjectReaderTests-1890400111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:55:09 devstack sudo[107383]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ad6774a6-ad69-46a1-9070-6d1ae229bb61 tempest-ProjectReaderTests-934378749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-874bc7fc-02c7-4919-bc44-a1f2d563762e" returned: 0 in 1.029s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ad6774a6-ad69-46a1-9070-6d1ae229bb61 tempest-ProjectReaderTests-934378749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-874bc7fc-02c7-4919-bc44-a1f2d563762e {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:09 devstack sudo[107400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-874bc7fc-02c7-4919-bc44-a1f2d563762e
Jul 09 14:55:09 devstack sudo[107400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:09 devstack sudo[107388]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-291150a9-2f1d-4c8d-8947-c9aa4243ca45 tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1d995214-783a-4112-8f95-6d13507320c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1d995214-783a-4112-8f95-6d13507320c4.5ad0880a-29bc-4b85-afe1-1a321d53251e 1G" returned: 0 in 0.926s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-291150a9-2f1d-4c8d-8947-c9aa4243ca45 tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d995214-783a-4112-8f95-6d13507320c4 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1d995214-783a-4112-8f95-6d13507320c4.5ad0880a-29bc-4b85-afe1-1a321d53251e {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:09 devstack sudo[107402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d995214-783a-4112-8f95-6d13507320c4 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1d995214-783a-4112-8f95-6d13507320c4.5ad0880a-29bc-4b85-afe1-1a321d53251e
Jul 09 14:55:09 devstack sudo[107402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:10 devstack sudo[107400]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ad6774a6-ad69-46a1-9070-6d1ae229bb61 tempest-ProjectReaderTests-934378749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-874bc7fc-02c7-4919-bc44-a1f2d563762e" returned: 0 in 0.685s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:10 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-ad6774a6-ad69-46a1-9070-6d1ae229bb61 tempest-ProjectReaderTests-934378749 None] Lock "cinder-quobyte-874bc7fc-02c7-4919-bc44-a1f2d563762e" released by "delete_volume" :: held 1.775s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:55:10 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-ad6774a6-ad69-46a1-9070-6d1ae229bb61 tempest-ProjectReaderTests-934378749 None] Created reservations ['c85a03bd-774a-459d-be3e-babe30f9ff1e', '7833bda1-a0e9-4823-91c5-bfb57f5a52d9', 'cd1cf5ed-51be-4d97-9c15-2c51efbe2f5c', '11890ace-a22b-41b4-83e1-953646d69e81'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:55:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-ad6774a6-ad69-46a1-9070-6d1ae229bb61 tempest-ProjectReaderTests-934378749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:55:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-ad6774a6-ad69-46a1-9070-6d1ae229bb61 tempest-ProjectReaderTests-934378749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:55:10 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-ad6774a6-ad69-46a1-9070-6d1ae229bb61 tempest-ProjectReaderTests-934378749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:55:10 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-ad6774a6-ad69-46a1-9070-6d1ae229bb61 tempest-ProjectReaderTests-934378749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:55:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-ad6774a6-ad69-46a1-9070-6d1ae229bb61 tempest-ProjectReaderTests-934378749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:55:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ad6774a6-ad69-46a1-9070-6d1ae229bb61 tempest-ProjectReaderTests-934378749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:10 devstack sudo[107407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:55:10 devstack sudo[107407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:10 devstack sudo[107402]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-291150a9-2f1d-4c8d-8947-c9aa4243ca45 tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d995214-783a-4112-8f95-6d13507320c4 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1d995214-783a-4112-8f95-6d13507320c4.5ad0880a-29bc-4b85-afe1-1a321d53251e" returned: 0 in 0.749s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:10 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-291150a9-2f1d-4c8d-8947-c9aa4243ca45 tempest-ProjectMemberTests-1092548551 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1d995214-783a-4112-8f95-6d13507320c4.5ad0880a-29bc-4b85-afe1-1a321d53251e is being set with open permissions: ugo+rw
Jul 09 14:55:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-291150a9-2f1d-4c8d-8947-c9aa4243ca45 tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1d995214-783a-4112-8f95-6d13507320c4.5ad0880a-29bc-4b85-afe1-1a321d53251e {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:10 devstack sudo[107411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1d995214-783a-4112-8f95-6d13507320c4.5ad0880a-29bc-4b85-afe1-1a321d53251e
Jul 09 14:55:10 devstack sudo[107411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:11 devstack sudo[107407]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ad6774a6-ad69-46a1-9070-6d1ae229bb61 tempest-ProjectReaderTests-934378749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.731s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:11 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-ad6774a6-ad69-46a1-9070-6d1ae229bb61 tempest-ProjectReaderTests-934378749 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:55:11 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-ad6774a6-ad69-46a1-9070-6d1ae229bb61 tempest-ProjectReaderTests-934378749 None] Deleted volume successfully.
Jul 09 14:55:11 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-ad6774a6-ad69-46a1-9070-6d1ae229bb61 tempest-ProjectReaderTests-934378749 None] Lock "cinder-874bc7fc-02c7-4919-bc44-a1f2d563762e-delete_volume" released by "delete_volume" :: held 2.731s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:55:11 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-66d32176-24fd-4734-b143-ff77642fcfce tempest-ProjectReaderTests-934378749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:55:11 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-66d32176-24fd-4734-b143-ff77642fcfce tempest-ProjectReaderTests-934378749 None] Flow 'volume_create_manager' (ea9323f7-9791-4e5b-a155-c8a225c1f7b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:55:11 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-66d32176-24fd-4734-b143-ff77642fcfce tempest-ProjectReaderTests-934378749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60e7733d-b380-4ff2-b091-4454f8bc8ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:55:11 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-66d32176-24fd-4734-b143-ff77642fcfce tempest-ProjectReaderTests-934378749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60e7733d-b380-4ff2-b091-4454f8bc8ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:55:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1043475168',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0bc9f4a-b105-4439-8b64-c9d195754faa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20599830728f47858cc21c11b6e6bbac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:55:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:55:11Z,use_quota=True,user_id='a49bf6be1b4b4e2d810713bc1d8374d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:55:11 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-66d32176-24fd-4734-b143-ff77642fcfce tempest-ProjectReaderTests-934378749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a70ae90-9c21-41e3-9bc7-4464e997bfad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:55:11 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-66d32176-24fd-4734-b143-ff77642fcfce tempest-ProjectReaderTests-934378749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a70ae90-9c21-41e3-9bc7-4464e997bfad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:55:11 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-66d32176-24fd-4734-b143-ff77642fcfce tempest-ProjectReaderTests-934378749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0292041-f11c-448b-b982-6cf327285e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:55:11 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-66d32176-24fd-4734-b143-ff77642fcfce tempest-ProjectReaderTests-934378749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0292041-f11c-448b-b982-6cf327285e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0bc9f4a-b105-4439-8b64-c9d195754faa', 'volume_name': 'volume-b0bc9f4a-b105-4439-8b64-c9d195754faa', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:55:11 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-66d32176-24fd-4734-b143-ff77642fcfce tempest-ProjectReaderTests-934378749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4effb9a4-80e1-4758-91f1-cbc367e1a0a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:55:11 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-66d32176-24fd-4734-b143-ff77642fcfce tempest-ProjectReaderTests-934378749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4effb9a4-80e1-4758-91f1-cbc367e1a0a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:55:11 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-66d32176-24fd-4734-b143-ff77642fcfce tempest-ProjectReaderTests-934378749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daefed86-ad87-415d-afd0-8bb184a458b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:55:11 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-66d32176-24fd-4734-b143-ff77642fcfce tempest-ProjectReaderTests-934378749 None] Volume b0bc9f4a-b105-4439-8b64-c9d195754faa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0bc9f4a-b105-4439-8b64-c9d195754faa', 'volume_size': 1}
Jul 09 14:55:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-66d32176-24fd-4734-b143-ff77642fcfce tempest-ProjectReaderTests-934378749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:55:11 devstack sudo[107411]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-291150a9-2f1d-4c8d-8947-c9aa4243ca45 tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1d995214-783a-4112-8f95-6d13507320c4.5ad0880a-29bc-4b85-afe1-1a321d53251e" returned: 0 in 0.774s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-291150a9-2f1d-4c8d-8947-c9aa4243ca45 tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1d995214-783a-4112-8f95-6d13507320c4.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:11 devstack sudo[107416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1d995214-783a-4112-8f95-6d13507320c4.info
Jul 09 14:55:11 devstack sudo[107416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:11 devstack sudo[107416]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-291150a9-2f1d-4c8d-8947-c9aa4243ca45 tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1d995214-783a-4112-8f95-6d13507320c4.info" returned: 0 in 0.664s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:11 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-291150a9-2f1d-4c8d-8947-c9aa4243ca45 tempest-ProjectMemberTests-1092548551 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1d995214-783a-4112-8f95-6d13507320c4.info is being set with open permissions: ugo+rw
Jul 09 14:55:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-291150a9-2f1d-4c8d-8947-c9aa4243ca45 tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1d995214-783a-4112-8f95-6d13507320c4.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:11 devstack sudo[107419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1d995214-783a-4112-8f95-6d13507320c4.info
Jul 09 14:55:11 devstack sudo[107419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:12 devstack sudo[107419]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-291150a9-2f1d-4c8d-8947-c9aa4243ca45 tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1d995214-783a-4112-8f95-6d13507320c4.info" returned: 0 in 0.633s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-291150a9-2f1d-4c8d-8947-c9aa4243ca45 tempest-ProjectMemberTests-1092548551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.725s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:55:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-cac18051-5bac-44a0-bec9-491582788fc2 tempest-ProjectReaderTests-1890400111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.237s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:55:12 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-cac18051-5bac-44a0-bec9-491582788fc2 tempest-ProjectReaderTests-1890400111 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:55:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-472787104',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88cc6333-bb7f-46e7-aa60-99d8c108527d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65c00229f3174f06821db0c8ac3485ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:55:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:55:09Z,use_quota=True,user_id='77387546a5754247a0d40a795e9c12d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:55:12 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-cac18051-5bac-44a0-bec9-491582788fc2 tempest-ProjectReaderTests-1890400111 None] Creating volume 88cc6333-bb7f-46e7-aa60-99d8c108527d {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:55:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-cac18051-5bac-44a0-bec9-491582788fc2 tempest-ProjectReaderTests-1890400111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:55:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-cac18051-5bac-44a0-bec9-491582788fc2 tempest-ProjectReaderTests-1890400111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:55:12 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-cac18051-5bac-44a0-bec9-491582788fc2 tempest-ProjectReaderTests-1890400111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:55:12 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-cac18051-5bac-44a0-bec9-491582788fc2 tempest-ProjectReaderTests-1890400111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:55:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-cac18051-5bac-44a0-bec9-491582788fc2 tempest-ProjectReaderTests-1890400111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:55:12 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-cac18051-5bac-44a0-bec9-491582788fc2 tempest-ProjectReaderTests-1890400111 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:55:12 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-cac18051-5bac-44a0-bec9-491582788fc2 tempest-ProjectReaderTests-1890400111 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:55:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-cac18051-5bac-44a0-bec9-491582788fc2 tempest-ProjectReaderTests-1890400111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-88cc6333-bb7f-46e7-aa60-99d8c108527d 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:12 devstack sudo[107422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-88cc6333-bb7f-46e7-aa60-99d8c108527d 1073741824
Jul 09 14:55:12 devstack sudo[107422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:12 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-291150a9-2f1d-4c8d-8947-c9aa4243ca45 tempest-ProjectMemberTests-1092548551 None] Create snapshot completed successfully
Jul 09 14:55:13 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a4ba7f1c-da67-4e17-820d-b7245ecaf20b tempest-ProjectMemberTests-1092548551 None] Acquiring lock "cinder-5ad0880a-29bc-4b85-afe1-1a321d53251e-delete_snapshot" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:55:13 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a4ba7f1c-da67-4e17-820d-b7245ecaf20b tempest-ProjectMemberTests-1092548551 None] Lock "cinder-5ad0880a-29bc-4b85-afe1-1a321d53251e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:55:13 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a4ba7f1c-da67-4e17-820d-b7245ecaf20b tempest-ProjectMemberTests-1092548551 None] Acquiring lock "cinder-quobyte-1d995214-783a-4112-8f95-6d13507320c4" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:55:13 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a4ba7f1c-da67-4e17-820d-b7245ecaf20b tempest-ProjectMemberTests-1092548551 None] Lock "cinder-quobyte-1d995214-783a-4112-8f95-6d13507320c4" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:55:13 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a4ba7f1c-da67-4e17-820d-b7245ecaf20b tempest-ProjectMemberTests-1092548551 None] Acquiring lock "cinder-quobyte-5ad0880a-29bc-4b85-afe1-1a321d53251e" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:55:13 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a4ba7f1c-da67-4e17-820d-b7245ecaf20b tempest-ProjectMemberTests-1092548551 None] Lock "cinder-quobyte-5ad0880a-29bc-4b85-afe1-1a321d53251e" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:55:13 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-a4ba7f1c-da67-4e17-820d-b7245ecaf20b tempest-ProjectMemberTests-1092548551 None] Deleting offline snapshot 5ad0880a-29bc-4b85-afe1-1a321d53251e of volume 1d995214-783a-4112-8f95-6d13507320c4 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 14:55:13 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-a4ba7f1c-da67-4e17-820d-b7245ecaf20b tempest-ProjectMemberTests-1092548551 None] snapshot_file for this snap is: volume-1d995214-783a-4112-8f95-6d13507320c4.5ad0880a-29bc-4b85-afe1-1a321d53251e {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 14:55:13 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[40cad414-7525-4c71-83da-a4d68772194a]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:55:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a4ba7f1c-da67-4e17-820d-b7245ecaf20b tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1d995214-783a-4112-8f95-6d13507320c4.5ad0880a-29bc-4b85-afe1-1a321d53251e {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:13 devstack sudo[107427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1d995214-783a-4112-8f95-6d13507320c4.5ad0880a-29bc-4b85-afe1-1a321d53251e
Jul 09 14:55:13 devstack sudo[107427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:13 devstack sudo[107422]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-cac18051-5bac-44a0-bec9-491582788fc2 tempest-ProjectReaderTests-1890400111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-88cc6333-bb7f-46e7-aa60-99d8c108527d 1073741824" returned: 0 in 0.885s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-cac18051-5bac-44a0-bec9-491582788fc2 tempest-ProjectReaderTests-1890400111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-88cc6333-bb7f-46e7-aa60-99d8c108527d {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:13 devstack sudo[107430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-88cc6333-bb7f-46e7-aa60-99d8c108527d
Jul 09 14:55:13 devstack sudo[107430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:14 devstack sudo[107427]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a4ba7f1c-da67-4e17-820d-b7245ecaf20b tempest-ProjectMemberTests-1092548551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1d995214-783a-4112-8f95-6d13507320c4.5ad0880a-29bc-4b85-afe1-1a321d53251e" returned: 0 in 0.790s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:14 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-a4ba7f1c-da67-4e17-820d-b7245ecaf20b tempest-ProjectMemberTests-1092548551 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d995214-783a-4112-8f95-6d13507320c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 14:55:14 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4865605-a8a5-48ea-90b3-44a17c3ef45b]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:55:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a4ba7f1c-da67-4e17-820d-b7245ecaf20b tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1d995214-783a-4112-8f95-6d13507320c4 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:14 devstack sudo[107435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1d995214-783a-4112-8f95-6d13507320c4
Jul 09 14:55:14 devstack sudo[107435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:14 devstack sudo[107430]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-cac18051-5bac-44a0-bec9-491582788fc2 tempest-ProjectReaderTests-1890400111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-88cc6333-bb7f-46e7-aa60-99d8c108527d" returned: 0 in 0.680s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:14 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-cac18051-5bac-44a0-bec9-491582788fc2 tempest-ProjectReaderTests-1890400111 None] <== create_volume: return (1613ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:55:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-cac18051-5bac-44a0-bec9-491582788fc2 tempest-ProjectReaderTests-1890400111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.616s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:55:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-66d32176-24fd-4734-b143-ff77642fcfce tempest-ProjectReaderTests-934378749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.975s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:55:14 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-66d32176-24fd-4734-b143-ff77642fcfce tempest-ProjectReaderTests-934378749 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:55:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1043475168',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0bc9f4a-b105-4439-8b64-c9d195754faa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20599830728f47858cc21c11b6e6bbac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:55:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:55:11Z,use_quota=True,user_id='a49bf6be1b4b4e2d810713bc1d8374d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:55:14 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-66d32176-24fd-4734-b143-ff77642fcfce tempest-ProjectReaderTests-934378749 None] Creating volume b0bc9f4a-b105-4439-8b64-c9d195754faa {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:55:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-66d32176-24fd-4734-b143-ff77642fcfce tempest-ProjectReaderTests-934378749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:55:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-66d32176-24fd-4734-b143-ff77642fcfce tempest-ProjectReaderTests-934378749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:55:14 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-66d32176-24fd-4734-b143-ff77642fcfce tempest-ProjectReaderTests-934378749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:55:14 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-66d32176-24fd-4734-b143-ff77642fcfce tempest-ProjectReaderTests-934378749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:55:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-66d32176-24fd-4734-b143-ff77642fcfce tempest-ProjectReaderTests-934378749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:55:14 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-66d32176-24fd-4734-b143-ff77642fcfce tempest-ProjectReaderTests-934378749 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:55:14 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-66d32176-24fd-4734-b143-ff77642fcfce tempest-ProjectReaderTests-934378749 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:55:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-66d32176-24fd-4734-b143-ff77642fcfce tempest-ProjectReaderTests-934378749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b0bc9f4a-b105-4439-8b64-c9d195754faa 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-cac18051-5bac-44a0-bec9-491582788fc2 tempest-ProjectReaderTests-1890400111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d69062c-ba9b-4d27-a260-0ce520767531) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88cc6333-bb7f-46e7-aa60-99d8c108527d', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:55:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-cac18051-5bac-44a0-bec9-491582788fc2 tempest-ProjectReaderTests-1890400111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c303acd-ee47-4e60-be9c-b713a4d6aedd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:55:14 devstack sudo[107438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b0bc9f4a-b105-4439-8b64-c9d195754faa 1073741824
Jul 09 14:55:14 devstack sudo[107438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:14 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-cac18051-5bac-44a0-bec9-491582788fc2 tempest-ProjectReaderTests-1890400111 None] Volume volume-88cc6333-bb7f-46e7-aa60-99d8c108527d (88cc6333-bb7f-46e7-aa60-99d8c108527d): created successfully
Jul 09 14:55:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-cac18051-5bac-44a0-bec9-491582788fc2 tempest-ProjectReaderTests-1890400111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c303acd-ee47-4e60-be9c-b713a4d6aedd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:55:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-cac18051-5bac-44a0-bec9-491582788fc2 tempest-ProjectReaderTests-1890400111 None] Flow 'volume_create_manager' (60846e2a-efde-484e-b41e-0278ed9f230f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:55:14 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-cac18051-5bac-44a0-bec9-491582788fc2 tempest-ProjectReaderTests-1890400111 None] Created volume successfully.
Jul 09 14:55:14 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-973f219d-3bf4-49d2-a816-3bb976efd926 tempest-ProjectReaderTests-1890400111 None] Acquiring lock "cinder-88cc6333-bb7f-46e7-aa60-99d8c108527d-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:55:14 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-973f219d-3bf4-49d2-a816-3bb976efd926 tempest-ProjectReaderTests-1890400111 None] Lock "cinder-88cc6333-bb7f-46e7-aa60-99d8c108527d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:55:14 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-973f219d-3bf4-49d2-a816-3bb976efd926 tempest-ProjectReaderTests-1890400111 None] Acquiring lock "cinder-quobyte-88cc6333-bb7f-46e7-aa60-99d8c108527d" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:55:14 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-973f219d-3bf4-49d2-a816-3bb976efd926 tempest-ProjectReaderTests-1890400111 None] Lock "cinder-quobyte-88cc6333-bb7f-46e7-aa60-99d8c108527d" acquired by "delete_volume" :: waited 0.015s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:55:14 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bf31834-7725-4d46-b03c-598a0ff332d1]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:55:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-973f219d-3bf4-49d2-a816-3bb976efd926 tempest-ProjectReaderTests-1890400111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-88cc6333-bb7f-46e7-aa60-99d8c108527d {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:14 devstack sudo[107440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-88cc6333-bb7f-46e7-aa60-99d8c108527d
Jul 09 14:55:14 devstack sudo[107440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:14 devstack sudo[107435]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a4ba7f1c-da67-4e17-820d-b7245ecaf20b tempest-ProjectMemberTests-1092548551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1d995214-783a-4112-8f95-6d13507320c4" returned: 0 in 0.817s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a4ba7f1c-da67-4e17-820d-b7245ecaf20b tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1d995214-783a-4112-8f95-6d13507320c4.5ad0880a-29bc-4b85-afe1-1a321d53251e {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:14 devstack sudo[107448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1d995214-783a-4112-8f95-6d13507320c4.5ad0880a-29bc-4b85-afe1-1a321d53251e
Jul 09 14:55:14 devstack sudo[107448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:15 devstack sudo[107438]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-66d32176-24fd-4734-b143-ff77642fcfce tempest-ProjectReaderTests-934378749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b0bc9f4a-b105-4439-8b64-c9d195754faa 1073741824" returned: 0 in 0.911s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-66d32176-24fd-4734-b143-ff77642fcfce tempest-ProjectReaderTests-934378749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b0bc9f4a-b105-4439-8b64-c9d195754faa {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:15 devstack sudo[107450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b0bc9f4a-b105-4439-8b64-c9d195754faa
Jul 09 14:55:15 devstack sudo[107450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:15 devstack sudo[107440]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-973f219d-3bf4-49d2-a816-3bb976efd926 tempest-ProjectReaderTests-1890400111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-88cc6333-bb7f-46e7-aa60-99d8c108527d" returned: 0 in 0.836s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-973f219d-3bf4-49d2-a816-3bb976efd926 tempest-ProjectReaderTests-1890400111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-88cc6333-bb7f-46e7-aa60-99d8c108527d {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:15 devstack sudo[107458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-88cc6333-bb7f-46e7-aa60-99d8c108527d
Jul 09 14:55:15 devstack sudo[107458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:15 devstack sudo[107448]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a4ba7f1c-da67-4e17-820d-b7245ecaf20b tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1d995214-783a-4112-8f95-6d13507320c4.5ad0880a-29bc-4b85-afe1-1a321d53251e" returned: 0 in 0.832s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a4ba7f1c-da67-4e17-820d-b7245ecaf20b tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1d995214-783a-4112-8f95-6d13507320c4.5ad0880a-29bc-4b85-afe1-1a321d53251e {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:15 devstack sudo[107460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1d995214-783a-4112-8f95-6d13507320c4.5ad0880a-29bc-4b85-afe1-1a321d53251e
Jul 09 14:55:15 devstack sudo[107460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:15 devstack sudo[107450]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-66d32176-24fd-4734-b143-ff77642fcfce tempest-ProjectReaderTests-934378749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b0bc9f4a-b105-4439-8b64-c9d195754faa" returned: 0 in 0.672s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:15 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-66d32176-24fd-4734-b143-ff77642fcfce tempest-ProjectReaderTests-934378749 None] <== create_volume: return (1659ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:55:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-66d32176-24fd-4734-b143-ff77642fcfce tempest-ProjectReaderTests-934378749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.662s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:55:15 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-66d32176-24fd-4734-b143-ff77642fcfce tempest-ProjectReaderTests-934378749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daefed86-ad87-415d-afd0-8bb184a458b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0bc9f4a-b105-4439-8b64-c9d195754faa', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:55:15 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-66d32176-24fd-4734-b143-ff77642fcfce tempest-ProjectReaderTests-934378749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40e93fd6-a48a-4f7c-95d3-4de9d534eaad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:55:15 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-66d32176-24fd-4734-b143-ff77642fcfce tempest-ProjectReaderTests-934378749 None] Volume volume-b0bc9f4a-b105-4439-8b64-c9d195754faa (b0bc9f4a-b105-4439-8b64-c9d195754faa): created successfully
Jul 09 14:55:15 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-66d32176-24fd-4734-b143-ff77642fcfce tempest-ProjectReaderTests-934378749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40e93fd6-a48a-4f7c-95d3-4de9d534eaad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:55:15 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-66d32176-24fd-4734-b143-ff77642fcfce tempest-ProjectReaderTests-934378749 None] Flow 'volume_create_manager' (ea9323f7-9791-4e5b-a155-c8a225c1f7b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:55:15 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-66d32176-24fd-4734-b143-ff77642fcfce tempest-ProjectReaderTests-934378749 None] Created volume successfully.
Jul 09 14:55:16 devstack sudo[107458]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-973f219d-3bf4-49d2-a816-3bb976efd926 tempest-ProjectReaderTests-1890400111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-88cc6333-bb7f-46e7-aa60-99d8c108527d" returned: 0 in 0.714s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:16 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-973f219d-3bf4-49d2-a816-3bb976efd926 tempest-ProjectReaderTests-1890400111 None] Lock "cinder-quobyte-88cc6333-bb7f-46e7-aa60-99d8c108527d" released by "delete_volume" :: held 1.602s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:55:16 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-973f219d-3bf4-49d2-a816-3bb976efd926 tempest-ProjectReaderTests-1890400111 None] Created reservations ['ec9e7bde-3b5a-4f86-b897-e204992598a0', 'b29267a7-ad92-487c-a98e-7b5688a53e78', '38eee0b9-dc11-4b16-8449-35c73f693ebc', '84ac63f3-d339-43d5-9c81-1de250d180a2'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:55:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-973f219d-3bf4-49d2-a816-3bb976efd926 tempest-ProjectReaderTests-1890400111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:55:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-973f219d-3bf4-49d2-a816-3bb976efd926 tempest-ProjectReaderTests-1890400111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:55:16 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-973f219d-3bf4-49d2-a816-3bb976efd926 tempest-ProjectReaderTests-1890400111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:55:16 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-973f219d-3bf4-49d2-a816-3bb976efd926 tempest-ProjectReaderTests-1890400111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:55:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-973f219d-3bf4-49d2-a816-3bb976efd926 tempest-ProjectReaderTests-1890400111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:55:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-973f219d-3bf4-49d2-a816-3bb976efd926 tempest-ProjectReaderTests-1890400111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:16 devstack sudo[107465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:55:16 devstack sudo[107465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:16 devstack sudo[107460]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a4ba7f1c-da67-4e17-820d-b7245ecaf20b tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1d995214-783a-4112-8f95-6d13507320c4.5ad0880a-29bc-4b85-afe1-1a321d53251e" returned: 0 in 0.694s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:16 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a4ba7f1c-da67-4e17-820d-b7245ecaf20b tempest-ProjectMemberTests-1092548551 None] Lock "cinder-quobyte-5ad0880a-29bc-4b85-afe1-1a321d53251e" released by "_delete_snapshot" :: held 3.228s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:55:16 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a4ba7f1c-da67-4e17-820d-b7245ecaf20b tempest-ProjectMemberTests-1092548551 None] Lock "cinder-quobyte-1d995214-783a-4112-8f95-6d13507320c4" released by "delete_snapshot" :: held 3.254s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:55:16 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-a4ba7f1c-da67-4e17-820d-b7245ecaf20b tempest-ProjectMemberTests-1092548551 None] Created reservations ['961d31a0-7cba-4cff-88fd-0a10ca91f66e', '698735e9-d9a0-46dd-89e9-5dc0c9bca6ec', 'bc606967-516e-4056-aad7-491982cbcbf2', '95f15314-4e12-4001-98fa-a1d27cccbac7'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:55:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f33abae5-bc2b-45d7-b581-6e7c0ee0c1ae tempest-ProjectReaderTests-934378749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:55:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f33abae5-bc2b-45d7-b581-6e7c0ee0c1ae tempest-ProjectReaderTests-934378749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:55:16 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-a4ba7f1c-da67-4e17-820d-b7245ecaf20b tempest-ProjectMemberTests-1092548551 None] Delete snapshot completed successfully.
Jul 09 14:55:16 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-f33abae5-bc2b-45d7-b581-6e7c0ee0c1ae tempest-ProjectReaderTests-934378749 None] Creating offline snapshot 5d24cf8c-fa5f-4d92-b491-ec8ccaa9f281 of volume b0bc9f4a-b105-4439-8b64-c9d195754faa {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 14:55:16 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a4ba7f1c-da67-4e17-820d-b7245ecaf20b tempest-ProjectMemberTests-1092548551 None] Lock "cinder-5ad0880a-29bc-4b85-afe1-1a321d53251e-delete_snapshot" released by "delete_snapshot" :: held 3.481s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:55:16 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[82673089-e07c-4124-ba04-15b26aaca3ff]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:55:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f33abae5-bc2b-45d7-b581-6e7c0ee0c1ae tempest-ProjectReaderTests-934378749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b0bc9f4a-b105-4439-8b64-c9d195754faa {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:16 devstack sudo[107467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b0bc9f4a-b105-4439-8b64-c9d195754faa
Jul 09 14:55:16 devstack sudo[107467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:17 devstack sudo[107465]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-973f219d-3bf4-49d2-a816-3bb976efd926 tempest-ProjectReaderTests-1890400111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.691s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:17 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-973f219d-3bf4-49d2-a816-3bb976efd926 tempest-ProjectReaderTests-1890400111 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:55:17 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-973f219d-3bf4-49d2-a816-3bb976efd926 tempest-ProjectReaderTests-1890400111 None] Deleted volume successfully.
Jul 09 14:55:17 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-973f219d-3bf4-49d2-a816-3bb976efd926 tempest-ProjectReaderTests-1890400111 None] Lock "cinder-88cc6333-bb7f-46e7-aa60-99d8c108527d-delete_volume" released by "delete_volume" :: held 2.529s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:55:17 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-5483957c-6288-44d9-aedb-0b0986212c8c tempest-ProjectMemberTests-1092548551 None] Acquiring lock "cinder-1d995214-783a-4112-8f95-6d13507320c4-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:55:17 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-5483957c-6288-44d9-aedb-0b0986212c8c tempest-ProjectMemberTests-1092548551 None] Lock "cinder-1d995214-783a-4112-8f95-6d13507320c4-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:55:17 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-5483957c-6288-44d9-aedb-0b0986212c8c tempest-ProjectMemberTests-1092548551 None] Acquiring lock "cinder-quobyte-1d995214-783a-4112-8f95-6d13507320c4" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:55:17 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-5483957c-6288-44d9-aedb-0b0986212c8c tempest-ProjectMemberTests-1092548551 None] Lock "cinder-quobyte-1d995214-783a-4112-8f95-6d13507320c4" acquired by "delete_volume" :: waited 0.014s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:55:17 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c30375-0bda-44b4-bfaa-ea2b56caf6a2]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:55:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5483957c-6288-44d9-aedb-0b0986212c8c tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1d995214-783a-4112-8f95-6d13507320c4 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:17 devstack sudo[107467]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f33abae5-bc2b-45d7-b581-6e7c0ee0c1ae tempest-ProjectReaderTests-934378749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b0bc9f4a-b105-4439-8b64-c9d195754faa" returned: 0 in 0.920s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f33abae5-bc2b-45d7-b581-6e7c0ee0c1ae tempest-ProjectReaderTests-934378749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b0bc9f4a-b105-4439-8b64-c9d195754faa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b0bc9f4a-b105-4439-8b64-c9d195754faa.5d24cf8c-fa5f-4d92-b491-ec8ccaa9f281 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:17 devstack sudo[107475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b0bc9f4a-b105-4439-8b64-c9d195754faa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b0bc9f4a-b105-4439-8b64-c9d195754faa.5d24cf8c-fa5f-4d92-b491-ec8ccaa9f281 1G
Jul 09 14:55:17 devstack sudo[107475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:17 devstack sudo[107474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1d995214-783a-4112-8f95-6d13507320c4
Jul 09 14:55:17 devstack sudo[107474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:18 devstack sudo[107474]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5483957c-6288-44d9-aedb-0b0986212c8c tempest-ProjectMemberTests-1092548551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1d995214-783a-4112-8f95-6d13507320c4" returned: 0 in 0.865s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5483957c-6288-44d9-aedb-0b0986212c8c tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1d995214-783a-4112-8f95-6d13507320c4 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:18 devstack sudo[107484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1d995214-783a-4112-8f95-6d13507320c4
Jul 09 14:55:18 devstack sudo[107484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:18 devstack sudo[107475]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f33abae5-bc2b-45d7-b581-6e7c0ee0c1ae tempest-ProjectReaderTests-934378749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b0bc9f4a-b105-4439-8b64-c9d195754faa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b0bc9f4a-b105-4439-8b64-c9d195754faa.5d24cf8c-fa5f-4d92-b491-ec8ccaa9f281 1G" returned: 0 in 1.018s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f33abae5-bc2b-45d7-b581-6e7c0ee0c1ae tempest-ProjectReaderTests-934378749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0bc9f4a-b105-4439-8b64-c9d195754faa -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b0bc9f4a-b105-4439-8b64-c9d195754faa.5d24cf8c-fa5f-4d92-b491-ec8ccaa9f281 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:18 devstack sudo[107486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0bc9f4a-b105-4439-8b64-c9d195754faa -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b0bc9f4a-b105-4439-8b64-c9d195754faa.5d24cf8c-fa5f-4d92-b491-ec8ccaa9f281
Jul 09 14:55:18 devstack sudo[107486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:19 devstack sudo[107484]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5483957c-6288-44d9-aedb-0b0986212c8c tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-1d995214-783a-4112-8f95-6d13507320c4" returned: 0 in 0.662s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:19 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-5483957c-6288-44d9-aedb-0b0986212c8c tempest-ProjectMemberTests-1092548551 None] Lock "cinder-quobyte-1d995214-783a-4112-8f95-6d13507320c4" released by "delete_volume" :: held 1.598s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:55:19 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-5483957c-6288-44d9-aedb-0b0986212c8c tempest-ProjectMemberTests-1092548551 None] Created reservations ['eca1500e-e762-4b12-ab16-e2c136020345', '83e42527-5486-43b5-85e7-97a82e04bd8e', 'c3d4024e-f1da-411e-96f4-b4564c3bbd77', '9f0a4635-fcc7-4405-a0e6-db3acef77f2e'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:55:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5483957c-6288-44d9-aedb-0b0986212c8c tempest-ProjectMemberTests-1092548551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:55:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5483957c-6288-44d9-aedb-0b0986212c8c tempest-ProjectMemberTests-1092548551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:55:19 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-5483957c-6288-44d9-aedb-0b0986212c8c tempest-ProjectMemberTests-1092548551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:55:19 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-5483957c-6288-44d9-aedb-0b0986212c8c tempest-ProjectMemberTests-1092548551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:55:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5483957c-6288-44d9-aedb-0b0986212c8c tempest-ProjectMemberTests-1092548551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:55:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5483957c-6288-44d9-aedb-0b0986212c8c tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:19 devstack sudo[107493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:55:19 devstack sudo[107493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:19 devstack sudo[107486]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f33abae5-bc2b-45d7-b581-6e7c0ee0c1ae tempest-ProjectReaderTests-934378749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0bc9f4a-b105-4439-8b64-c9d195754faa -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b0bc9f4a-b105-4439-8b64-c9d195754faa.5d24cf8c-fa5f-4d92-b491-ec8ccaa9f281" returned: 0 in 0.724s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:19 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-f33abae5-bc2b-45d7-b581-6e7c0ee0c1ae tempest-ProjectReaderTests-934378749 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b0bc9f4a-b105-4439-8b64-c9d195754faa.5d24cf8c-fa5f-4d92-b491-ec8ccaa9f281 is being set with open permissions: ugo+rw
Jul 09 14:55:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f33abae5-bc2b-45d7-b581-6e7c0ee0c1ae tempest-ProjectReaderTests-934378749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b0bc9f4a-b105-4439-8b64-c9d195754faa.5d24cf8c-fa5f-4d92-b491-ec8ccaa9f281 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:19 devstack sudo[107495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b0bc9f4a-b105-4439-8b64-c9d195754faa.5d24cf8c-fa5f-4d92-b491-ec8ccaa9f281
Jul 09 14:55:19 devstack sudo[107495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:19 devstack sudo[107493]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5483957c-6288-44d9-aedb-0b0986212c8c tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.674s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:19 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-5483957c-6288-44d9-aedb-0b0986212c8c tempest-ProjectMemberTests-1092548551 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:55:19 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-5483957c-6288-44d9-aedb-0b0986212c8c tempest-ProjectMemberTests-1092548551 None] Deleted volume successfully.
Jul 09 14:55:19 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-5483957c-6288-44d9-aedb-0b0986212c8c tempest-ProjectMemberTests-1092548551 None] Lock "cinder-1d995214-783a-4112-8f95-6d13507320c4-delete_volume" released by "delete_volume" :: held 2.491s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:55:20 devstack sudo[107495]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f33abae5-bc2b-45d7-b581-6e7c0ee0c1ae tempest-ProjectReaderTests-934378749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b0bc9f4a-b105-4439-8b64-c9d195754faa.5d24cf8c-fa5f-4d92-b491-ec8ccaa9f281" returned: 0 in 0.658s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f33abae5-bc2b-45d7-b581-6e7c0ee0c1ae tempest-ProjectReaderTests-934378749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b0bc9f4a-b105-4439-8b64-c9d195754faa.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:20 devstack sudo[107499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b0bc9f4a-b105-4439-8b64-c9d195754faa.info
Jul 09 14:55:20 devstack sudo[107499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:20 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-82f33bb7-8545-49c7-aa3e-8d55a7cfe55a tempest-ProjectMemberTests-1092548551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:55:20 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-82f33bb7-8545-49c7-aa3e-8d55a7cfe55a tempest-ProjectMemberTests-1092548551 None] Flow 'volume_create_manager' (6da4cd59-bcb2-4d4f-80ab-b32e9423dc2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:55:20 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-82f33bb7-8545-49c7-aa3e-8d55a7cfe55a tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dc9efbe-cc73-46c3-87c0-3bf418077925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:55:20 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-82f33bb7-8545-49c7-aa3e-8d55a7cfe55a tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dc9efbe-cc73-46c3-87c0-3bf418077925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:55:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1720503107',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=079d9980-dac5-49be-9756-78f8827cd167,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53e3a7b509634eeda7e218e1577efd89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:55:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:55:20Z,use_quota=True,user_id='6f31a0c3fe3e49ccabfa9bdf47df92af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:55:20 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-82f33bb7-8545-49c7-aa3e-8d55a7cfe55a tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82ad6a9b-d063-423f-a90a-cc7353df9cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:55:20 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-82f33bb7-8545-49c7-aa3e-8d55a7cfe55a tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82ad6a9b-d063-423f-a90a-cc7353df9cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:55:20 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-82f33bb7-8545-49c7-aa3e-8d55a7cfe55a tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8e8c9e5-e090-4e57-b527-6c957da5397c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:55:20 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-82f33bb7-8545-49c7-aa3e-8d55a7cfe55a tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8e8c9e5-e090-4e57-b527-6c957da5397c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '079d9980-dac5-49be-9756-78f8827cd167', 'volume_name': 'volume-079d9980-dac5-49be-9756-78f8827cd167', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:55:20 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-82f33bb7-8545-49c7-aa3e-8d55a7cfe55a tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66669cfb-536e-4547-875f-2b5cc0376d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:55:20 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-82f33bb7-8545-49c7-aa3e-8d55a7cfe55a tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66669cfb-536e-4547-875f-2b5cc0376d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:55:20 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-82f33bb7-8545-49c7-aa3e-8d55a7cfe55a tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa26ed0e-5e00-487c-aa45-b4ec77b69039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:55:20 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-82f33bb7-8545-49c7-aa3e-8d55a7cfe55a tempest-ProjectMemberTests-1092548551 None] Volume 079d9980-dac5-49be-9756-78f8827cd167: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-079d9980-dac5-49be-9756-78f8827cd167', 'volume_size': 1}
Jul 09 14:55:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-82f33bb7-8545-49c7-aa3e-8d55a7cfe55a tempest-ProjectMemberTests-1092548551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:55:20 devstack sudo[107499]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f33abae5-bc2b-45d7-b581-6e7c0ee0c1ae tempest-ProjectReaderTests-934378749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b0bc9f4a-b105-4439-8b64-c9d195754faa.info" returned: 0 in 0.660s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:20 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-f33abae5-bc2b-45d7-b581-6e7c0ee0c1ae tempest-ProjectReaderTests-934378749 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b0bc9f4a-b105-4439-8b64-c9d195754faa.info is being set with open permissions: ugo+rw
Jul 09 14:55:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f33abae5-bc2b-45d7-b581-6e7c0ee0c1ae tempest-ProjectReaderTests-934378749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b0bc9f4a-b105-4439-8b64-c9d195754faa.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:20 devstack sudo[107502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b0bc9f4a-b105-4439-8b64-c9d195754faa.info
Jul 09 14:55:20 devstack sudo[107502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:21 devstack sudo[107502]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f33abae5-bc2b-45d7-b581-6e7c0ee0c1ae tempest-ProjectReaderTests-934378749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b0bc9f4a-b105-4439-8b64-c9d195754faa.info" returned: 0 in 0.640s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f33abae5-bc2b-45d7-b581-6e7c0ee0c1ae tempest-ProjectReaderTests-934378749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.722s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:55:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-82f33bb7-8545-49c7-aa3e-8d55a7cfe55a tempest-ProjectMemberTests-1092548551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.133s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:55:21 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-82f33bb7-8545-49c7-aa3e-8d55a7cfe55a tempest-ProjectMemberTests-1092548551 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:55:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1720503107',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=079d9980-dac5-49be-9756-78f8827cd167,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53e3a7b509634eeda7e218e1577efd89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:55:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:55:20Z,use_quota=True,user_id='6f31a0c3fe3e49ccabfa9bdf47df92af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:55:21 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-82f33bb7-8545-49c7-aa3e-8d55a7cfe55a tempest-ProjectMemberTests-1092548551 None] Creating volume 079d9980-dac5-49be-9756-78f8827cd167 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:55:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-82f33bb7-8545-49c7-aa3e-8d55a7cfe55a tempest-ProjectMemberTests-1092548551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:55:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-82f33bb7-8545-49c7-aa3e-8d55a7cfe55a tempest-ProjectMemberTests-1092548551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:55:21 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-82f33bb7-8545-49c7-aa3e-8d55a7cfe55a tempest-ProjectMemberTests-1092548551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:55:21 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-82f33bb7-8545-49c7-aa3e-8d55a7cfe55a tempest-ProjectMemberTests-1092548551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:55:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-82f33bb7-8545-49c7-aa3e-8d55a7cfe55a tempest-ProjectMemberTests-1092548551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:55:21 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-82f33bb7-8545-49c7-aa3e-8d55a7cfe55a tempest-ProjectMemberTests-1092548551 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:55:21 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-82f33bb7-8545-49c7-aa3e-8d55a7cfe55a tempest-ProjectMemberTests-1092548551 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:55:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-82f33bb7-8545-49c7-aa3e-8d55a7cfe55a tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-079d9980-dac5-49be-9756-78f8827cd167 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:21 devstack sudo[107508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-079d9980-dac5-49be-9756-78f8827cd167 1073741824
Jul 09 14:55:21 devstack sudo[107508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:21 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-f33abae5-bc2b-45d7-b581-6e7c0ee0c1ae tempest-ProjectReaderTests-934378749 None] Create snapshot completed successfully
Jul 09 14:55:21 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-860c0531-e8ab-432e-8436-6aa40b8fdc2d tempest-ProjectReaderTests-934378749 None] Acquiring lock "cinder-5d24cf8c-fa5f-4d92-b491-ec8ccaa9f281-delete_snapshot" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:55:21 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-860c0531-e8ab-432e-8436-6aa40b8fdc2d tempest-ProjectReaderTests-934378749 None] Lock "cinder-5d24cf8c-fa5f-4d92-b491-ec8ccaa9f281-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:55:21 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-860c0531-e8ab-432e-8436-6aa40b8fdc2d tempest-ProjectReaderTests-934378749 None] Acquiring lock "cinder-quobyte-b0bc9f4a-b105-4439-8b64-c9d195754faa" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:55:21 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-860c0531-e8ab-432e-8436-6aa40b8fdc2d tempest-ProjectReaderTests-934378749 None] Lock "cinder-quobyte-b0bc9f4a-b105-4439-8b64-c9d195754faa" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:55:21 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-860c0531-e8ab-432e-8436-6aa40b8fdc2d tempest-ProjectReaderTests-934378749 None] Acquiring lock "cinder-quobyte-5d24cf8c-fa5f-4d92-b491-ec8ccaa9f281" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:55:21 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-860c0531-e8ab-432e-8436-6aa40b8fdc2d tempest-ProjectReaderTests-934378749 None] Lock "cinder-quobyte-5d24cf8c-fa5f-4d92-b491-ec8ccaa9f281" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:55:21 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-860c0531-e8ab-432e-8436-6aa40b8fdc2d tempest-ProjectReaderTests-934378749 None] Deleting offline snapshot 5d24cf8c-fa5f-4d92-b491-ec8ccaa9f281 of volume b0bc9f4a-b105-4439-8b64-c9d195754faa {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 14:55:21 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-860c0531-e8ab-432e-8436-6aa40b8fdc2d tempest-ProjectReaderTests-934378749 None] snapshot_file for this snap is: volume-b0bc9f4a-b105-4439-8b64-c9d195754faa.5d24cf8c-fa5f-4d92-b491-ec8ccaa9f281 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 14:55:21 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[5062cf99-0251-4ad7-b7b3-7ca5f1c189c8]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:55:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-860c0531-e8ab-432e-8436-6aa40b8fdc2d tempest-ProjectReaderTests-934378749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b0bc9f4a-b105-4439-8b64-c9d195754faa.5d24cf8c-fa5f-4d92-b491-ec8ccaa9f281 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:22 devstack sudo[107513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b0bc9f4a-b105-4439-8b64-c9d195754faa.5d24cf8c-fa5f-4d92-b491-ec8ccaa9f281
Jul 09 14:55:22 devstack sudo[107513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:22 devstack sudo[107508]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-82f33bb7-8545-49c7-aa3e-8d55a7cfe55a tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-079d9980-dac5-49be-9756-78f8827cd167 1073741824" returned: 0 in 0.862s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-82f33bb7-8545-49c7-aa3e-8d55a7cfe55a tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-079d9980-dac5-49be-9756-78f8827cd167 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:22 devstack sudo[107516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-079d9980-dac5-49be-9756-78f8827cd167
Jul 09 14:55:22 devstack sudo[107516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:22 devstack sudo[107513]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-860c0531-e8ab-432e-8436-6aa40b8fdc2d tempest-ProjectReaderTests-934378749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b0bc9f4a-b105-4439-8b64-c9d195754faa.5d24cf8c-fa5f-4d92-b491-ec8ccaa9f281" returned: 0 in 0.781s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:22 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-860c0531-e8ab-432e-8436-6aa40b8fdc2d tempest-ProjectReaderTests-934378749 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0bc9f4a-b105-4439-8b64-c9d195754faa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 14:55:22 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[de20b481-70e0-4869-83ad-f7f3c3ab02c2]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:55:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-860c0531-e8ab-432e-8436-6aa40b8fdc2d tempest-ProjectReaderTests-934378749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b0bc9f4a-b105-4439-8b64-c9d195754faa {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:22 devstack sudo[107516]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-82f33bb7-8545-49c7-aa3e-8d55a7cfe55a tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-079d9980-dac5-49be-9756-78f8827cd167" returned: 0 in 0.615s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:22 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-82f33bb7-8545-49c7-aa3e-8d55a7cfe55a tempest-ProjectMemberTests-1092548551 None] <== create_volume: return (1515ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:55:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-82f33bb7-8545-49c7-aa3e-8d55a7cfe55a tempest-ProjectMemberTests-1092548551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.518s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:55:22 devstack sudo[107522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b0bc9f4a-b105-4439-8b64-c9d195754faa
Jul 09 14:55:22 devstack sudo[107522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:22 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-82f33bb7-8545-49c7-aa3e-8d55a7cfe55a tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa26ed0e-5e00-487c-aa45-b4ec77b69039) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-079d9980-dac5-49be-9756-78f8827cd167', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:55:22 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-82f33bb7-8545-49c7-aa3e-8d55a7cfe55a tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11032548-7a5a-4dce-b917-7d83247560bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:55:22 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-82f33bb7-8545-49c7-aa3e-8d55a7cfe55a tempest-ProjectMemberTests-1092548551 None] Volume volume-079d9980-dac5-49be-9756-78f8827cd167 (079d9980-dac5-49be-9756-78f8827cd167): created successfully
Jul 09 14:55:22 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-82f33bb7-8545-49c7-aa3e-8d55a7cfe55a tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11032548-7a5a-4dce-b917-7d83247560bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:55:22 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-82f33bb7-8545-49c7-aa3e-8d55a7cfe55a tempest-ProjectMemberTests-1092548551 None] Flow 'volume_create_manager' (6da4cd59-bcb2-4d4f-80ab-b32e9423dc2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:55:22 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-82f33bb7-8545-49c7-aa3e-8d55a7cfe55a tempest-ProjectMemberTests-1092548551 None] Created volume successfully.
Jul 09 14:55:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7c9890c3-6885-478d-ae1a-630011a4fd7a tempest-ProjectMemberTests-1092548551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:55:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7c9890c3-6885-478d-ae1a-630011a4fd7a tempest-ProjectMemberTests-1092548551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:55:23 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-7c9890c3-6885-478d-ae1a-630011a4fd7a tempest-ProjectMemberTests-1092548551 None] Creating offline snapshot d4a46eb3-3794-4d83-ba3a-e4798802ad1b of volume 079d9980-dac5-49be-9756-78f8827cd167 {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 14:55:23 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[91a8669a-12e8-454e-927b-3236df7191ae]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:55:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7c9890c3-6885-478d-ae1a-630011a4fd7a tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-079d9980-dac5-49be-9756-78f8827cd167 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:23 devstack sudo[107522]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-860c0531-e8ab-432e-8436-6aa40b8fdc2d tempest-ProjectReaderTests-934378749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b0bc9f4a-b105-4439-8b64-c9d195754faa" returned: 0 in 0.764s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-860c0531-e8ab-432e-8436-6aa40b8fdc2d tempest-ProjectReaderTests-934378749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b0bc9f4a-b105-4439-8b64-c9d195754faa.5d24cf8c-fa5f-4d92-b491-ec8ccaa9f281 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:23 devstack sudo[107528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b0bc9f4a-b105-4439-8b64-c9d195754faa.5d24cf8c-fa5f-4d92-b491-ec8ccaa9f281
Jul 09 14:55:23 devstack sudo[107528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:23 devstack sudo[107527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-079d9980-dac5-49be-9756-78f8827cd167
Jul 09 14:55:23 devstack sudo[107527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:24 devstack sudo[107527]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7c9890c3-6885-478d-ae1a-630011a4fd7a tempest-ProjectMemberTests-1092548551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-079d9980-dac5-49be-9756-78f8827cd167" returned: 0 in 0.739s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7c9890c3-6885-478d-ae1a-630011a4fd7a tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-079d9980-dac5-49be-9756-78f8827cd167,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-079d9980-dac5-49be-9756-78f8827cd167.d4a46eb3-3794-4d83-ba3a-e4798802ad1b 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:24 devstack sudo[107537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-079d9980-dac5-49be-9756-78f8827cd167,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-079d9980-dac5-49be-9756-78f8827cd167.d4a46eb3-3794-4d83-ba3a-e4798802ad1b 1G
Jul 09 14:55:24 devstack sudo[107537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:24 devstack sudo[107528]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-860c0531-e8ab-432e-8436-6aa40b8fdc2d tempest-ProjectReaderTests-934378749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b0bc9f4a-b105-4439-8b64-c9d195754faa.5d24cf8c-fa5f-4d92-b491-ec8ccaa9f281" returned: 0 in 0.749s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-860c0531-e8ab-432e-8436-6aa40b8fdc2d tempest-ProjectReaderTests-934378749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b0bc9f4a-b105-4439-8b64-c9d195754faa.5d24cf8c-fa5f-4d92-b491-ec8ccaa9f281 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:24 devstack sudo[107539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b0bc9f4a-b105-4439-8b64-c9d195754faa.5d24cf8c-fa5f-4d92-b491-ec8ccaa9f281
Jul 09 14:55:24 devstack sudo[107539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:24 devstack sudo[107539]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-860c0531-e8ab-432e-8436-6aa40b8fdc2d tempest-ProjectReaderTests-934378749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b0bc9f4a-b105-4439-8b64-c9d195754faa.5d24cf8c-fa5f-4d92-b491-ec8ccaa9f281" returned: 0 in 0.693s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:25 devstack sudo[107537]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7c9890c3-6885-478d-ae1a-630011a4fd7a tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-079d9980-dac5-49be-9756-78f8827cd167,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-079d9980-dac5-49be-9756-78f8827cd167.d4a46eb3-3794-4d83-ba3a-e4798802ad1b 1G" returned: 0 in 0.820s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7c9890c3-6885-478d-ae1a-630011a4fd7a tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-079d9980-dac5-49be-9756-78f8827cd167 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-079d9980-dac5-49be-9756-78f8827cd167.d4a46eb3-3794-4d83-ba3a-e4798802ad1b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:25 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-860c0531-e8ab-432e-8436-6aa40b8fdc2d tempest-ProjectReaderTests-934378749 None] Lock "cinder-quobyte-5d24cf8c-fa5f-4d92-b491-ec8ccaa9f281" released by "_delete_snapshot" :: held 3.102s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:55:25 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-860c0531-e8ab-432e-8436-6aa40b8fdc2d tempest-ProjectReaderTests-934378749 None] Lock "cinder-quobyte-b0bc9f4a-b105-4439-8b64-c9d195754faa" released by "delete_snapshot" :: held 3.127s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:55:25 devstack sudo[107545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-079d9980-dac5-49be-9756-78f8827cd167 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-079d9980-dac5-49be-9756-78f8827cd167.d4a46eb3-3794-4d83-ba3a-e4798802ad1b
Jul 09 14:55:25 devstack sudo[107545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:25 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-860c0531-e8ab-432e-8436-6aa40b8fdc2d tempest-ProjectReaderTests-934378749 None] Created reservations ['b0c6ffc0-a325-4a6d-83e1-54a5c41733f4', 'f858c390-df2f-4284-b253-f06fd2089131', '7aa8ef96-bcae-4162-895e-18e4a86ab2e3', 'a0103c14-f3ed-4535-9f5b-e1cdc4e422c9'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:55:25 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-860c0531-e8ab-432e-8436-6aa40b8fdc2d tempest-ProjectReaderTests-934378749 None] Delete snapshot completed successfully.
Jul 09 14:55:25 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-860c0531-e8ab-432e-8436-6aa40b8fdc2d tempest-ProjectReaderTests-934378749 None] Lock "cinder-5d24cf8c-fa5f-4d92-b491-ec8ccaa9f281-delete_snapshot" released by "delete_snapshot" :: held 3.322s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:55:25 devstack sudo[107545]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7c9890c3-6885-478d-ae1a-630011a4fd7a tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-079d9980-dac5-49be-9756-78f8827cd167 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-079d9980-dac5-49be-9756-78f8827cd167.d4a46eb3-3794-4d83-ba3a-e4798802ad1b" returned: 0 in 0.701s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:25 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-7c9890c3-6885-478d-ae1a-630011a4fd7a tempest-ProjectMemberTests-1092548551 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-079d9980-dac5-49be-9756-78f8827cd167.d4a46eb3-3794-4d83-ba3a-e4798802ad1b is being set with open permissions: ugo+rw
Jul 09 14:55:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7c9890c3-6885-478d-ae1a-630011a4fd7a tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-079d9980-dac5-49be-9756-78f8827cd167.d4a46eb3-3794-4d83-ba3a-e4798802ad1b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:25 devstack sudo[107550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-079d9980-dac5-49be-9756-78f8827cd167.d4a46eb3-3794-4d83-ba3a-e4798802ad1b
Jul 09 14:55:25 devstack sudo[107550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:26 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-4bc35f5c-efe7-403f-bf0d-7f6c3ed78f0b tempest-ProjectReaderTests-934378749 None] Acquiring lock "cinder-b0bc9f4a-b105-4439-8b64-c9d195754faa-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:55:26 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-4bc35f5c-efe7-403f-bf0d-7f6c3ed78f0b tempest-ProjectReaderTests-934378749 None] Lock "cinder-b0bc9f4a-b105-4439-8b64-c9d195754faa-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:55:26 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-4bc35f5c-efe7-403f-bf0d-7f6c3ed78f0b tempest-ProjectReaderTests-934378749 None] Acquiring lock "cinder-quobyte-b0bc9f4a-b105-4439-8b64-c9d195754faa" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:55:26 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-4bc35f5c-efe7-403f-bf0d-7f6c3ed78f0b tempest-ProjectReaderTests-934378749 None] Lock "cinder-quobyte-b0bc9f4a-b105-4439-8b64-c9d195754faa" acquired by "delete_volume" :: waited 0.014s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:55:26 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[38491cf0-fe67-4f52-95c0-43dc723cdf0e]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:55:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4bc35f5c-efe7-403f-bf0d-7f6c3ed78f0b tempest-ProjectReaderTests-934378749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b0bc9f4a-b105-4439-8b64-c9d195754faa {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:26 devstack sudo[107553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b0bc9f4a-b105-4439-8b64-c9d195754faa
Jul 09 14:55:26 devstack sudo[107553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:26 devstack sudo[107550]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7c9890c3-6885-478d-ae1a-630011a4fd7a tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-079d9980-dac5-49be-9756-78f8827cd167.d4a46eb3-3794-4d83-ba3a-e4798802ad1b" returned: 0 in 0.637s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7c9890c3-6885-478d-ae1a-630011a4fd7a tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-079d9980-dac5-49be-9756-78f8827cd167.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:26 devstack sudo[107555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-079d9980-dac5-49be-9756-78f8827cd167.info
Jul 09 14:55:26 devstack sudo[107555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:27 devstack sudo[107555]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7c9890c3-6885-478d-ae1a-630011a4fd7a tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-079d9980-dac5-49be-9756-78f8827cd167.info" returned: 0 in 0.637s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:27 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-7c9890c3-6885-478d-ae1a-630011a4fd7a tempest-ProjectMemberTests-1092548551 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-079d9980-dac5-49be-9756-78f8827cd167.info is being set with open permissions: ugo+rw
Jul 09 14:55:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7c9890c3-6885-478d-ae1a-630011a4fd7a tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-079d9980-dac5-49be-9756-78f8827cd167.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:27 devstack sudo[107553]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4bc35f5c-efe7-403f-bf0d-7f6c3ed78f0b tempest-ProjectReaderTests-934378749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b0bc9f4a-b105-4439-8b64-c9d195754faa" returned: 0 in 0.789s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4bc35f5c-efe7-403f-bf0d-7f6c3ed78f0b tempest-ProjectReaderTests-934378749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b0bc9f4a-b105-4439-8b64-c9d195754faa {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:27 devstack sudo[107561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-079d9980-dac5-49be-9756-78f8827cd167.info
Jul 09 14:55:27 devstack sudo[107561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:27 devstack sudo[107562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b0bc9f4a-b105-4439-8b64-c9d195754faa
Jul 09 14:55:27 devstack sudo[107562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:27 devstack sudo[107561]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7c9890c3-6885-478d-ae1a-630011a4fd7a tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-079d9980-dac5-49be-9756-78f8827cd167.info" returned: 0 in 0.675s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7c9890c3-6885-478d-ae1a-630011a4fd7a tempest-ProjectMemberTests-1092548551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.290s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:55:27 devstack sudo[107562]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4bc35f5c-efe7-403f-bf0d-7f6c3ed78f0b tempest-ProjectReaderTests-934378749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-b0bc9f4a-b105-4439-8b64-c9d195754faa" returned: 0 in 0.698s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:27 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-7c9890c3-6885-478d-ae1a-630011a4fd7a tempest-ProjectMemberTests-1092548551 None] Create snapshot completed successfully
Jul 09 14:55:27 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-4bc35f5c-efe7-403f-bf0d-7f6c3ed78f0b tempest-ProjectReaderTests-934378749 None] Lock "cinder-quobyte-b0bc9f4a-b105-4439-8b64-c9d195754faa" released by "delete_volume" :: held 1.551s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:55:27 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-4bc35f5c-efe7-403f-bf0d-7f6c3ed78f0b tempest-ProjectReaderTests-934378749 None] Created reservations ['01392e8b-c4ff-44f0-a42c-1ce9200c1b70', 'a9281306-0e0c-4a5b-95a2-fd0485f4ed31', 'da595fa9-78eb-4dfa-b87e-7f1163693984', 'f049dbb5-e81f-4125-bb4f-05dc5d12642c'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:55:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-4bc35f5c-efe7-403f-bf0d-7f6c3ed78f0b tempest-ProjectReaderTests-934378749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:55:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-4bc35f5c-efe7-403f-bf0d-7f6c3ed78f0b tempest-ProjectReaderTests-934378749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:55:27 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-4bc35f5c-efe7-403f-bf0d-7f6c3ed78f0b tempest-ProjectReaderTests-934378749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:55:27 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-4bc35f5c-efe7-403f-bf0d-7f6c3ed78f0b tempest-ProjectReaderTests-934378749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:55:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-4bc35f5c-efe7-403f-bf0d-7f6c3ed78f0b tempest-ProjectReaderTests-934378749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:55:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4bc35f5c-efe7-403f-bf0d-7f6c3ed78f0b tempest-ProjectReaderTests-934378749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:27 devstack sudo[107567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:55:27 devstack sudo[107567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:28 devstack sudo[107567]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4bc35f5c-efe7-403f-bf0d-7f6c3ed78f0b tempest-ProjectReaderTests-934378749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.642s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:28 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-4bc35f5c-efe7-403f-bf0d-7f6c3ed78f0b tempest-ProjectReaderTests-934378749 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:55:28 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-4bc35f5c-efe7-403f-bf0d-7f6c3ed78f0b tempest-ProjectReaderTests-934378749 None] Deleted volume successfully.
Jul 09 14:55:28 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-4bc35f5c-efe7-403f-bf0d-7f6c3ed78f0b tempest-ProjectReaderTests-934378749 None] Lock "cinder-b0bc9f4a-b105-4439-8b64-c9d195754faa-delete_volume" released by "delete_volume" :: held 2.398s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:55:28 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b8e34db9-0647-48e6-ab8e-43d32db8d373 tempest-ProjectMemberTests-1092548551 None] Acquiring lock "cinder-d4a46eb3-3794-4d83-ba3a-e4798802ad1b-delete_snapshot" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:55:28 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b8e34db9-0647-48e6-ab8e-43d32db8d373 tempest-ProjectMemberTests-1092548551 None] Lock "cinder-d4a46eb3-3794-4d83-ba3a-e4798802ad1b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:55:28 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b8e34db9-0647-48e6-ab8e-43d32db8d373 tempest-ProjectMemberTests-1092548551 None] Acquiring lock "cinder-quobyte-079d9980-dac5-49be-9756-78f8827cd167" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:55:28 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b8e34db9-0647-48e6-ab8e-43d32db8d373 tempest-ProjectMemberTests-1092548551 None] Lock "cinder-quobyte-079d9980-dac5-49be-9756-78f8827cd167" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:55:28 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b8e34db9-0647-48e6-ab8e-43d32db8d373 tempest-ProjectMemberTests-1092548551 None] Acquiring lock "cinder-quobyte-d4a46eb3-3794-4d83-ba3a-e4798802ad1b" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:55:28 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b8e34db9-0647-48e6-ab8e-43d32db8d373 tempest-ProjectMemberTests-1092548551 None] Lock "cinder-quobyte-d4a46eb3-3794-4d83-ba3a-e4798802ad1b" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:55:28 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-b8e34db9-0647-48e6-ab8e-43d32db8d373 tempest-ProjectMemberTests-1092548551 None] Deleting offline snapshot d4a46eb3-3794-4d83-ba3a-e4798802ad1b of volume 079d9980-dac5-49be-9756-78f8827cd167 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 14:55:28 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-b8e34db9-0647-48e6-ab8e-43d32db8d373 tempest-ProjectMemberTests-1092548551 None] snapshot_file for this snap is: volume-079d9980-dac5-49be-9756-78f8827cd167.d4a46eb3-3794-4d83-ba3a-e4798802ad1b {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 14:55:28 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[bffbc8f7-7deb-4074-a106-ec298ac29497]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:55:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b8e34db9-0647-48e6-ab8e-43d32db8d373 tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-079d9980-dac5-49be-9756-78f8827cd167.d4a46eb3-3794-4d83-ba3a-e4798802ad1b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:28 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-6078b6fe-47a7-4a0c-b533-b87bed3e9bfc tempest-ProjectReaderTests-934378749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:55:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6078b6fe-47a7-4a0c-b533-b87bed3e9bfc tempest-ProjectReaderTests-934378749 None] Flow 'volume_create_manager' (21d24126-8bfc-4d92-9d10-24cfdf248371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:55:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6078b6fe-47a7-4a0c-b533-b87bed3e9bfc tempest-ProjectReaderTests-934378749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea18d2f1-6740-447b-83cd-d02b66edfeba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:55:29 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6078b6fe-47a7-4a0c-b533-b87bed3e9bfc tempest-ProjectReaderTests-934378749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea18d2f1-6740-447b-83cd-d02b66edfeba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:55:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1364089164',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82e8b4ae-2309-44b2-9458-806f8b15dccc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20599830728f47858cc21c11b6e6bbac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:55:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:55:29Z,use_quota=True,user_id='a49bf6be1b4b4e2d810713bc1d8374d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:55:29 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6078b6fe-47a7-4a0c-b533-b87bed3e9bfc tempest-ProjectReaderTests-934378749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af0fff6f-849a-4d4b-a65d-4d6da43f8d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:55:29 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6078b6fe-47a7-4a0c-b533-b87bed3e9bfc tempest-ProjectReaderTests-934378749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af0fff6f-849a-4d4b-a65d-4d6da43f8d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:55:29 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6078b6fe-47a7-4a0c-b533-b87bed3e9bfc tempest-ProjectReaderTests-934378749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4545bad-946e-439a-84ae-fc9e6d364bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:55:29 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6078b6fe-47a7-4a0c-b533-b87bed3e9bfc tempest-ProjectReaderTests-934378749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4545bad-946e-439a-84ae-fc9e6d364bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82e8b4ae-2309-44b2-9458-806f8b15dccc', 'volume_name': 'volume-82e8b4ae-2309-44b2-9458-806f8b15dccc', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:55:29 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6078b6fe-47a7-4a0c-b533-b87bed3e9bfc tempest-ProjectReaderTests-934378749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98f5da31-678d-4cfd-ab5d-8305209aa6f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:55:29 devstack sudo[107718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-079d9980-dac5-49be-9756-78f8827cd167.d4a46eb3-3794-4d83-ba3a-e4798802ad1b
Jul 09 14:55:29 devstack sudo[107718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:29 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6078b6fe-47a7-4a0c-b533-b87bed3e9bfc tempest-ProjectReaderTests-934378749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98f5da31-678d-4cfd-ab5d-8305209aa6f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:55:29 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6078b6fe-47a7-4a0c-b533-b87bed3e9bfc tempest-ProjectReaderTests-934378749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ba40fbe-5911-4464-a559-0dce2e2c6ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:55:29 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-6078b6fe-47a7-4a0c-b533-b87bed3e9bfc tempest-ProjectReaderTests-934378749 None] Volume 82e8b4ae-2309-44b2-9458-806f8b15dccc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82e8b4ae-2309-44b2-9458-806f8b15dccc', 'volume_size': 1}
Jul 09 14:55:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6078b6fe-47a7-4a0c-b533-b87bed3e9bfc tempest-ProjectReaderTests-934378749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:55:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6078b6fe-47a7-4a0c-b533-b87bed3e9bfc tempest-ProjectReaderTests-934378749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:55:29 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-6078b6fe-47a7-4a0c-b533-b87bed3e9bfc tempest-ProjectReaderTests-934378749 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:55:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1364089164',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82e8b4ae-2309-44b2-9458-806f8b15dccc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20599830728f47858cc21c11b6e6bbac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:55:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:55:29Z,use_quota=True,user_id='a49bf6be1b4b4e2d810713bc1d8374d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:55:29 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-6078b6fe-47a7-4a0c-b533-b87bed3e9bfc tempest-ProjectReaderTests-934378749 None] Creating volume 82e8b4ae-2309-44b2-9458-806f8b15dccc {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:55:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6078b6fe-47a7-4a0c-b533-b87bed3e9bfc tempest-ProjectReaderTests-934378749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:55:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6078b6fe-47a7-4a0c-b533-b87bed3e9bfc tempest-ProjectReaderTests-934378749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:55:29 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-6078b6fe-47a7-4a0c-b533-b87bed3e9bfc tempest-ProjectReaderTests-934378749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:55:29 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-6078b6fe-47a7-4a0c-b533-b87bed3e9bfc tempest-ProjectReaderTests-934378749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:55:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6078b6fe-47a7-4a0c-b533-b87bed3e9bfc tempest-ProjectReaderTests-934378749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:55:29 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-6078b6fe-47a7-4a0c-b533-b87bed3e9bfc tempest-ProjectReaderTests-934378749 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:55:29 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-6078b6fe-47a7-4a0c-b533-b87bed3e9bfc tempest-ProjectReaderTests-934378749 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:55:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6078b6fe-47a7-4a0c-b533-b87bed3e9bfc tempest-ProjectReaderTests-934378749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-82e8b4ae-2309-44b2-9458-806f8b15dccc 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:29 devstack sudo[107809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-82e8b4ae-2309-44b2-9458-806f8b15dccc 1073741824
Jul 09 14:55:29 devstack sudo[107809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:29 devstack sudo[107718]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b8e34db9-0647-48e6-ab8e-43d32db8d373 tempest-ProjectMemberTests-1092548551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-079d9980-dac5-49be-9756-78f8827cd167.d4a46eb3-3794-4d83-ba3a-e4798802ad1b" returned: 0 in 0.756s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:29 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-b8e34db9-0647-48e6-ab8e-43d32db8d373 tempest-ProjectMemberTests-1092548551 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-079d9980-dac5-49be-9756-78f8827cd167(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 14:55:29 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc2bf1c-928d-494e-aed2-590261198a0e]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:55:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b8e34db9-0647-48e6-ab8e-43d32db8d373 tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-079d9980-dac5-49be-9756-78f8827cd167 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:29 devstack sudo[107997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-079d9980-dac5-49be-9756-78f8827cd167
Jul 09 14:55:29 devstack sudo[107997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:29 devstack sudo[107809]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6078b6fe-47a7-4a0c-b533-b87bed3e9bfc tempest-ProjectReaderTests-934378749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-82e8b4ae-2309-44b2-9458-806f8b15dccc 1073741824" returned: 0 in 0.822s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6078b6fe-47a7-4a0c-b533-b87bed3e9bfc tempest-ProjectReaderTests-934378749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-82e8b4ae-2309-44b2-9458-806f8b15dccc {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:29 devstack sudo[107999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-82e8b4ae-2309-44b2-9458-806f8b15dccc
Jul 09 14:55:29 devstack sudo[107999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:30 devstack sudo[107997]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b8e34db9-0647-48e6-ab8e-43d32db8d373 tempest-ProjectMemberTests-1092548551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-079d9980-dac5-49be-9756-78f8827cd167" returned: 0 in 0.738s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b8e34db9-0647-48e6-ab8e-43d32db8d373 tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-079d9980-dac5-49be-9756-78f8827cd167.d4a46eb3-3794-4d83-ba3a-e4798802ad1b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:30 devstack sudo[108005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-079d9980-dac5-49be-9756-78f8827cd167.d4a46eb3-3794-4d83-ba3a-e4798802ad1b
Jul 09 14:55:30 devstack sudo[108005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:30 devstack sudo[107999]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6078b6fe-47a7-4a0c-b533-b87bed3e9bfc tempest-ProjectReaderTests-934378749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-82e8b4ae-2309-44b2-9458-806f8b15dccc" returned: 0 in 0.643s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:30 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-6078b6fe-47a7-4a0c-b533-b87bed3e9bfc tempest-ProjectReaderTests-934378749 None] <== create_volume: return (1510ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:55:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6078b6fe-47a7-4a0c-b533-b87bed3e9bfc tempest-ProjectReaderTests-934378749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.512s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:55:30 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6078b6fe-47a7-4a0c-b533-b87bed3e9bfc tempest-ProjectReaderTests-934378749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ba40fbe-5911-4464-a559-0dce2e2c6ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82e8b4ae-2309-44b2-9458-806f8b15dccc', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:55:30 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6078b6fe-47a7-4a0c-b533-b87bed3e9bfc tempest-ProjectReaderTests-934378749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35f2097e-09f8-40ae-94cc-c116d27134b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:55:30 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-6078b6fe-47a7-4a0c-b533-b87bed3e9bfc tempest-ProjectReaderTests-934378749 None] Volume volume-82e8b4ae-2309-44b2-9458-806f8b15dccc (82e8b4ae-2309-44b2-9458-806f8b15dccc): created successfully
Jul 09 14:55:30 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6078b6fe-47a7-4a0c-b533-b87bed3e9bfc tempest-ProjectReaderTests-934378749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35f2097e-09f8-40ae-94cc-c116d27134b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:55:30 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6078b6fe-47a7-4a0c-b533-b87bed3e9bfc tempest-ProjectReaderTests-934378749 None] Flow 'volume_create_manager' (21d24126-8bfc-4d92-9d10-24cfdf248371) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:55:30 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-6078b6fe-47a7-4a0c-b533-b87bed3e9bfc tempest-ProjectReaderTests-934378749 None] Created volume successfully.
Jul 09 14:55:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8ff20aeb-e87f-4011-9096-0b24da034e5f tempest-ProjectReaderTests-934378749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:55:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8ff20aeb-e87f-4011-9096-0b24da034e5f tempest-ProjectReaderTests-934378749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:55:31 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-8ff20aeb-e87f-4011-9096-0b24da034e5f tempest-ProjectReaderTests-934378749 None] Creating offline snapshot e2b2cd7c-e661-4095-bb75-f1deea4ae8df of volume 82e8b4ae-2309-44b2-9458-806f8b15dccc {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 14:55:31 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ea4a63-2fcf-4f40-a78a-ba368747f66f]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:55:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8ff20aeb-e87f-4011-9096-0b24da034e5f tempest-ProjectReaderTests-934378749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-82e8b4ae-2309-44b2-9458-806f8b15dccc {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:31 devstack sudo[108005]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b8e34db9-0647-48e6-ab8e-43d32db8d373 tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-079d9980-dac5-49be-9756-78f8827cd167.d4a46eb3-3794-4d83-ba3a-e4798802ad1b" returned: 0 in 0.749s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b8e34db9-0647-48e6-ab8e-43d32db8d373 tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-079d9980-dac5-49be-9756-78f8827cd167.d4a46eb3-3794-4d83-ba3a-e4798802ad1b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:31 devstack sudo[108013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-079d9980-dac5-49be-9756-78f8827cd167.d4a46eb3-3794-4d83-ba3a-e4798802ad1b
Jul 09 14:55:31 devstack sudo[108013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:31 devstack sudo[108012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-82e8b4ae-2309-44b2-9458-806f8b15dccc
Jul 09 14:55:31 devstack sudo[108012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:31 devstack sudo[108013]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b8e34db9-0647-48e6-ab8e-43d32db8d373 tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-079d9980-dac5-49be-9756-78f8827cd167.d4a46eb3-3794-4d83-ba3a-e4798802ad1b" returned: 0 in 0.640s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:31 devstack sudo[108012]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8ff20aeb-e87f-4011-9096-0b24da034e5f tempest-ProjectReaderTests-934378749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-82e8b4ae-2309-44b2-9458-806f8b15dccc" returned: 0 in 0.752s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8ff20aeb-e87f-4011-9096-0b24da034e5f tempest-ProjectReaderTests-934378749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-82e8b4ae-2309-44b2-9458-806f8b15dccc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-82e8b4ae-2309-44b2-9458-806f8b15dccc.e2b2cd7c-e661-4095-bb75-f1deea4ae8df 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:31 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b8e34db9-0647-48e6-ab8e-43d32db8d373 tempest-ProjectMemberTests-1092548551 None] Lock "cinder-quobyte-d4a46eb3-3794-4d83-ba3a-e4798802ad1b" released by "_delete_snapshot" :: held 3.040s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:55:31 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b8e34db9-0647-48e6-ab8e-43d32db8d373 tempest-ProjectMemberTests-1092548551 None] Lock "cinder-quobyte-079d9980-dac5-49be-9756-78f8827cd167" released by "delete_snapshot" :: held 3.077s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:55:31 devstack sudo[108020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-82e8b4ae-2309-44b2-9458-806f8b15dccc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-82e8b4ae-2309-44b2-9458-806f8b15dccc.e2b2cd7c-e661-4095-bb75-f1deea4ae8df 1G
Jul 09 14:55:31 devstack sudo[108020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:31 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-b8e34db9-0647-48e6-ab8e-43d32db8d373 tempest-ProjectMemberTests-1092548551 None] Created reservations ['3a9df545-997f-4ec0-91d1-1c03fa67ed5c', '0ce522f3-ada5-4368-92fa-553b2fd31290', '3dbf8df6-f90f-416d-a20d-8dc28c06111b', 'ab0203cc-f562-4f7b-b417-3606fb30cc2e'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:55:31 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-b8e34db9-0647-48e6-ab8e-43d32db8d373 tempest-ProjectMemberTests-1092548551 None] Delete snapshot completed successfully.
Jul 09 14:55:32 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b8e34db9-0647-48e6-ab8e-43d32db8d373 tempest-ProjectMemberTests-1092548551 None] Lock "cinder-d4a46eb3-3794-4d83-ba3a-e4798802ad1b-delete_snapshot" released by "delete_snapshot" :: held 3.233s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:55:32 devstack sudo[108020]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8ff20aeb-e87f-4011-9096-0b24da034e5f tempest-ProjectReaderTests-934378749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-82e8b4ae-2309-44b2-9458-806f8b15dccc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-82e8b4ae-2309-44b2-9458-806f8b15dccc.e2b2cd7c-e661-4095-bb75-f1deea4ae8df 1G" returned: 0 in 0.776s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8ff20aeb-e87f-4011-9096-0b24da034e5f tempest-ProjectReaderTests-934378749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82e8b4ae-2309-44b2-9458-806f8b15dccc -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-82e8b4ae-2309-44b2-9458-806f8b15dccc.e2b2cd7c-e661-4095-bb75-f1deea4ae8df {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:32 devstack sudo[108025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82e8b4ae-2309-44b2-9458-806f8b15dccc -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-82e8b4ae-2309-44b2-9458-806f8b15dccc.e2b2cd7c-e661-4095-bb75-f1deea4ae8df
Jul 09 14:55:32 devstack sudo[108025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:32 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1b69e763-4236-4867-93aa-0398bbf9b542 tempest-ProjectMemberTests-1092548551 None] Acquiring lock "cinder-079d9980-dac5-49be-9756-78f8827cd167-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:55:33 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1b69e763-4236-4867-93aa-0398bbf9b542 tempest-ProjectMemberTests-1092548551 None] Lock "cinder-079d9980-dac5-49be-9756-78f8827cd167-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:55:33 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1b69e763-4236-4867-93aa-0398bbf9b542 tempest-ProjectMemberTests-1092548551 None] Acquiring lock "cinder-quobyte-079d9980-dac5-49be-9756-78f8827cd167" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:55:33 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1b69e763-4236-4867-93aa-0398bbf9b542 tempest-ProjectMemberTests-1092548551 None] Lock "cinder-quobyte-079d9980-dac5-49be-9756-78f8827cd167" acquired by "delete_volume" :: waited 0.017s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:55:33 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe44d1e-cc3c-468c-9f7f-c50f28b438ed]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:55:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1b69e763-4236-4867-93aa-0398bbf9b542 tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-079d9980-dac5-49be-9756-78f8827cd167 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:33 devstack sudo[108027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-079d9980-dac5-49be-9756-78f8827cd167
Jul 09 14:55:33 devstack sudo[108027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:33 devstack sudo[108025]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8ff20aeb-e87f-4011-9096-0b24da034e5f tempest-ProjectReaderTests-934378749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82e8b4ae-2309-44b2-9458-806f8b15dccc -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-82e8b4ae-2309-44b2-9458-806f8b15dccc.e2b2cd7c-e661-4095-bb75-f1deea4ae8df" returned: 0 in 0.696s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:33 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-8ff20aeb-e87f-4011-9096-0b24da034e5f tempest-ProjectReaderTests-934378749 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-82e8b4ae-2309-44b2-9458-806f8b15dccc.e2b2cd7c-e661-4095-bb75-f1deea4ae8df is being set with open permissions: ugo+rw
Jul 09 14:55:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8ff20aeb-e87f-4011-9096-0b24da034e5f tempest-ProjectReaderTests-934378749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-82e8b4ae-2309-44b2-9458-806f8b15dccc.e2b2cd7c-e661-4095-bb75-f1deea4ae8df {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:33 devstack sudo[108032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-82e8b4ae-2309-44b2-9458-806f8b15dccc.e2b2cd7c-e661-4095-bb75-f1deea4ae8df
Jul 09 14:55:33 devstack sudo[108032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:33 devstack sudo[108027]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1b69e763-4236-4867-93aa-0398bbf9b542 tempest-ProjectMemberTests-1092548551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-079d9980-dac5-49be-9756-78f8827cd167" returned: 0 in 0.777s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1b69e763-4236-4867-93aa-0398bbf9b542 tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-079d9980-dac5-49be-9756-78f8827cd167 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:33 devstack sudo[108038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-079d9980-dac5-49be-9756-78f8827cd167
Jul 09 14:55:33 devstack sudo[108038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:33 devstack sudo[108032]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8ff20aeb-e87f-4011-9096-0b24da034e5f tempest-ProjectReaderTests-934378749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-82e8b4ae-2309-44b2-9458-806f8b15dccc.e2b2cd7c-e661-4095-bb75-f1deea4ae8df" returned: 0 in 0.611s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8ff20aeb-e87f-4011-9096-0b24da034e5f tempest-ProjectReaderTests-934378749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-82e8b4ae-2309-44b2-9458-806f8b15dccc.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:33 devstack sudo[108040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-82e8b4ae-2309-44b2-9458-806f8b15dccc.info
Jul 09 14:55:33 devstack sudo[108040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:34 devstack sudo[108038]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1b69e763-4236-4867-93aa-0398bbf9b542 tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-079d9980-dac5-49be-9756-78f8827cd167" returned: 0 in 0.678s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:34 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1b69e763-4236-4867-93aa-0398bbf9b542 tempest-ProjectMemberTests-1092548551 None] Lock "cinder-quobyte-079d9980-dac5-49be-9756-78f8827cd167" released by "delete_volume" :: held 1.530s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:55:34 devstack sudo[108040]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8ff20aeb-e87f-4011-9096-0b24da034e5f tempest-ProjectReaderTests-934378749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-82e8b4ae-2309-44b2-9458-806f8b15dccc.info" returned: 0 in 0.655s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:34 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-8ff20aeb-e87f-4011-9096-0b24da034e5f tempest-ProjectReaderTests-934378749 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-82e8b4ae-2309-44b2-9458-806f8b15dccc.info is being set with open permissions: ugo+rw
Jul 09 14:55:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8ff20aeb-e87f-4011-9096-0b24da034e5f tempest-ProjectReaderTests-934378749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-82e8b4ae-2309-44b2-9458-806f8b15dccc.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:34 devstack sudo[108044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-82e8b4ae-2309-44b2-9458-806f8b15dccc.info
Jul 09 14:55:34 devstack sudo[108044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:34 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-1b69e763-4236-4867-93aa-0398bbf9b542 tempest-ProjectMemberTests-1092548551 None] Created reservations ['25bc88f9-d2c3-4f15-a93e-f2769f1cf8fa', '2e9af296-819c-4f43-823e-cfcdde9fda5c', '3d846aec-2808-41d9-b547-37c40a994f01', 'ca76535a-4427-4e85-8258-9fd4fa8c0a05'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:55:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1b69e763-4236-4867-93aa-0398bbf9b542 tempest-ProjectMemberTests-1092548551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:55:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1b69e763-4236-4867-93aa-0398bbf9b542 tempest-ProjectMemberTests-1092548551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:55:34 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-1b69e763-4236-4867-93aa-0398bbf9b542 tempest-ProjectMemberTests-1092548551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:55:34 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-1b69e763-4236-4867-93aa-0398bbf9b542 tempest-ProjectMemberTests-1092548551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:55:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1b69e763-4236-4867-93aa-0398bbf9b542 tempest-ProjectMemberTests-1092548551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:55:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1b69e763-4236-4867-93aa-0398bbf9b542 tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:34 devstack sudo[108046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:55:34 devstack sudo[108046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:35 devstack sudo[108044]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8ff20aeb-e87f-4011-9096-0b24da034e5f tempest-ProjectReaderTests-934378749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-82e8b4ae-2309-44b2-9458-806f8b15dccc.info" returned: 0 in 0.654s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8ff20aeb-e87f-4011-9096-0b24da034e5f tempest-ProjectReaderTests-934378749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.231s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:55:35 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-8ff20aeb-e87f-4011-9096-0b24da034e5f tempest-ProjectReaderTests-934378749 None] Create snapshot completed successfully
Jul 09 14:55:35 devstack sudo[108046]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1b69e763-4236-4867-93aa-0398bbf9b542 tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.674s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:35 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-1b69e763-4236-4867-93aa-0398bbf9b542 tempest-ProjectMemberTests-1092548551 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:55:35 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-1b69e763-4236-4867-93aa-0398bbf9b542 tempest-ProjectMemberTests-1092548551 None] Deleted volume successfully.
Jul 09 14:55:35 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1b69e763-4236-4867-93aa-0398bbf9b542 tempest-ProjectMemberTests-1092548551 None] Lock "cinder-079d9980-dac5-49be-9756-78f8827cd167-delete_volume" released by "delete_volume" :: held 2.431s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:55:35 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-b10c358b-803c-4221-a338-beedc5f63143 tempest-ProjectMemberTests-1092548551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:55:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b10c358b-803c-4221-a338-beedc5f63143 tempest-ProjectMemberTests-1092548551 None] Flow 'volume_create_manager' (4e4b0067-993b-4d9b-90cf-4cf6e6d5396b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:55:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b10c358b-803c-4221-a338-beedc5f63143 tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (375734e9-dbad-4eaa-8ecf-50ee069b54a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:55:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b10c358b-803c-4221-a338-beedc5f63143 tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (375734e9-dbad-4eaa-8ecf-50ee069b54a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:55:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1069858842',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=989cfac5-cf1e-4e81-85ea-8ffce2aaf6dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53e3a7b509634eeda7e218e1577efd89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:55:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:55:36Z,use_quota=True,user_id='6f31a0c3fe3e49ccabfa9bdf47df92af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:55:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b10c358b-803c-4221-a338-beedc5f63143 tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3af2ece8-b007-4f2f-badb-5661aafbbdc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:55:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b10c358b-803c-4221-a338-beedc5f63143 tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3af2ece8-b007-4f2f-badb-5661aafbbdc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:55:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b10c358b-803c-4221-a338-beedc5f63143 tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (178c8d4f-3d6d-456c-ab67-4f516f2cd2ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:55:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b10c358b-803c-4221-a338-beedc5f63143 tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (178c8d4f-3d6d-456c-ab67-4f516f2cd2ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '989cfac5-cf1e-4e81-85ea-8ffce2aaf6dd', 'volume_name': 'volume-989cfac5-cf1e-4e81-85ea-8ffce2aaf6dd', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:55:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b10c358b-803c-4221-a338-beedc5f63143 tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cca7b5c-f23b-43e7-8489-89c59c53656a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:55:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b10c358b-803c-4221-a338-beedc5f63143 tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cca7b5c-f23b-43e7-8489-89c59c53656a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:55:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b10c358b-803c-4221-a338-beedc5f63143 tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2835ef63-1bbd-49ae-b295-a91c0f728bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:55:35 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-b10c358b-803c-4221-a338-beedc5f63143 tempest-ProjectMemberTests-1092548551 None] Volume 989cfac5-cf1e-4e81-85ea-8ffce2aaf6dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-989cfac5-cf1e-4e81-85ea-8ffce2aaf6dd', 'volume_size': 1}
Jul 09 14:55:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b10c358b-803c-4221-a338-beedc5f63143 tempest-ProjectMemberTests-1092548551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:55:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b10c358b-803c-4221-a338-beedc5f63143 tempest-ProjectMemberTests-1092548551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:55:35 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b10c358b-803c-4221-a338-beedc5f63143 tempest-ProjectMemberTests-1092548551 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:55:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1069858842',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=989cfac5-cf1e-4e81-85ea-8ffce2aaf6dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53e3a7b509634eeda7e218e1577efd89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:55:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:55:36Z,use_quota=True,user_id='6f31a0c3fe3e49ccabfa9bdf47df92af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:55:35 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-b10c358b-803c-4221-a338-beedc5f63143 tempest-ProjectMemberTests-1092548551 None] Creating volume 989cfac5-cf1e-4e81-85ea-8ffce2aaf6dd {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:55:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b10c358b-803c-4221-a338-beedc5f63143 tempest-ProjectMemberTests-1092548551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:55:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b10c358b-803c-4221-a338-beedc5f63143 tempest-ProjectMemberTests-1092548551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:55:35 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b10c358b-803c-4221-a338-beedc5f63143 tempest-ProjectMemberTests-1092548551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:55:35 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b10c358b-803c-4221-a338-beedc5f63143 tempest-ProjectMemberTests-1092548551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:55:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b10c358b-803c-4221-a338-beedc5f63143 tempest-ProjectMemberTests-1092548551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:55:35 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b10c358b-803c-4221-a338-beedc5f63143 tempest-ProjectMemberTests-1092548551 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:55:35 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-b10c358b-803c-4221-a338-beedc5f63143 tempest-ProjectMemberTests-1092548551 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:55:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b10c358b-803c-4221-a338-beedc5f63143 tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-989cfac5-cf1e-4e81-85ea-8ffce2aaf6dd 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:35 devstack sudo[108050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-989cfac5-cf1e-4e81-85ea-8ffce2aaf6dd 1073741824
Jul 09 14:55:35 devstack sudo[108050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:36 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1359c756-40db-433e-b738-eef1f0652440 tempest-ProjectReaderTests-934378749 None] Acquiring lock "cinder-e2b2cd7c-e661-4095-bb75-f1deea4ae8df-delete_snapshot" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:55:36 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1359c756-40db-433e-b738-eef1f0652440 tempest-ProjectReaderTests-934378749 None] Lock "cinder-e2b2cd7c-e661-4095-bb75-f1deea4ae8df-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:55:36 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1359c756-40db-433e-b738-eef1f0652440 tempest-ProjectReaderTests-934378749 None] Acquiring lock "cinder-quobyte-82e8b4ae-2309-44b2-9458-806f8b15dccc" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:55:36 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1359c756-40db-433e-b738-eef1f0652440 tempest-ProjectReaderTests-934378749 None] Lock "cinder-quobyte-82e8b4ae-2309-44b2-9458-806f8b15dccc" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:55:36 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1359c756-40db-433e-b738-eef1f0652440 tempest-ProjectReaderTests-934378749 None] Acquiring lock "cinder-quobyte-e2b2cd7c-e661-4095-bb75-f1deea4ae8df" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:55:36 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1359c756-40db-433e-b738-eef1f0652440 tempest-ProjectReaderTests-934378749 None] Lock "cinder-quobyte-e2b2cd7c-e661-4095-bb75-f1deea4ae8df" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:55:36 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-1359c756-40db-433e-b738-eef1f0652440 tempest-ProjectReaderTests-934378749 None] Deleting offline snapshot e2b2cd7c-e661-4095-bb75-f1deea4ae8df of volume 82e8b4ae-2309-44b2-9458-806f8b15dccc {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 14:55:36 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-1359c756-40db-433e-b738-eef1f0652440 tempest-ProjectReaderTests-934378749 None] snapshot_file for this snap is: volume-82e8b4ae-2309-44b2-9458-806f8b15dccc.e2b2cd7c-e661-4095-bb75-f1deea4ae8df {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 14:55:36 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c64798f-294b-40dc-84a7-d99b0c23439e]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:55:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1359c756-40db-433e-b738-eef1f0652440 tempest-ProjectReaderTests-934378749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-82e8b4ae-2309-44b2-9458-806f8b15dccc.e2b2cd7c-e661-4095-bb75-f1deea4ae8df {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:36 devstack sudo[108055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-82e8b4ae-2309-44b2-9458-806f8b15dccc.e2b2cd7c-e661-4095-bb75-f1deea4ae8df
Jul 09 14:55:36 devstack sudo[108055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:36 devstack sudo[108050]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b10c358b-803c-4221-a338-beedc5f63143 tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-989cfac5-cf1e-4e81-85ea-8ffce2aaf6dd 1073741824" returned: 0 in 0.839s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b10c358b-803c-4221-a338-beedc5f63143 tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-989cfac5-cf1e-4e81-85ea-8ffce2aaf6dd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:36 devstack sudo[108057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-989cfac5-cf1e-4e81-85ea-8ffce2aaf6dd
Jul 09 14:55:36 devstack sudo[108057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:37 devstack sudo[108055]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1359c756-40db-433e-b738-eef1f0652440 tempest-ProjectReaderTests-934378749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-82e8b4ae-2309-44b2-9458-806f8b15dccc.e2b2cd7c-e661-4095-bb75-f1deea4ae8df" returned: 0 in 0.751s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:37 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-1359c756-40db-433e-b738-eef1f0652440 tempest-ProjectReaderTests-934378749 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82e8b4ae-2309-44b2-9458-806f8b15dccc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 14:55:37 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[58f62042-8153-4fe0-b4e5-7dc02b5d8106]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:55:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1359c756-40db-433e-b738-eef1f0652440 tempest-ProjectReaderTests-934378749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-82e8b4ae-2309-44b2-9458-806f8b15dccc {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:37 devstack sudo[108063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-82e8b4ae-2309-44b2-9458-806f8b15dccc
Jul 09 14:55:37 devstack sudo[108063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:37 devstack sudo[108057]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b10c358b-803c-4221-a338-beedc5f63143 tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-989cfac5-cf1e-4e81-85ea-8ffce2aaf6dd" returned: 0 in 0.673s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:37 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b10c358b-803c-4221-a338-beedc5f63143 tempest-ProjectMemberTests-1092548551 None] <== create_volume: return (1564ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:55:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b10c358b-803c-4221-a338-beedc5f63143 tempest-ProjectMemberTests-1092548551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.565s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:55:37 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b10c358b-803c-4221-a338-beedc5f63143 tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2835ef63-1bbd-49ae-b295-a91c0f728bf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-989cfac5-cf1e-4e81-85ea-8ffce2aaf6dd', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:55:37 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b10c358b-803c-4221-a338-beedc5f63143 tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7cddbe6-78d9-49ea-a151-1e29a1d07ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:55:37 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-b10c358b-803c-4221-a338-beedc5f63143 tempest-ProjectMemberTests-1092548551 None] Volume volume-989cfac5-cf1e-4e81-85ea-8ffce2aaf6dd (989cfac5-cf1e-4e81-85ea-8ffce2aaf6dd): created successfully
Jul 09 14:55:37 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b10c358b-803c-4221-a338-beedc5f63143 tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7cddbe6-78d9-49ea-a151-1e29a1d07ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:55:37 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b10c358b-803c-4221-a338-beedc5f63143 tempest-ProjectMemberTests-1092548551 None] Flow 'volume_create_manager' (4e4b0067-993b-4d9b-90cf-4cf6e6d5396b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:55:37 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-b10c358b-803c-4221-a338-beedc5f63143 tempest-ProjectMemberTests-1092548551 None] Created volume successfully.
Jul 09 14:55:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5c26a25a-c86f-4468-9b45-3e031a6a2287 tempest-ProjectMemberTests-1092548551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:55:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5c26a25a-c86f-4468-9b45-3e031a6a2287 tempest-ProjectMemberTests-1092548551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:55:37 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-5c26a25a-c86f-4468-9b45-3e031a6a2287 tempest-ProjectMemberTests-1092548551 None] Creating offline snapshot f8e717b5-cb13-4be2-931d-991d7aa422a3 of volume 989cfac5-cf1e-4e81-85ea-8ffce2aaf6dd {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 14:55:37 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[4697b3f8-00ca-49d8-8522-a46b205f67a8]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:55:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5c26a25a-c86f-4468-9b45-3e031a6a2287 tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-989cfac5-cf1e-4e81-85ea-8ffce2aaf6dd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:37 devstack sudo[108063]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1359c756-40db-433e-b738-eef1f0652440 tempest-ProjectReaderTests-934378749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-82e8b4ae-2309-44b2-9458-806f8b15dccc" returned: 0 in 0.808s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1359c756-40db-433e-b738-eef1f0652440 tempest-ProjectReaderTests-934378749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-82e8b4ae-2309-44b2-9458-806f8b15dccc.e2b2cd7c-e661-4095-bb75-f1deea4ae8df {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:38 devstack sudo[108070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-82e8b4ae-2309-44b2-9458-806f8b15dccc.e2b2cd7c-e661-4095-bb75-f1deea4ae8df
Jul 09 14:55:38 devstack sudo[108070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:38 devstack sudo[108069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-989cfac5-cf1e-4e81-85ea-8ffce2aaf6dd
Jul 09 14:55:38 devstack sudo[108069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:38 devstack sudo[108070]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1359c756-40db-433e-b738-eef1f0652440 tempest-ProjectReaderTests-934378749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-82e8b4ae-2309-44b2-9458-806f8b15dccc.e2b2cd7c-e661-4095-bb75-f1deea4ae8df" returned: 0 in 0.735s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1359c756-40db-433e-b738-eef1f0652440 tempest-ProjectReaderTests-934378749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-82e8b4ae-2309-44b2-9458-806f8b15dccc.e2b2cd7c-e661-4095-bb75-f1deea4ae8df {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:38 devstack sudo[108069]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5c26a25a-c86f-4468-9b45-3e031a6a2287 tempest-ProjectMemberTests-1092548551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-989cfac5-cf1e-4e81-85ea-8ffce2aaf6dd" returned: 0 in 0.800s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5c26a25a-c86f-4468-9b45-3e031a6a2287 tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-989cfac5-cf1e-4e81-85ea-8ffce2aaf6dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-989cfac5-cf1e-4e81-85ea-8ffce2aaf6dd.f8e717b5-cb13-4be2-931d-991d7aa422a3 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:38 devstack sudo[108079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-82e8b4ae-2309-44b2-9458-806f8b15dccc.e2b2cd7c-e661-4095-bb75-f1deea4ae8df
Jul 09 14:55:38 devstack sudo[108079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:38 devstack sudo[108080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-989cfac5-cf1e-4e81-85ea-8ffce2aaf6dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-989cfac5-cf1e-4e81-85ea-8ffce2aaf6dd.f8e717b5-cb13-4be2-931d-991d7aa422a3 1G
Jul 09 14:55:38 devstack sudo[108080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:39 devstack sudo[108079]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1359c756-40db-433e-b738-eef1f0652440 tempest-ProjectReaderTests-934378749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-82e8b4ae-2309-44b2-9458-806f8b15dccc.e2b2cd7c-e661-4095-bb75-f1deea4ae8df" returned: 0 in 0.643s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:39 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1359c756-40db-433e-b738-eef1f0652440 tempest-ProjectReaderTests-934378749 None] Lock "cinder-quobyte-e2b2cd7c-e661-4095-bb75-f1deea4ae8df" released by "_delete_snapshot" :: held 3.032s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:55:39 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1359c756-40db-433e-b738-eef1f0652440 tempest-ProjectReaderTests-934378749 None] Lock "cinder-quobyte-82e8b4ae-2309-44b2-9458-806f8b15dccc" released by "delete_snapshot" :: held 3.060s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:55:39 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-1359c756-40db-433e-b738-eef1f0652440 tempest-ProjectReaderTests-934378749 None] Created reservations ['421e5ad0-1662-4fda-9f1e-fea2e107f1f5', '9c89edad-3aa3-47b7-a75d-be34c639b6c9', '1d8e5a32-f37b-4587-9764-9e366ab800b8', '7df8bd4e-fca9-4172-804b-1d0d3ac0b288'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:55:39 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-1359c756-40db-433e-b738-eef1f0652440 tempest-ProjectReaderTests-934378749 None] Delete snapshot completed successfully.
Jul 09 14:55:39 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1359c756-40db-433e-b738-eef1f0652440 tempest-ProjectReaderTests-934378749 None] Lock "cinder-e2b2cd7c-e661-4095-bb75-f1deea4ae8df-delete_snapshot" released by "delete_snapshot" :: held 3.199s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:55:39 devstack sudo[108080]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5c26a25a-c86f-4468-9b45-3e031a6a2287 tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-989cfac5-cf1e-4e81-85ea-8ffce2aaf6dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-989cfac5-cf1e-4e81-85ea-8ffce2aaf6dd.f8e717b5-cb13-4be2-931d-991d7aa422a3 1G" returned: 0 in 0.823s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5c26a25a-c86f-4468-9b45-3e031a6a2287 tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-989cfac5-cf1e-4e81-85ea-8ffce2aaf6dd -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-989cfac5-cf1e-4e81-85ea-8ffce2aaf6dd.f8e717b5-cb13-4be2-931d-991d7aa422a3 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:39 devstack sudo[108087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-989cfac5-cf1e-4e81-85ea-8ffce2aaf6dd -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-989cfac5-cf1e-4e81-85ea-8ffce2aaf6dd.f8e717b5-cb13-4be2-931d-991d7aa422a3
Jul 09 14:55:39 devstack sudo[108087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:40 devstack sudo[108087]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5c26a25a-c86f-4468-9b45-3e031a6a2287 tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-989cfac5-cf1e-4e81-85ea-8ffce2aaf6dd -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-989cfac5-cf1e-4e81-85ea-8ffce2aaf6dd.f8e717b5-cb13-4be2-931d-991d7aa422a3" returned: 0 in 0.665s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:40 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-5c26a25a-c86f-4468-9b45-3e031a6a2287 tempest-ProjectMemberTests-1092548551 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-989cfac5-cf1e-4e81-85ea-8ffce2aaf6dd.f8e717b5-cb13-4be2-931d-991d7aa422a3 is being set with open permissions: ugo+rw
Jul 09 14:55:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5c26a25a-c86f-4468-9b45-3e031a6a2287 tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-989cfac5-cf1e-4e81-85ea-8ffce2aaf6dd.f8e717b5-cb13-4be2-931d-991d7aa422a3 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:40 devstack sudo[108092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-989cfac5-cf1e-4e81-85ea-8ffce2aaf6dd.f8e717b5-cb13-4be2-931d-991d7aa422a3
Jul 09 14:55:40 devstack sudo[108092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:40 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e9cea36f-7690-452e-961e-07b51cacc483 tempest-ProjectReaderTests-934378749 None] Acquiring lock "cinder-82e8b4ae-2309-44b2-9458-806f8b15dccc-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:55:40 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e9cea36f-7690-452e-961e-07b51cacc483 tempest-ProjectReaderTests-934378749 None] Lock "cinder-82e8b4ae-2309-44b2-9458-806f8b15dccc-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:55:40 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e9cea36f-7690-452e-961e-07b51cacc483 tempest-ProjectReaderTests-934378749 None] Acquiring lock "cinder-quobyte-82e8b4ae-2309-44b2-9458-806f8b15dccc" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:55:40 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e9cea36f-7690-452e-961e-07b51cacc483 tempest-ProjectReaderTests-934378749 None] Lock "cinder-quobyte-82e8b4ae-2309-44b2-9458-806f8b15dccc" acquired by "delete_volume" :: waited 0.016s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:55:40 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab88a66d-b549-457a-b113-e87a7670d86b]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:55:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e9cea36f-7690-452e-961e-07b51cacc483 tempest-ProjectReaderTests-934378749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-82e8b4ae-2309-44b2-9458-806f8b15dccc {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:40 devstack sudo[108094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-82e8b4ae-2309-44b2-9458-806f8b15dccc
Jul 09 14:55:40 devstack sudo[108094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:40 devstack sudo[108092]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5c26a25a-c86f-4468-9b45-3e031a6a2287 tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-989cfac5-cf1e-4e81-85ea-8ffce2aaf6dd.f8e717b5-cb13-4be2-931d-991d7aa422a3" returned: 0 in 0.657s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5c26a25a-c86f-4468-9b45-3e031a6a2287 tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-989cfac5-cf1e-4e81-85ea-8ffce2aaf6dd.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:40 devstack sudo[108097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-989cfac5-cf1e-4e81-85ea-8ffce2aaf6dd.info
Jul 09 14:55:40 devstack sudo[108097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:41 devstack sudo[108094]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e9cea36f-7690-452e-961e-07b51cacc483 tempest-ProjectReaderTests-934378749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-82e8b4ae-2309-44b2-9458-806f8b15dccc" returned: 0 in 0.783s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e9cea36f-7690-452e-961e-07b51cacc483 tempest-ProjectReaderTests-934378749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-82e8b4ae-2309-44b2-9458-806f8b15dccc {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:41 devstack sudo[108103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-82e8b4ae-2309-44b2-9458-806f8b15dccc
Jul 09 14:55:41 devstack sudo[108103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:41 devstack sudo[108097]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5c26a25a-c86f-4468-9b45-3e031a6a2287 tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-989cfac5-cf1e-4e81-85ea-8ffce2aaf6dd.info" returned: 0 in 0.653s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:41 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-5c26a25a-c86f-4468-9b45-3e031a6a2287 tempest-ProjectMemberTests-1092548551 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-989cfac5-cf1e-4e81-85ea-8ffce2aaf6dd.info is being set with open permissions: ugo+rw
Jul 09 14:55:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5c26a25a-c86f-4468-9b45-3e031a6a2287 tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-989cfac5-cf1e-4e81-85ea-8ffce2aaf6dd.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:41 devstack sudo[108106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-989cfac5-cf1e-4e81-85ea-8ffce2aaf6dd.info
Jul 09 14:55:41 devstack sudo[108106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:42 devstack sudo[108103]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e9cea36f-7690-452e-961e-07b51cacc483 tempest-ProjectReaderTests-934378749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-82e8b4ae-2309-44b2-9458-806f8b15dccc" returned: 0 in 0.667s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:42 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e9cea36f-7690-452e-961e-07b51cacc483 tempest-ProjectReaderTests-934378749 None] Lock "cinder-quobyte-82e8b4ae-2309-44b2-9458-806f8b15dccc" released by "delete_volume" :: held 1.511s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:55:42 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-e9cea36f-7690-452e-961e-07b51cacc483 tempest-ProjectReaderTests-934378749 None] Created reservations ['8f434780-6b46-410f-b47d-ecccfcb74490', '3bc8b162-9b1f-4966-a85b-a8820b5a25f1', '9010e689-2d10-4816-ba6c-70b17336e05c', '3eb49946-8982-437a-951c-1529193810fa'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:55:42 devstack sudo[108106]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e9cea36f-7690-452e-961e-07b51cacc483 tempest-ProjectReaderTests-934378749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:55:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e9cea36f-7690-452e-961e-07b51cacc483 tempest-ProjectReaderTests-934378749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:55:42 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-e9cea36f-7690-452e-961e-07b51cacc483 tempest-ProjectReaderTests-934378749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:55:42 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-e9cea36f-7690-452e-961e-07b51cacc483 tempest-ProjectReaderTests-934378749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:55:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e9cea36f-7690-452e-961e-07b51cacc483 tempest-ProjectReaderTests-934378749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:55:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e9cea36f-7690-452e-961e-07b51cacc483 tempest-ProjectReaderTests-934378749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5c26a25a-c86f-4468-9b45-3e031a6a2287 tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-989cfac5-cf1e-4e81-85ea-8ffce2aaf6dd.info" returned: 0 in 0.665s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:42 devstack sudo[108110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:55:42 devstack sudo[108110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5c26a25a-c86f-4468-9b45-3e031a6a2287 tempest-ProjectMemberTests-1092548551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.344s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:55:42 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-5c26a25a-c86f-4468-9b45-3e031a6a2287 tempest-ProjectMemberTests-1092548551 None] Create snapshot completed successfully
Jul 09 14:55:42 devstack sudo[108110]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e9cea36f-7690-452e-961e-07b51cacc483 tempest-ProjectReaderTests-934378749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.674s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:42 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-e9cea36f-7690-452e-961e-07b51cacc483 tempest-ProjectReaderTests-934378749 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:55:42 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-e9cea36f-7690-452e-961e-07b51cacc483 tempest-ProjectReaderTests-934378749 None] Deleted volume successfully.
Jul 09 14:55:42 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e9cea36f-7690-452e-961e-07b51cacc483 tempest-ProjectReaderTests-934378749 None] Lock "cinder-82e8b4ae-2309-44b2-9458-806f8b15dccc-delete_volume" released by "delete_volume" :: held 2.385s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:55:43 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-0f28e40a-9b04-4d31-8e19-0a18f082ae9b tempest-ProjectMemberTests-1092548551 None] Acquiring lock "cinder-f8e717b5-cb13-4be2-931d-991d7aa422a3-delete_snapshot" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:55:43 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-0f28e40a-9b04-4d31-8e19-0a18f082ae9b tempest-ProjectMemberTests-1092548551 None] Lock "cinder-f8e717b5-cb13-4be2-931d-991d7aa422a3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:55:43 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-0f28e40a-9b04-4d31-8e19-0a18f082ae9b tempest-ProjectMemberTests-1092548551 None] Acquiring lock "cinder-quobyte-989cfac5-cf1e-4e81-85ea-8ffce2aaf6dd" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:55:43 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-0f28e40a-9b04-4d31-8e19-0a18f082ae9b tempest-ProjectMemberTests-1092548551 None] Lock "cinder-quobyte-989cfac5-cf1e-4e81-85ea-8ffce2aaf6dd" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:55:43 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-0f28e40a-9b04-4d31-8e19-0a18f082ae9b tempest-ProjectMemberTests-1092548551 None] Acquiring lock "cinder-quobyte-f8e717b5-cb13-4be2-931d-991d7aa422a3" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:55:43 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-0f28e40a-9b04-4d31-8e19-0a18f082ae9b tempest-ProjectMemberTests-1092548551 None] Lock "cinder-quobyte-f8e717b5-cb13-4be2-931d-991d7aa422a3" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:55:43 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-0f28e40a-9b04-4d31-8e19-0a18f082ae9b tempest-ProjectMemberTests-1092548551 None] Deleting offline snapshot f8e717b5-cb13-4be2-931d-991d7aa422a3 of volume 989cfac5-cf1e-4e81-85ea-8ffce2aaf6dd {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 14:55:43 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-0f28e40a-9b04-4d31-8e19-0a18f082ae9b tempest-ProjectMemberTests-1092548551 None] snapshot_file for this snap is: volume-989cfac5-cf1e-4e81-85ea-8ffce2aaf6dd.f8e717b5-cb13-4be2-931d-991d7aa422a3 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 14:55:43 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[1acf58a4-1020-4ef9-bf06-69fbd33479b0]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:55:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0f28e40a-9b04-4d31-8e19-0a18f082ae9b tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-989cfac5-cf1e-4e81-85ea-8ffce2aaf6dd.f8e717b5-cb13-4be2-931d-991d7aa422a3 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:43 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-417c0f94-552c-41a9-bdb3-8ae82445d6e7 tempest-ProjectReaderTests-934378749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:55:43 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-417c0f94-552c-41a9-bdb3-8ae82445d6e7 tempest-ProjectReaderTests-934378749 None] Flow 'volume_create_manager' (ae6f8d2b-8b04-498e-95eb-44a6cb8137c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:55:43 devstack sudo[108113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-989cfac5-cf1e-4e81-85ea-8ffce2aaf6dd.f8e717b5-cb13-4be2-931d-991d7aa422a3
Jul 09 14:55:43 devstack sudo[108113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:43 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-417c0f94-552c-41a9-bdb3-8ae82445d6e7 tempest-ProjectReaderTests-934378749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b495bf61-78f0-433e-995b-6909392fd99e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:55:43 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-417c0f94-552c-41a9-bdb3-8ae82445d6e7 tempest-ProjectReaderTests-934378749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b495bf61-78f0-433e-995b-6909392fd99e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:55:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-530336695',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d954f400-c0a0-4c52-9e13-a9b84e27239a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20599830728f47858cc21c11b6e6bbac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:55:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:55:43Z,use_quota=True,user_id='a49bf6be1b4b4e2d810713bc1d8374d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:55:43 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-417c0f94-552c-41a9-bdb3-8ae82445d6e7 tempest-ProjectReaderTests-934378749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5906f49-888a-4c38-bcc3-dc0cca353870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:55:43 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-417c0f94-552c-41a9-bdb3-8ae82445d6e7 tempest-ProjectReaderTests-934378749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5906f49-888a-4c38-bcc3-dc0cca353870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:55:43 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-417c0f94-552c-41a9-bdb3-8ae82445d6e7 tempest-ProjectReaderTests-934378749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac8a7e0b-36c7-47d8-9126-61c60f46a0de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:55:43 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-417c0f94-552c-41a9-bdb3-8ae82445d6e7 tempest-ProjectReaderTests-934378749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac8a7e0b-36c7-47d8-9126-61c60f46a0de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd954f400-c0a0-4c52-9e13-a9b84e27239a', 'volume_name': 'volume-d954f400-c0a0-4c52-9e13-a9b84e27239a', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:55:43 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-417c0f94-552c-41a9-bdb3-8ae82445d6e7 tempest-ProjectReaderTests-934378749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4878bb2d-acd2-4113-8dda-36d7297fb33e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:55:43 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-417c0f94-552c-41a9-bdb3-8ae82445d6e7 tempest-ProjectReaderTests-934378749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4878bb2d-acd2-4113-8dda-36d7297fb33e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:55:43 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-417c0f94-552c-41a9-bdb3-8ae82445d6e7 tempest-ProjectReaderTests-934378749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f91fc8fa-f74e-4766-812b-9bb4918d611f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:55:43 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-417c0f94-552c-41a9-bdb3-8ae82445d6e7 tempest-ProjectReaderTests-934378749 None] Volume d954f400-c0a0-4c52-9e13-a9b84e27239a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d954f400-c0a0-4c52-9e13-a9b84e27239a', 'volume_size': 1}
Jul 09 14:55:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-417c0f94-552c-41a9-bdb3-8ae82445d6e7 tempest-ProjectReaderTests-934378749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:55:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-417c0f94-552c-41a9-bdb3-8ae82445d6e7 tempest-ProjectReaderTests-934378749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:55:43 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-417c0f94-552c-41a9-bdb3-8ae82445d6e7 tempest-ProjectReaderTests-934378749 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:55:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-530336695',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d954f400-c0a0-4c52-9e13-a9b84e27239a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20599830728f47858cc21c11b6e6bbac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:55:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:55:43Z,use_quota=True,user_id='a49bf6be1b4b4e2d810713bc1d8374d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:55:43 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-417c0f94-552c-41a9-bdb3-8ae82445d6e7 tempest-ProjectReaderTests-934378749 None] Creating volume d954f400-c0a0-4c52-9e13-a9b84e27239a {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:55:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-417c0f94-552c-41a9-bdb3-8ae82445d6e7 tempest-ProjectReaderTests-934378749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:55:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-417c0f94-552c-41a9-bdb3-8ae82445d6e7 tempest-ProjectReaderTests-934378749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:55:43 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-417c0f94-552c-41a9-bdb3-8ae82445d6e7 tempest-ProjectReaderTests-934378749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:55:43 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-417c0f94-552c-41a9-bdb3-8ae82445d6e7 tempest-ProjectReaderTests-934378749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:55:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-417c0f94-552c-41a9-bdb3-8ae82445d6e7 tempest-ProjectReaderTests-934378749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:55:43 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-417c0f94-552c-41a9-bdb3-8ae82445d6e7 tempest-ProjectReaderTests-934378749 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:55:43 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-417c0f94-552c-41a9-bdb3-8ae82445d6e7 tempest-ProjectReaderTests-934378749 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:55:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-417c0f94-552c-41a9-bdb3-8ae82445d6e7 tempest-ProjectReaderTests-934378749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d954f400-c0a0-4c52-9e13-a9b84e27239a 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:43 devstack sudo[108115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d954f400-c0a0-4c52-9e13-a9b84e27239a 1073741824
Jul 09 14:55:43 devstack sudo[108115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:43 devstack sudo[108113]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0f28e40a-9b04-4d31-8e19-0a18f082ae9b tempest-ProjectMemberTests-1092548551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-989cfac5-cf1e-4e81-85ea-8ffce2aaf6dd.f8e717b5-cb13-4be2-931d-991d7aa422a3" returned: 0 in 0.774s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:43 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-0f28e40a-9b04-4d31-8e19-0a18f082ae9b tempest-ProjectMemberTests-1092548551 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-989cfac5-cf1e-4e81-85ea-8ffce2aaf6dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 14:55:44 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[609aeacc-ad30-4cd1-bf39-5912c70bc602]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:55:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0f28e40a-9b04-4d31-8e19-0a18f082ae9b tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-989cfac5-cf1e-4e81-85ea-8ffce2aaf6dd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:44 devstack sudo[108123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-989cfac5-cf1e-4e81-85ea-8ffce2aaf6dd
Jul 09 14:55:44 devstack sudo[108123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:44 devstack sudo[108115]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-417c0f94-552c-41a9-bdb3-8ae82445d6e7 tempest-ProjectReaderTests-934378749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d954f400-c0a0-4c52-9e13-a9b84e27239a 1073741824" returned: 0 in 0.849s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-417c0f94-552c-41a9-bdb3-8ae82445d6e7 tempest-ProjectReaderTests-934378749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d954f400-c0a0-4c52-9e13-a9b84e27239a {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:44 devstack sudo[108125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d954f400-c0a0-4c52-9e13-a9b84e27239a
Jul 09 14:55:44 devstack sudo[108125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:44 devstack sudo[108123]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0f28e40a-9b04-4d31-8e19-0a18f082ae9b tempest-ProjectMemberTests-1092548551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-989cfac5-cf1e-4e81-85ea-8ffce2aaf6dd" returned: 0 in 0.774s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0f28e40a-9b04-4d31-8e19-0a18f082ae9b tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-989cfac5-cf1e-4e81-85ea-8ffce2aaf6dd.f8e717b5-cb13-4be2-931d-991d7aa422a3 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:44 devstack sudo[108130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-989cfac5-cf1e-4e81-85ea-8ffce2aaf6dd.f8e717b5-cb13-4be2-931d-991d7aa422a3
Jul 09 14:55:44 devstack sudo[108130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:44 devstack sudo[108125]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-417c0f94-552c-41a9-bdb3-8ae82445d6e7 tempest-ProjectReaderTests-934378749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d954f400-c0a0-4c52-9e13-a9b84e27239a" returned: 0 in 0.677s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:44 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-417c0f94-552c-41a9-bdb3-8ae82445d6e7 tempest-ProjectReaderTests-934378749 None] <== create_volume: return (1570ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:55:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-417c0f94-552c-41a9-bdb3-8ae82445d6e7 tempest-ProjectReaderTests-934378749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.572s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:55:44 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-417c0f94-552c-41a9-bdb3-8ae82445d6e7 tempest-ProjectReaderTests-934378749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f91fc8fa-f74e-4766-812b-9bb4918d611f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d954f400-c0a0-4c52-9e13-a9b84e27239a', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:55:44 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-417c0f94-552c-41a9-bdb3-8ae82445d6e7 tempest-ProjectReaderTests-934378749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ded7f1cb-2e7b-4231-818c-ea342ae6f9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:55:44 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-417c0f94-552c-41a9-bdb3-8ae82445d6e7 tempest-ProjectReaderTests-934378749 None] Volume volume-d954f400-c0a0-4c52-9e13-a9b84e27239a (d954f400-c0a0-4c52-9e13-a9b84e27239a): created successfully
Jul 09 14:55:45 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-417c0f94-552c-41a9-bdb3-8ae82445d6e7 tempest-ProjectReaderTests-934378749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ded7f1cb-2e7b-4231-818c-ea342ae6f9b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:55:45 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-417c0f94-552c-41a9-bdb3-8ae82445d6e7 tempest-ProjectReaderTests-934378749 None] Flow 'volume_create_manager' (ae6f8d2b-8b04-498e-95eb-44a6cb8137c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:55:45 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-417c0f94-552c-41a9-bdb3-8ae82445d6e7 tempest-ProjectReaderTests-934378749 None] Created volume successfully.
Jul 09 14:55:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-aa142411-8abc-4a04-af8e-40191c67a1d1 tempest-ProjectReaderTests-934378749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:55:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-aa142411-8abc-4a04-af8e-40191c67a1d1 tempest-ProjectReaderTests-934378749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:55:45 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-aa142411-8abc-4a04-af8e-40191c67a1d1 tempest-ProjectReaderTests-934378749 None] Creating offline snapshot 76be6da5-8578-41fc-abb3-6d444579892b of volume d954f400-c0a0-4c52-9e13-a9b84e27239a {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 14:55:45 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[36211f78-e1f6-4ecd-ab6d-54d5c7c9880e]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:55:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-aa142411-8abc-4a04-af8e-40191c67a1d1 tempest-ProjectReaderTests-934378749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d954f400-c0a0-4c52-9e13-a9b84e27239a {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:45 devstack sudo[108130]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0f28e40a-9b04-4d31-8e19-0a18f082ae9b tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-989cfac5-cf1e-4e81-85ea-8ffce2aaf6dd.f8e717b5-cb13-4be2-931d-991d7aa422a3" returned: 0 in 0.799s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0f28e40a-9b04-4d31-8e19-0a18f082ae9b tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-989cfac5-cf1e-4e81-85ea-8ffce2aaf6dd.f8e717b5-cb13-4be2-931d-991d7aa422a3 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:45 devstack sudo[108137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-989cfac5-cf1e-4e81-85ea-8ffce2aaf6dd.f8e717b5-cb13-4be2-931d-991d7aa422a3
Jul 09 14:55:45 devstack sudo[108137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:45 devstack sudo[108136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d954f400-c0a0-4c52-9e13-a9b84e27239a
Jul 09 14:55:45 devstack sudo[108136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:46 devstack sudo[108137]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0f28e40a-9b04-4d31-8e19-0a18f082ae9b tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-989cfac5-cf1e-4e81-85ea-8ffce2aaf6dd.f8e717b5-cb13-4be2-931d-991d7aa422a3" returned: 0 in 0.659s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:46 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-0f28e40a-9b04-4d31-8e19-0a18f082ae9b tempest-ProjectMemberTests-1092548551 None] Lock "cinder-quobyte-f8e717b5-cb13-4be2-931d-991d7aa422a3" released by "_delete_snapshot" :: held 3.103s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:55:46 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-0f28e40a-9b04-4d31-8e19-0a18f082ae9b tempest-ProjectMemberTests-1092548551 None] Lock "cinder-quobyte-989cfac5-cf1e-4e81-85ea-8ffce2aaf6dd" released by "delete_snapshot" :: held 3.134s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:55:46 devstack sudo[108136]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-aa142411-8abc-4a04-af8e-40191c67a1d1 tempest-ProjectReaderTests-934378749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d954f400-c0a0-4c52-9e13-a9b84e27239a" returned: 0 in 0.780s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-aa142411-8abc-4a04-af8e-40191c67a1d1 tempest-ProjectReaderTests-934378749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d954f400-c0a0-4c52-9e13-a9b84e27239a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d954f400-c0a0-4c52-9e13-a9b84e27239a.76be6da5-8578-41fc-abb3-6d444579892b 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:46 devstack sudo[108144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d954f400-c0a0-4c52-9e13-a9b84e27239a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d954f400-c0a0-4c52-9e13-a9b84e27239a.76be6da5-8578-41fc-abb3-6d444579892b 1G
Jul 09 14:55:46 devstack sudo[108144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:46 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-0f28e40a-9b04-4d31-8e19-0a18f082ae9b tempest-ProjectMemberTests-1092548551 None] Created reservations ['b11b46bb-0491-4129-a9f2-b0e4d4d484ce', 'd773492b-a0f6-4241-b971-822090937672', 'c0360b5b-216b-415f-85cf-395d6d4b3013', 'afdfa021-278a-4d24-bc0c-2ca8ad58ee32'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:55:46 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-0f28e40a-9b04-4d31-8e19-0a18f082ae9b tempest-ProjectMemberTests-1092548551 None] Delete snapshot completed successfully.
Jul 09 14:55:46 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-0f28e40a-9b04-4d31-8e19-0a18f082ae9b tempest-ProjectMemberTests-1092548551 None] Lock "cinder-f8e717b5-cb13-4be2-931d-991d7aa422a3-delete_snapshot" released by "delete_snapshot" :: held 3.298s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:55:47 devstack sudo[108144]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-aa142411-8abc-4a04-af8e-40191c67a1d1 tempest-ProjectReaderTests-934378749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d954f400-c0a0-4c52-9e13-a9b84e27239a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d954f400-c0a0-4c52-9e13-a9b84e27239a.76be6da5-8578-41fc-abb3-6d444579892b 1G" returned: 0 in 0.783s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-aa142411-8abc-4a04-af8e-40191c67a1d1 tempest-ProjectReaderTests-934378749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d954f400-c0a0-4c52-9e13-a9b84e27239a -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d954f400-c0a0-4c52-9e13-a9b84e27239a.76be6da5-8578-41fc-abb3-6d444579892b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:47 devstack sudo[108150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d954f400-c0a0-4c52-9e13-a9b84e27239a -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d954f400-c0a0-4c52-9e13-a9b84e27239a.76be6da5-8578-41fc-abb3-6d444579892b
Jul 09 14:55:47 devstack sudo[108150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:47 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-ef044d23-6221-406c-991a-f2d5750ed545 tempest-ProjectMemberTests-1092548551 None] Acquiring lock "cinder-989cfac5-cf1e-4e81-85ea-8ffce2aaf6dd-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:55:47 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-ef044d23-6221-406c-991a-f2d5750ed545 tempest-ProjectMemberTests-1092548551 None] Lock "cinder-989cfac5-cf1e-4e81-85ea-8ffce2aaf6dd-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:55:47 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-ef044d23-6221-406c-991a-f2d5750ed545 tempest-ProjectMemberTests-1092548551 None] Acquiring lock "cinder-quobyte-989cfac5-cf1e-4e81-85ea-8ffce2aaf6dd" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:55:47 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-ef044d23-6221-406c-991a-f2d5750ed545 tempest-ProjectMemberTests-1092548551 None] Lock "cinder-quobyte-989cfac5-cf1e-4e81-85ea-8ffce2aaf6dd" acquired by "delete_volume" :: waited 0.016s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:55:47 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[30082262-83bc-4845-9775-ef0f18e60946]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:55:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ef044d23-6221-406c-991a-f2d5750ed545 tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-989cfac5-cf1e-4e81-85ea-8ffce2aaf6dd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:47 devstack sudo[108152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-989cfac5-cf1e-4e81-85ea-8ffce2aaf6dd
Jul 09 14:55:47 devstack sudo[108152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:47 devstack sudo[108150]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-aa142411-8abc-4a04-af8e-40191c67a1d1 tempest-ProjectReaderTests-934378749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d954f400-c0a0-4c52-9e13-a9b84e27239a -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d954f400-c0a0-4c52-9e13-a9b84e27239a.76be6da5-8578-41fc-abb3-6d444579892b" returned: 0 in 0.704s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:47 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-aa142411-8abc-4a04-af8e-40191c67a1d1 tempest-ProjectReaderTests-934378749 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d954f400-c0a0-4c52-9e13-a9b84e27239a.76be6da5-8578-41fc-abb3-6d444579892b is being set with open permissions: ugo+rw
Jul 09 14:55:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-aa142411-8abc-4a04-af8e-40191c67a1d1 tempest-ProjectReaderTests-934378749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d954f400-c0a0-4c52-9e13-a9b84e27239a.76be6da5-8578-41fc-abb3-6d444579892b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:47 devstack sudo[108157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d954f400-c0a0-4c52-9e13-a9b84e27239a.76be6da5-8578-41fc-abb3-6d444579892b
Jul 09 14:55:47 devstack sudo[108157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:48 devstack sudo[108152]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ef044d23-6221-406c-991a-f2d5750ed545 tempest-ProjectMemberTests-1092548551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-989cfac5-cf1e-4e81-85ea-8ffce2aaf6dd" returned: 0 in 0.825s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ef044d23-6221-406c-991a-f2d5750ed545 tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-989cfac5-cf1e-4e81-85ea-8ffce2aaf6dd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:48 devstack sudo[108162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-989cfac5-cf1e-4e81-85ea-8ffce2aaf6dd
Jul 09 14:55:48 devstack sudo[108162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:48 devstack sudo[108157]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-aa142411-8abc-4a04-af8e-40191c67a1d1 tempest-ProjectReaderTests-934378749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d954f400-c0a0-4c52-9e13-a9b84e27239a.76be6da5-8578-41fc-abb3-6d444579892b" returned: 0 in 0.658s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-aa142411-8abc-4a04-af8e-40191c67a1d1 tempest-ProjectReaderTests-934378749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d954f400-c0a0-4c52-9e13-a9b84e27239a.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:48 devstack sudo[108165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d954f400-c0a0-4c52-9e13-a9b84e27239a.info
Jul 09 14:55:48 devstack sudo[108165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:48 devstack sudo[108162]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ef044d23-6221-406c-991a-f2d5750ed545 tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-989cfac5-cf1e-4e81-85ea-8ffce2aaf6dd" returned: 0 in 0.671s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:48 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-ef044d23-6221-406c-991a-f2d5750ed545 tempest-ProjectMemberTests-1092548551 None] Lock "cinder-quobyte-989cfac5-cf1e-4e81-85ea-8ffce2aaf6dd" released by "delete_volume" :: held 1.550s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:55:49 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-ef044d23-6221-406c-991a-f2d5750ed545 tempest-ProjectMemberTests-1092548551 None] Created reservations ['77f05993-a152-4232-95e1-df3bbf3b2775', '5b066e2a-3b72-49cc-8280-2a8d5f78fe9c', 'd648a46d-7a9b-4edc-8d8f-d4688a724b11', 'f5a1262e-be22-4f56-b89d-492544a4af74'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:55:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-ef044d23-6221-406c-991a-f2d5750ed545 tempest-ProjectMemberTests-1092548551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:55:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-ef044d23-6221-406c-991a-f2d5750ed545 tempest-ProjectMemberTests-1092548551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:55:49 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-ef044d23-6221-406c-991a-f2d5750ed545 tempest-ProjectMemberTests-1092548551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:55:49 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-ef044d23-6221-406c-991a-f2d5750ed545 tempest-ProjectMemberTests-1092548551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:55:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-ef044d23-6221-406c-991a-f2d5750ed545 tempest-ProjectMemberTests-1092548551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:55:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ef044d23-6221-406c-991a-f2d5750ed545 tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:49 devstack sudo[108203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:55:49 devstack sudo[108203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:49 devstack sudo[108165]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-aa142411-8abc-4a04-af8e-40191c67a1d1 tempest-ProjectReaderTests-934378749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d954f400-c0a0-4c52-9e13-a9b84e27239a.info" returned: 0 in 0.709s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:49 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-aa142411-8abc-4a04-af8e-40191c67a1d1 tempest-ProjectReaderTests-934378749 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d954f400-c0a0-4c52-9e13-a9b84e27239a.info is being set with open permissions: ugo+rw
Jul 09 14:55:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-aa142411-8abc-4a04-af8e-40191c67a1d1 tempest-ProjectReaderTests-934378749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d954f400-c0a0-4c52-9e13-a9b84e27239a.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:49 devstack sudo[108207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d954f400-c0a0-4c52-9e13-a9b84e27239a.info
Jul 09 14:55:49 devstack sudo[108207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:49 devstack sudo[108203]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ef044d23-6221-406c-991a-f2d5750ed545 tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.696s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:49 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-ef044d23-6221-406c-991a-f2d5750ed545 tempest-ProjectMemberTests-1092548551 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:55:49 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-ef044d23-6221-406c-991a-f2d5750ed545 tempest-ProjectMemberTests-1092548551 None] Deleted volume successfully.
Jul 09 14:55:49 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-ef044d23-6221-406c-991a-f2d5750ed545 tempest-ProjectMemberTests-1092548551 None] Lock "cinder-989cfac5-cf1e-4e81-85ea-8ffce2aaf6dd-delete_volume" released by "delete_volume" :: held 2.486s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:55:49 devstack sudo[108207]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-aa142411-8abc-4a04-af8e-40191c67a1d1 tempest-ProjectReaderTests-934378749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d954f400-c0a0-4c52-9e13-a9b84e27239a.info" returned: 0 in 0.705s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-aa142411-8abc-4a04-af8e-40191c67a1d1 tempest-ProjectReaderTests-934378749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.424s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:55:49 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-aa142411-8abc-4a04-af8e-40191c67a1d1 tempest-ProjectReaderTests-934378749 None] Create snapshot completed successfully
Jul 09 14:55:50 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-47a8b1ca-8882-440e-bb27-4a24217623d4 tempest-ProjectMemberTests-1092548551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:55:50 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-47a8b1ca-8882-440e-bb27-4a24217623d4 tempest-ProjectMemberTests-1092548551 None] Flow 'volume_create_manager' (cd8c575a-6bcd-4451-976f-7999496d03e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:55:50 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-47a8b1ca-8882-440e-bb27-4a24217623d4 tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdfa5d92-7580-4298-a5a2-7223c06f8c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:55:50 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-47a8b1ca-8882-440e-bb27-4a24217623d4 tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdfa5d92-7580-4298-a5a2-7223c06f8c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:55:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-76046920',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f07eec85-7186-4639-a52a-5e4bcdc8dde2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53e3a7b509634eeda7e218e1577efd89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:55:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:55:50Z,use_quota=True,user_id='6f31a0c3fe3e49ccabfa9bdf47df92af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:55:50 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-47a8b1ca-8882-440e-bb27-4a24217623d4 tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e784b4d-a004-42cf-a8d7-510860d4a87c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:55:50 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-47a8b1ca-8882-440e-bb27-4a24217623d4 tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e784b4d-a004-42cf-a8d7-510860d4a87c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:55:50 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-47a8b1ca-8882-440e-bb27-4a24217623d4 tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (733de19d-2479-4920-9eba-2e63651461ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:55:50 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-47a8b1ca-8882-440e-bb27-4a24217623d4 tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (733de19d-2479-4920-9eba-2e63651461ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f07eec85-7186-4639-a52a-5e4bcdc8dde2', 'volume_name': 'volume-f07eec85-7186-4639-a52a-5e4bcdc8dde2', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:55:50 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-47a8b1ca-8882-440e-bb27-4a24217623d4 tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ceae68fe-9040-4220-9e95-2873c01a93cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:55:50 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-47a8b1ca-8882-440e-bb27-4a24217623d4 tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ceae68fe-9040-4220-9e95-2873c01a93cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:55:50 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-47a8b1ca-8882-440e-bb27-4a24217623d4 tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0883c725-492f-4d8f-aa01-087e8f152d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:55:50 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-47a8b1ca-8882-440e-bb27-4a24217623d4 tempest-ProjectMemberTests-1092548551 None] Volume f07eec85-7186-4639-a52a-5e4bcdc8dde2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f07eec85-7186-4639-a52a-5e4bcdc8dde2', 'volume_size': 1}
Jul 09 14:55:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-47a8b1ca-8882-440e-bb27-4a24217623d4 tempest-ProjectMemberTests-1092548551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:55:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-47a8b1ca-8882-440e-bb27-4a24217623d4 tempest-ProjectMemberTests-1092548551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:55:50 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-47a8b1ca-8882-440e-bb27-4a24217623d4 tempest-ProjectMemberTests-1092548551 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:55:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-76046920',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f07eec85-7186-4639-a52a-5e4bcdc8dde2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53e3a7b509634eeda7e218e1577efd89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:55:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:55:50Z,use_quota=True,user_id='6f31a0c3fe3e49ccabfa9bdf47df92af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:55:50 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-47a8b1ca-8882-440e-bb27-4a24217623d4 tempest-ProjectMemberTests-1092548551 None] Creating volume f07eec85-7186-4639-a52a-5e4bcdc8dde2 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:55:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-47a8b1ca-8882-440e-bb27-4a24217623d4 tempest-ProjectMemberTests-1092548551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:55:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-47a8b1ca-8882-440e-bb27-4a24217623d4 tempest-ProjectMemberTests-1092548551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:55:50 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-47a8b1ca-8882-440e-bb27-4a24217623d4 tempest-ProjectMemberTests-1092548551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:55:50 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-47a8b1ca-8882-440e-bb27-4a24217623d4 tempest-ProjectMemberTests-1092548551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:55:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-47a8b1ca-8882-440e-bb27-4a24217623d4 tempest-ProjectMemberTests-1092548551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:55:50 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-47a8b1ca-8882-440e-bb27-4a24217623d4 tempest-ProjectMemberTests-1092548551 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:55:50 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-47a8b1ca-8882-440e-bb27-4a24217623d4 tempest-ProjectMemberTests-1092548551 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:55:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-47a8b1ca-8882-440e-bb27-4a24217623d4 tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-f07eec85-7186-4639-a52a-5e4bcdc8dde2 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:50 devstack sudo[108211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-f07eec85-7186-4639-a52a-5e4bcdc8dde2 1073741824
Jul 09 14:55:50 devstack sudo[108211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:50 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-78c34a34-9831-4e69-b044-19fd5f00b865 tempest-ProjectReaderTests-934378749 None] Acquiring lock "cinder-76be6da5-8578-41fc-abb3-6d444579892b-delete_snapshot" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:55:50 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-78c34a34-9831-4e69-b044-19fd5f00b865 tempest-ProjectReaderTests-934378749 None] Lock "cinder-76be6da5-8578-41fc-abb3-6d444579892b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:55:50 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-78c34a34-9831-4e69-b044-19fd5f00b865 tempest-ProjectReaderTests-934378749 None] Acquiring lock "cinder-quobyte-d954f400-c0a0-4c52-9e13-a9b84e27239a" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:55:50 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-78c34a34-9831-4e69-b044-19fd5f00b865 tempest-ProjectReaderTests-934378749 None] Lock "cinder-quobyte-d954f400-c0a0-4c52-9e13-a9b84e27239a" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:55:50 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-78c34a34-9831-4e69-b044-19fd5f00b865 tempest-ProjectReaderTests-934378749 None] Acquiring lock "cinder-quobyte-76be6da5-8578-41fc-abb3-6d444579892b" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:55:50 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-78c34a34-9831-4e69-b044-19fd5f00b865 tempest-ProjectReaderTests-934378749 None] Lock "cinder-quobyte-76be6da5-8578-41fc-abb3-6d444579892b" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:55:50 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-78c34a34-9831-4e69-b044-19fd5f00b865 tempest-ProjectReaderTests-934378749 None] Deleting offline snapshot 76be6da5-8578-41fc-abb3-6d444579892b of volume d954f400-c0a0-4c52-9e13-a9b84e27239a {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 14:55:50 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-78c34a34-9831-4e69-b044-19fd5f00b865 tempest-ProjectReaderTests-934378749 None] snapshot_file for this snap is: volume-d954f400-c0a0-4c52-9e13-a9b84e27239a.76be6da5-8578-41fc-abb3-6d444579892b {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 14:55:50 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d39ba5c-fadc-43e4-a41f-4fc3a9d86880]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:55:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-78c34a34-9831-4e69-b044-19fd5f00b865 tempest-ProjectReaderTests-934378749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d954f400-c0a0-4c52-9e13-a9b84e27239a.76be6da5-8578-41fc-abb3-6d444579892b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:50 devstack sudo[108216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d954f400-c0a0-4c52-9e13-a9b84e27239a.76be6da5-8578-41fc-abb3-6d444579892b
Jul 09 14:55:50 devstack sudo[108216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:50 devstack sudo[108211]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-47a8b1ca-8882-440e-bb27-4a24217623d4 tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-f07eec85-7186-4639-a52a-5e4bcdc8dde2 1073741824" returned: 0 in 0.862s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-47a8b1ca-8882-440e-bb27-4a24217623d4 tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-f07eec85-7186-4639-a52a-5e4bcdc8dde2 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:51 devstack sudo[108219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-f07eec85-7186-4639-a52a-5e4bcdc8dde2
Jul 09 14:55:51 devstack sudo[108219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:51 devstack sudo[108216]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-78c34a34-9831-4e69-b044-19fd5f00b865 tempest-ProjectReaderTests-934378749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d954f400-c0a0-4c52-9e13-a9b84e27239a.76be6da5-8578-41fc-abb3-6d444579892b" returned: 0 in 0.757s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:51 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-78c34a34-9831-4e69-b044-19fd5f00b865 tempest-ProjectReaderTests-934378749 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d954f400-c0a0-4c52-9e13-a9b84e27239a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 14:55:51 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1a9d474-6db2-4d68-ad52-c1f0d0a268dc]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:55:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-78c34a34-9831-4e69-b044-19fd5f00b865 tempest-ProjectReaderTests-934378749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d954f400-c0a0-4c52-9e13-a9b84e27239a {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:51 devstack sudo[108219]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-47a8b1ca-8882-440e-bb27-4a24217623d4 tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-f07eec85-7186-4639-a52a-5e4bcdc8dde2" returned: 0 in 0.683s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:51 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-47a8b1ca-8882-440e-bb27-4a24217623d4 tempest-ProjectMemberTests-1092548551 None] <== create_volume: return (1586ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:55:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-47a8b1ca-8882-440e-bb27-4a24217623d4 tempest-ProjectMemberTests-1092548551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.588s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:55:51 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-47a8b1ca-8882-440e-bb27-4a24217623d4 tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0883c725-492f-4d8f-aa01-087e8f152d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f07eec85-7186-4639-a52a-5e4bcdc8dde2', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:55:51 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-47a8b1ca-8882-440e-bb27-4a24217623d4 tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (921362d0-30a8-477e-8dcc-64c69e04f6e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:55:51 devstack sudo[108225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d954f400-c0a0-4c52-9e13-a9b84e27239a
Jul 09 14:55:51 devstack sudo[108225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:51 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-47a8b1ca-8882-440e-bb27-4a24217623d4 tempest-ProjectMemberTests-1092548551 None] Volume volume-f07eec85-7186-4639-a52a-5e4bcdc8dde2 (f07eec85-7186-4639-a52a-5e4bcdc8dde2): created successfully
Jul 09 14:55:51 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-47a8b1ca-8882-440e-bb27-4a24217623d4 tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (921362d0-30a8-477e-8dcc-64c69e04f6e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:55:51 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-47a8b1ca-8882-440e-bb27-4a24217623d4 tempest-ProjectMemberTests-1092548551 None] Flow 'volume_create_manager' (cd8c575a-6bcd-4451-976f-7999496d03e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:55:51 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-47a8b1ca-8882-440e-bb27-4a24217623d4 tempest-ProjectMemberTests-1092548551 None] Created volume successfully.
Jul 09 14:55:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b135cff0-943a-45ac-b4ca-71495bfdd99d tempest-ProjectMemberTests-1092548551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:55:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b135cff0-943a-45ac-b4ca-71495bfdd99d tempest-ProjectMemberTests-1092548551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:55:52 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-b135cff0-943a-45ac-b4ca-71495bfdd99d tempest-ProjectMemberTests-1092548551 None] Creating offline snapshot 6def49cb-3ff9-4c86-889c-22a942d9f46a of volume f07eec85-7186-4639-a52a-5e4bcdc8dde2 {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 14:55:52 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[661920ba-408d-4d75-81ea-30518772333c]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:55:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b135cff0-943a-45ac-b4ca-71495bfdd99d tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-f07eec85-7186-4639-a52a-5e4bcdc8dde2 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:52 devstack sudo[108225]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-78c34a34-9831-4e69-b044-19fd5f00b865 tempest-ProjectReaderTests-934378749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d954f400-c0a0-4c52-9e13-a9b84e27239a" returned: 0 in 0.755s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-78c34a34-9831-4e69-b044-19fd5f00b865 tempest-ProjectReaderTests-934378749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d954f400-c0a0-4c52-9e13-a9b84e27239a.76be6da5-8578-41fc-abb3-6d444579892b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:52 devstack sudo[108232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d954f400-c0a0-4c52-9e13-a9b84e27239a.76be6da5-8578-41fc-abb3-6d444579892b
Jul 09 14:55:52 devstack sudo[108232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:52 devstack sudo[108231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-f07eec85-7186-4639-a52a-5e4bcdc8dde2
Jul 09 14:55:52 devstack sudo[108231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:52 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 14:55:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:55:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:55:52 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:55:52 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:55:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:55:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:52 devstack sudo[108235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:55:52 devstack sudo[108235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:53 devstack sudo[108231]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b135cff0-943a-45ac-b4ca-71495bfdd99d tempest-ProjectMemberTests-1092548551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-f07eec85-7186-4639-a52a-5e4bcdc8dde2" returned: 0 in 0.761s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b135cff0-943a-45ac-b4ca-71495bfdd99d tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-f07eec85-7186-4639-a52a-5e4bcdc8dde2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-f07eec85-7186-4639-a52a-5e4bcdc8dde2.6def49cb-3ff9-4c86-889c-22a942d9f46a 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:53 devstack sudo[108244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-f07eec85-7186-4639-a52a-5e4bcdc8dde2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-f07eec85-7186-4639-a52a-5e4bcdc8dde2.6def49cb-3ff9-4c86-889c-22a942d9f46a 1G
Jul 09 14:55:53 devstack sudo[108244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:53 devstack sudo[108235]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.701s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:53 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:55:53 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Running periodic task VolumeManager._thread_info {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 14:55:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] thread count: 28 {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 09 14:55:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] thread info: [<_MainThread(MainThread, started 125388812103808)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125388713797504)>, <Thread(Thread-3 (stat_writer), started daemon 125388699995392)>, <Thread(Rabbit-heartbeat, started daemon 125388700522560)>, <Thread(Thread-5 (_runner), started daemon 125388698545216)>, <Thread(Thread-7 (_runner), started daemon 125388698611264)>, <Thread(fd_logger, started daemon 125388703020672)>, <Thread(privsep_reader, started daemon 125388696441088)>, <Thread(tpool_thread_0, started daemon 125388687943360)>, <Thread(tpool_thread_1, started daemon 125388679550656)>, <Thread(tpool_thread_2, started daemon 125388671141568)>, <Thread(tpool_thread_3, started daemon 125388662732480)>, <Thread(tpool_thread_4, started daemon 125388654323392)>, <Thread(tpool_thread_5, started daemon 125388645914304)>, <Thread(tpool_thread_6, started daemon 125388637505216)>, <Thread(tpool_thread_7, started daemon 125388629096128)>, <Thread(tpool_thread_8, started daemon 125388620687040)>, <Thread(tpool_thread_9, started daemon 125388612277952)>, <Thread(tpool_thread_10, started daemon 125388603868864)>, <Thread(tpool_thread_11, started daemon 125388595459776)>, <Thread(tpool_thread_12, started daemon 125388587050688)>, <Thread(tpool_thread_13, started daemon 125388578641600)>, <Thread(tpool_thread_14, started daemon 125388570232512)>, <Thread(tpool_thread_15, started daemon 125388561823424)>, <Thread(tpool_thread_16, started daemon 125388553414336)>, <Thread(tpool_thread_17, started daemon 125388545005248)>, <Thread(tpool_thread_18, started daemon 125388536596160)>, <Thread(tpool_thread_19, started daemon 125388528187072)>] {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 09 14:55:53 devstack sudo[108232]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-78c34a34-9831-4e69-b044-19fd5f00b865 tempest-ProjectReaderTests-934378749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d954f400-c0a0-4c52-9e13-a9b84e27239a.76be6da5-8578-41fc-abb3-6d444579892b" returned: 0 in 0.765s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-78c34a34-9831-4e69-b044-19fd5f00b865 tempest-ProjectReaderTests-934378749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d954f400-c0a0-4c52-9e13-a9b84e27239a.76be6da5-8578-41fc-abb3-6d444579892b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:53 devstack sudo[108246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d954f400-c0a0-4c52-9e13-a9b84e27239a.76be6da5-8578-41fc-abb3-6d444579892b
Jul 09 14:55:53 devstack sudo[108246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:53 devstack sudo[108246]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-78c34a34-9831-4e69-b044-19fd5f00b865 tempest-ProjectReaderTests-934378749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d954f400-c0a0-4c52-9e13-a9b84e27239a.76be6da5-8578-41fc-abb3-6d444579892b" returned: 0 in 0.656s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:53 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-78c34a34-9831-4e69-b044-19fd5f00b865 tempest-ProjectReaderTests-934378749 None] Lock "cinder-quobyte-76be6da5-8578-41fc-abb3-6d444579892b" released by "_delete_snapshot" :: held 3.024s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:55:53 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-78c34a34-9831-4e69-b044-19fd5f00b865 tempest-ProjectReaderTests-934378749 None] Lock "cinder-quobyte-d954f400-c0a0-4c52-9e13-a9b84e27239a" released by "delete_snapshot" :: held 3.049s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:55:53 devstack sudo[108244]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b135cff0-943a-45ac-b4ca-71495bfdd99d tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-f07eec85-7186-4639-a52a-5e4bcdc8dde2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-f07eec85-7186-4639-a52a-5e4bcdc8dde2.6def49cb-3ff9-4c86-889c-22a942d9f46a 1G" returned: 0 in 0.822s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b135cff0-943a-45ac-b4ca-71495bfdd99d tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f07eec85-7186-4639-a52a-5e4bcdc8dde2 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-f07eec85-7186-4639-a52a-5e4bcdc8dde2.6def49cb-3ff9-4c86-889c-22a942d9f46a {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:53 devstack sudo[108252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f07eec85-7186-4639-a52a-5e4bcdc8dde2 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-f07eec85-7186-4639-a52a-5e4bcdc8dde2.6def49cb-3ff9-4c86-889c-22a942d9f46a
Jul 09 14:55:53 devstack sudo[108252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:53 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-78c34a34-9831-4e69-b044-19fd5f00b865 tempest-ProjectReaderTests-934378749 None] Created reservations ['1c1cfcc1-f632-40e1-aa15-9265dfcbf566', '2715a0dd-897e-4d65-910a-91e257c960a7', 'd6c653aa-1c5a-454c-ac46-b49bd57aea7f', '5320f927-e1be-4f7d-8ee6-e71557e56e70'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:55:53 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-78c34a34-9831-4e69-b044-19fd5f00b865 tempest-ProjectReaderTests-934378749 None] Delete snapshot completed successfully.
Jul 09 14:55:53 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-78c34a34-9831-4e69-b044-19fd5f00b865 tempest-ProjectReaderTests-934378749 None] Lock "cinder-76be6da5-8578-41fc-abb3-6d444579892b-delete_snapshot" released by "delete_snapshot" :: held 3.212s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:55:54 devstack sudo[108252]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b135cff0-943a-45ac-b4ca-71495bfdd99d tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f07eec85-7186-4639-a52a-5e4bcdc8dde2 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-f07eec85-7186-4639-a52a-5e4bcdc8dde2.6def49cb-3ff9-4c86-889c-22a942d9f46a" returned: 0 in 0.670s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:54 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-b135cff0-943a-45ac-b4ca-71495bfdd99d tempest-ProjectMemberTests-1092548551 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-f07eec85-7186-4639-a52a-5e4bcdc8dde2.6def49cb-3ff9-4c86-889c-22a942d9f46a is being set with open permissions: ugo+rw
Jul 09 14:55:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b135cff0-943a-45ac-b4ca-71495bfdd99d tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-f07eec85-7186-4639-a52a-5e4bcdc8dde2.6def49cb-3ff9-4c86-889c-22a942d9f46a {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:54 devstack sudo[108257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-f07eec85-7186-4639-a52a-5e4bcdc8dde2.6def49cb-3ff9-4c86-889c-22a942d9f46a
Jul 09 14:55:54 devstack sudo[108257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:54 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d932e09f-65fd-4592-95cc-aa5957a33220 tempest-ProjectReaderTests-934378749 None] Acquiring lock "cinder-d954f400-c0a0-4c52-9e13-a9b84e27239a-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:55:55 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d932e09f-65fd-4592-95cc-aa5957a33220 tempest-ProjectReaderTests-934378749 None] Lock "cinder-d954f400-c0a0-4c52-9e13-a9b84e27239a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:55:55 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d932e09f-65fd-4592-95cc-aa5957a33220 tempest-ProjectReaderTests-934378749 None] Acquiring lock "cinder-quobyte-d954f400-c0a0-4c52-9e13-a9b84e27239a" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:55:55 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d932e09f-65fd-4592-95cc-aa5957a33220 tempest-ProjectReaderTests-934378749 None] Lock "cinder-quobyte-d954f400-c0a0-4c52-9e13-a9b84e27239a" acquired by "delete_volume" :: waited 0.017s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:55:55 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b8d1ef-b063-46e0-be2d-2458daaef33a]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:55:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d932e09f-65fd-4592-95cc-aa5957a33220 tempest-ProjectReaderTests-934378749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d954f400-c0a0-4c52-9e13-a9b84e27239a {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:55 devstack sudo[108257]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b135cff0-943a-45ac-b4ca-71495bfdd99d tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-f07eec85-7186-4639-a52a-5e4bcdc8dde2.6def49cb-3ff9-4c86-889c-22a942d9f46a" returned: 0 in 0.635s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b135cff0-943a-45ac-b4ca-71495bfdd99d tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-f07eec85-7186-4639-a52a-5e4bcdc8dde2.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:55 devstack sudo[108260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d954f400-c0a0-4c52-9e13-a9b84e27239a
Jul 09 14:55:55 devstack sudo[108260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:55 devstack sudo[108261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-f07eec85-7186-4639-a52a-5e4bcdc8dde2.info
Jul 09 14:55:55 devstack sudo[108261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:55 devstack sudo[108261]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b135cff0-943a-45ac-b4ca-71495bfdd99d tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-f07eec85-7186-4639-a52a-5e4bcdc8dde2.info" returned: 0 in 0.655s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:55 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-b135cff0-943a-45ac-b4ca-71495bfdd99d tempest-ProjectMemberTests-1092548551 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-f07eec85-7186-4639-a52a-5e4bcdc8dde2.info is being set with open permissions: ugo+rw
Jul 09 14:55:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b135cff0-943a-45ac-b4ca-71495bfdd99d tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-f07eec85-7186-4639-a52a-5e4bcdc8dde2.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:55 devstack sudo[108260]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d932e09f-65fd-4592-95cc-aa5957a33220 tempest-ProjectReaderTests-934378749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d954f400-c0a0-4c52-9e13-a9b84e27239a" returned: 0 in 0.784s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:55 devstack sudo[108268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-f07eec85-7186-4639-a52a-5e4bcdc8dde2.info
Jul 09 14:55:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d932e09f-65fd-4592-95cc-aa5957a33220 tempest-ProjectReaderTests-934378749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d954f400-c0a0-4c52-9e13-a9b84e27239a {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:55 devstack sudo[108268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:55 devstack sudo[108270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d954f400-c0a0-4c52-9e13-a9b84e27239a
Jul 09 14:55:55 devstack sudo[108270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:56 devstack sudo[108268]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b135cff0-943a-45ac-b4ca-71495bfdd99d tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-f07eec85-7186-4639-a52a-5e4bcdc8dde2.info" returned: 0 in 0.656s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b135cff0-943a-45ac-b4ca-71495bfdd99d tempest-ProjectMemberTests-1092548551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.273s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:55:56 devstack sudo[108270]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d932e09f-65fd-4592-95cc-aa5957a33220 tempest-ProjectReaderTests-934378749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-d954f400-c0a0-4c52-9e13-a9b84e27239a" returned: 0 in 0.658s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:56 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d932e09f-65fd-4592-95cc-aa5957a33220 tempest-ProjectReaderTests-934378749 None] Lock "cinder-quobyte-d954f400-c0a0-4c52-9e13-a9b84e27239a" released by "delete_volume" :: held 1.507s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:55:56 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-b135cff0-943a-45ac-b4ca-71495bfdd99d tempest-ProjectMemberTests-1092548551 None] Create snapshot completed successfully
Jul 09 14:55:56 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-d932e09f-65fd-4592-95cc-aa5957a33220 tempest-ProjectReaderTests-934378749 None] Created reservations ['1bb009de-ead2-40b4-9431-e6e3b2bdfdcf', '779d4754-fb65-4bd4-ade0-fef179e842df', 'b8479d5d-a978-4f41-bfb7-aab03ac3d933', '6d7a71d1-ff54-45b0-af56-8b9dd7d112e7'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:55:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d932e09f-65fd-4592-95cc-aa5957a33220 tempest-ProjectReaderTests-934378749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:55:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d932e09f-65fd-4592-95cc-aa5957a33220 tempest-ProjectReaderTests-934378749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:55:56 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-d932e09f-65fd-4592-95cc-aa5957a33220 tempest-ProjectReaderTests-934378749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:55:56 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-d932e09f-65fd-4592-95cc-aa5957a33220 tempest-ProjectReaderTests-934378749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:55:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d932e09f-65fd-4592-95cc-aa5957a33220 tempest-ProjectReaderTests-934378749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:55:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d932e09f-65fd-4592-95cc-aa5957a33220 tempest-ProjectReaderTests-934378749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:56 devstack sudo[108280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:55:56 devstack sudo[108280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:57 devstack sudo[108280]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d932e09f-65fd-4592-95cc-aa5957a33220 tempest-ProjectReaderTests-934378749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.655s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:57 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-d932e09f-65fd-4592-95cc-aa5957a33220 tempest-ProjectReaderTests-934378749 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:55:57 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-d932e09f-65fd-4592-95cc-aa5957a33220 tempest-ProjectReaderTests-934378749 None] Deleted volume successfully.
Jul 09 14:55:57 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d932e09f-65fd-4592-95cc-aa5957a33220 tempest-ProjectReaderTests-934378749 None] Lock "cinder-d954f400-c0a0-4c52-9e13-a9b84e27239a-delete_volume" released by "delete_volume" :: held 2.370s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:55:57 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e7782e8d-5c3f-4761-960d-b7754b67eadb tempest-ProjectMemberTests-1092548551 None] Acquiring lock "cinder-6def49cb-3ff9-4c86-889c-22a942d9f46a-delete_snapshot" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:55:57 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e7782e8d-5c3f-4761-960d-b7754b67eadb tempest-ProjectMemberTests-1092548551 None] Lock "cinder-6def49cb-3ff9-4c86-889c-22a942d9f46a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:55:57 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e7782e8d-5c3f-4761-960d-b7754b67eadb tempest-ProjectMemberTests-1092548551 None] Acquiring lock "cinder-quobyte-f07eec85-7186-4639-a52a-5e4bcdc8dde2" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:55:57 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e7782e8d-5c3f-4761-960d-b7754b67eadb tempest-ProjectMemberTests-1092548551 None] Lock "cinder-quobyte-f07eec85-7186-4639-a52a-5e4bcdc8dde2" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:55:57 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e7782e8d-5c3f-4761-960d-b7754b67eadb tempest-ProjectMemberTests-1092548551 None] Acquiring lock "cinder-quobyte-6def49cb-3ff9-4c86-889c-22a942d9f46a" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:55:57 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e7782e8d-5c3f-4761-960d-b7754b67eadb tempest-ProjectMemberTests-1092548551 None] Lock "cinder-quobyte-6def49cb-3ff9-4c86-889c-22a942d9f46a" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:55:57 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-e7782e8d-5c3f-4761-960d-b7754b67eadb tempest-ProjectMemberTests-1092548551 None] Deleting offline snapshot 6def49cb-3ff9-4c86-889c-22a942d9f46a of volume f07eec85-7186-4639-a52a-5e4bcdc8dde2 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 14:55:57 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-e7782e8d-5c3f-4761-960d-b7754b67eadb tempest-ProjectMemberTests-1092548551 None] snapshot_file for this snap is: volume-f07eec85-7186-4639-a52a-5e4bcdc8dde2.6def49cb-3ff9-4c86-889c-22a942d9f46a {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 14:55:57 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[d12417e0-17dc-4486-9ab8-2a29bd2af449]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:55:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e7782e8d-5c3f-4761-960d-b7754b67eadb tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-f07eec85-7186-4639-a52a-5e4bcdc8dde2.6def49cb-3ff9-4c86-889c-22a942d9f46a {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:57 devstack sudo[108283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-f07eec85-7186-4639-a52a-5e4bcdc8dde2.6def49cb-3ff9-4c86-889c-22a942d9f46a
Jul 09 14:55:57 devstack sudo[108283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:58 devstack sudo[108283]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e7782e8d-5c3f-4761-960d-b7754b67eadb tempest-ProjectMemberTests-1092548551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-f07eec85-7186-4639-a52a-5e4bcdc8dde2.6def49cb-3ff9-4c86-889c-22a942d9f46a" returned: 0 in 0.844s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:58 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-e7782e8d-5c3f-4761-960d-b7754b67eadb tempest-ProjectMemberTests-1092548551 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f07eec85-7186-4639-a52a-5e4bcdc8dde2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 14:55:58 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a1e40d-e911-467e-a29d-3e6aa772b198]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:55:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e7782e8d-5c3f-4761-960d-b7754b67eadb tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-f07eec85-7186-4639-a52a-5e4bcdc8dde2 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:58 devstack sudo[108288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-f07eec85-7186-4639-a52a-5e4bcdc8dde2
Jul 09 14:55:58 devstack sudo[108288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:55:59 devstack sudo[108288]: pam_unix(sudo:session): session closed for user root
Jul 09 14:55:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e7782e8d-5c3f-4761-960d-b7754b67eadb tempest-ProjectMemberTests-1092548551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-f07eec85-7186-4639-a52a-5e4bcdc8dde2" returned: 0 in 0.813s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:55:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e7782e8d-5c3f-4761-960d-b7754b67eadb tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-f07eec85-7186-4639-a52a-5e4bcdc8dde2.6def49cb-3ff9-4c86-889c-22a942d9f46a {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:55:59 devstack sudo[108294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-f07eec85-7186-4639-a52a-5e4bcdc8dde2.6def49cb-3ff9-4c86-889c-22a942d9f46a
Jul 09 14:55:59 devstack sudo[108294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:56:00 devstack sudo[108294]: pam_unix(sudo:session): session closed for user root
Jul 09 14:56:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e7782e8d-5c3f-4761-960d-b7754b67eadb tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-f07eec85-7186-4639-a52a-5e4bcdc8dde2.6def49cb-3ff9-4c86-889c-22a942d9f46a" returned: 0 in 0.734s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:56:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e7782e8d-5c3f-4761-960d-b7754b67eadb tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-f07eec85-7186-4639-a52a-5e4bcdc8dde2.6def49cb-3ff9-4c86-889c-22a942d9f46a {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:56:00 devstack sudo[108300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-f07eec85-7186-4639-a52a-5e4bcdc8dde2.6def49cb-3ff9-4c86-889c-22a942d9f46a
Jul 09 14:56:00 devstack sudo[108300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:56:00 devstack sudo[108300]: pam_unix(sudo:session): session closed for user root
Jul 09 14:56:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e7782e8d-5c3f-4761-960d-b7754b67eadb tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-f07eec85-7186-4639-a52a-5e4bcdc8dde2.6def49cb-3ff9-4c86-889c-22a942d9f46a" returned: 0 in 0.659s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:56:00 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e7782e8d-5c3f-4761-960d-b7754b67eadb tempest-ProjectMemberTests-1092548551 None] Lock "cinder-quobyte-6def49cb-3ff9-4c86-889c-22a942d9f46a" released by "_delete_snapshot" :: held 3.153s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:56:00 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e7782e8d-5c3f-4761-960d-b7754b67eadb tempest-ProjectMemberTests-1092548551 None] Lock "cinder-quobyte-f07eec85-7186-4639-a52a-5e4bcdc8dde2" released by "delete_snapshot" :: held 3.180s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:56:00 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:INSERT=47,cinder:UPDATE=184,cinder:SELECT=131,cinder:DELETE=16 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 14:56:00 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:UPDATE=156,cinder:SELECT=120,cinder:INSERT=44,cinder:DELETE=12 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 14:56:00 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-e7782e8d-5c3f-4761-960d-b7754b67eadb tempest-ProjectMemberTests-1092548551 None] Created reservations ['31c0a25f-f0f2-48ef-81dc-72610c9f5610', '140813b3-4835-4d08-886c-f4cb72594cc9', '70b48b5d-ca6e-44da-a79b-d5f3c4a8431a', 'ffff52c5-a2aa-44ea-8dfc-f1d2f0361ba8'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:56:00 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-e7782e8d-5c3f-4761-960d-b7754b67eadb tempest-ProjectMemberTests-1092548551 None] Delete snapshot completed successfully.
Jul 09 14:56:00 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e7782e8d-5c3f-4761-960d-b7754b67eadb tempest-ProjectMemberTests-1092548551 None] Lock "cinder-6def49cb-3ff9-4c86-889c-22a942d9f46a-delete_snapshot" released by "delete_snapshot" :: held 3.340s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:56:01 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-25a701d8-d60f-45c4-a490-dcf3d52cb475 tempest-ProjectMemberTests-1092548551 None] Acquiring lock "cinder-f07eec85-7186-4639-a52a-5e4bcdc8dde2-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:56:01 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-25a701d8-d60f-45c4-a490-dcf3d52cb475 tempest-ProjectMemberTests-1092548551 None] Lock "cinder-f07eec85-7186-4639-a52a-5e4bcdc8dde2-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:56:01 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-25a701d8-d60f-45c4-a490-dcf3d52cb475 tempest-ProjectMemberTests-1092548551 None] Acquiring lock "cinder-quobyte-f07eec85-7186-4639-a52a-5e4bcdc8dde2" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:56:01 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-25a701d8-d60f-45c4-a490-dcf3d52cb475 tempest-ProjectMemberTests-1092548551 None] Lock "cinder-quobyte-f07eec85-7186-4639-a52a-5e4bcdc8dde2" acquired by "delete_volume" :: waited 0.014s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:56:01 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dce6860-ce95-4900-b8a2-a6b78ced9151]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:56:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-25a701d8-d60f-45c4-a490-dcf3d52cb475 tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-f07eec85-7186-4639-a52a-5e4bcdc8dde2 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:56:01 devstack sudo[108304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-f07eec85-7186-4639-a52a-5e4bcdc8dde2
Jul 09 14:56:01 devstack sudo[108304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:56:02 devstack sudo[108304]: pam_unix(sudo:session): session closed for user root
Jul 09 14:56:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-25a701d8-d60f-45c4-a490-dcf3d52cb475 tempest-ProjectMemberTests-1092548551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-f07eec85-7186-4639-a52a-5e4bcdc8dde2" returned: 0 in 0.823s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:56:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-25a701d8-d60f-45c4-a490-dcf3d52cb475 tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-f07eec85-7186-4639-a52a-5e4bcdc8dde2 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:56:02 devstack sudo[108309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-f07eec85-7186-4639-a52a-5e4bcdc8dde2
Jul 09 14:56:02 devstack sudo[108309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:56:03 devstack sudo[108309]: pam_unix(sudo:session): session closed for user root
Jul 09 14:56:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-25a701d8-d60f-45c4-a490-dcf3d52cb475 tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-f07eec85-7186-4639-a52a-5e4bcdc8dde2" returned: 0 in 0.681s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:56:03 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-25a701d8-d60f-45c4-a490-dcf3d52cb475 tempest-ProjectMemberTests-1092548551 None] Lock "cinder-quobyte-f07eec85-7186-4639-a52a-5e4bcdc8dde2" released by "delete_volume" :: held 1.563s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:56:03 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-25a701d8-d60f-45c4-a490-dcf3d52cb475 tempest-ProjectMemberTests-1092548551 None] Created reservations ['db385b0a-4dbb-40f8-ba22-3c4288f21508', 'c0440abf-a266-4550-91f6-0968dd975aff', 'cecbe6b1-9140-40a7-ab2a-5be733319772', '74233fa4-3c96-40f1-8942-59db0261ff3c'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:56:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-25a701d8-d60f-45c4-a490-dcf3d52cb475 tempest-ProjectMemberTests-1092548551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:56:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-25a701d8-d60f-45c4-a490-dcf3d52cb475 tempest-ProjectMemberTests-1092548551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:56:03 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-25a701d8-d60f-45c4-a490-dcf3d52cb475 tempest-ProjectMemberTests-1092548551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:56:03 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-25a701d8-d60f-45c4-a490-dcf3d52cb475 tempest-ProjectMemberTests-1092548551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:56:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-25a701d8-d60f-45c4-a490-dcf3d52cb475 tempest-ProjectMemberTests-1092548551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:56:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-25a701d8-d60f-45c4-a490-dcf3d52cb475 tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:56:03 devstack sudo[108312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:56:03 devstack sudo[108312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:56:04 devstack sudo[108312]: pam_unix(sudo:session): session closed for user root
Jul 09 14:56:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-25a701d8-d60f-45c4-a490-dcf3d52cb475 tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.696s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:56:04 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-25a701d8-d60f-45c4-a490-dcf3d52cb475 tempest-ProjectMemberTests-1092548551 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:56:04 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-25a701d8-d60f-45c4-a490-dcf3d52cb475 tempest-ProjectMemberTests-1092548551 None] Deleted volume successfully.
Jul 09 14:56:04 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-25a701d8-d60f-45c4-a490-dcf3d52cb475 tempest-ProjectMemberTests-1092548551 None] Lock "cinder-f07eec85-7186-4639-a52a-5e4bcdc8dde2-delete_volume" released by "delete_volume" :: held 2.449s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:56:04 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7510eb0-5e0a-4a80-9af0-fd9e27fb9efc tempest-ProjectMemberTests-1092548551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:56:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e7510eb0-5e0a-4a80-9af0-fd9e27fb9efc tempest-ProjectMemberTests-1092548551 None] Flow 'volume_create_manager' (d6777f95-9c48-40aa-9e2b-70bfb9c7e92c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:56:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e7510eb0-5e0a-4a80-9af0-fd9e27fb9efc tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e332b8b2-fb2f-43c0-b289-ad12cdeb9a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:56:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e7510eb0-5e0a-4a80-9af0-fd9e27fb9efc tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e332b8b2-fb2f-43c0-b289-ad12cdeb9a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:56:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-859610550',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e30d78e6-856e-4010-b49e-8c2f9bdfdb52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53e3a7b509634eeda7e218e1577efd89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:56:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:56:04Z,use_quota=True,user_id='6f31a0c3fe3e49ccabfa9bdf47df92af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:56:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e7510eb0-5e0a-4a80-9af0-fd9e27fb9efc tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67fd40cc-d054-4f01-a132-1547f4cb79f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:56:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e7510eb0-5e0a-4a80-9af0-fd9e27fb9efc tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67fd40cc-d054-4f01-a132-1547f4cb79f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:56:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e7510eb0-5e0a-4a80-9af0-fd9e27fb9efc tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01cb85b9-d56b-4c9a-9b25-7b7044dabde5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:56:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e7510eb0-5e0a-4a80-9af0-fd9e27fb9efc tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01cb85b9-d56b-4c9a-9b25-7b7044dabde5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e30d78e6-856e-4010-b49e-8c2f9bdfdb52', 'volume_name': 'volume-e30d78e6-856e-4010-b49e-8c2f9bdfdb52', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:56:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e7510eb0-5e0a-4a80-9af0-fd9e27fb9efc tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e682e13-0fc9-4205-919e-ba8eac94d802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:56:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e7510eb0-5e0a-4a80-9af0-fd9e27fb9efc tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e682e13-0fc9-4205-919e-ba8eac94d802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:56:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e7510eb0-5e0a-4a80-9af0-fd9e27fb9efc tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06facfa3-7d92-4289-8148-a091aee5faa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:56:04 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-e7510eb0-5e0a-4a80-9af0-fd9e27fb9efc tempest-ProjectMemberTests-1092548551 None] Volume e30d78e6-856e-4010-b49e-8c2f9bdfdb52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e30d78e6-856e-4010-b49e-8c2f9bdfdb52', 'volume_size': 1}
Jul 09 14:56:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e7510eb0-5e0a-4a80-9af0-fd9e27fb9efc tempest-ProjectMemberTests-1092548551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:56:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e7510eb0-5e0a-4a80-9af0-fd9e27fb9efc tempest-ProjectMemberTests-1092548551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:56:04 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-e7510eb0-5e0a-4a80-9af0-fd9e27fb9efc tempest-ProjectMemberTests-1092548551 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:56:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-859610550',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e30d78e6-856e-4010-b49e-8c2f9bdfdb52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53e3a7b509634eeda7e218e1577efd89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:56:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:56:04Z,use_quota=True,user_id='6f31a0c3fe3e49ccabfa9bdf47df92af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:56:04 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-e7510eb0-5e0a-4a80-9af0-fd9e27fb9efc tempest-ProjectMemberTests-1092548551 None] Creating volume e30d78e6-856e-4010-b49e-8c2f9bdfdb52 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:56:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e7510eb0-5e0a-4a80-9af0-fd9e27fb9efc tempest-ProjectMemberTests-1092548551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:56:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e7510eb0-5e0a-4a80-9af0-fd9e27fb9efc tempest-ProjectMemberTests-1092548551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:56:04 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-e7510eb0-5e0a-4a80-9af0-fd9e27fb9efc tempest-ProjectMemberTests-1092548551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:56:04 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-e7510eb0-5e0a-4a80-9af0-fd9e27fb9efc tempest-ProjectMemberTests-1092548551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:56:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e7510eb0-5e0a-4a80-9af0-fd9e27fb9efc tempest-ProjectMemberTests-1092548551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:56:04 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-e7510eb0-5e0a-4a80-9af0-fd9e27fb9efc tempest-ProjectMemberTests-1092548551 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:56:04 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-e7510eb0-5e0a-4a80-9af0-fd9e27fb9efc tempest-ProjectMemberTests-1092548551 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:56:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e7510eb0-5e0a-4a80-9af0-fd9e27fb9efc tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e30d78e6-856e-4010-b49e-8c2f9bdfdb52 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:56:04 devstack sudo[108315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e30d78e6-856e-4010-b49e-8c2f9bdfdb52 1073741824
Jul 09 14:56:04 devstack sudo[108315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:56:05 devstack sudo[108315]: pam_unix(sudo:session): session closed for user root
Jul 09 14:56:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e7510eb0-5e0a-4a80-9af0-fd9e27fb9efc tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e30d78e6-856e-4010-b49e-8c2f9bdfdb52 1073741824" returned: 0 in 0.833s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:56:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e7510eb0-5e0a-4a80-9af0-fd9e27fb9efc tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e30d78e6-856e-4010-b49e-8c2f9bdfdb52 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:56:05 devstack sudo[108320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e30d78e6-856e-4010-b49e-8c2f9bdfdb52
Jul 09 14:56:05 devstack sudo[108320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:56:06 devstack sudo[108320]: pam_unix(sudo:session): session closed for user root
Jul 09 14:56:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e7510eb0-5e0a-4a80-9af0-fd9e27fb9efc tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e30d78e6-856e-4010-b49e-8c2f9bdfdb52" returned: 0 in 0.628s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:56:06 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-e7510eb0-5e0a-4a80-9af0-fd9e27fb9efc tempest-ProjectMemberTests-1092548551 None] <== create_volume: return (1509ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:56:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e7510eb0-5e0a-4a80-9af0-fd9e27fb9efc tempest-ProjectMemberTests-1092548551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.512s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:56:06 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e7510eb0-5e0a-4a80-9af0-fd9e27fb9efc tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06facfa3-7d92-4289-8148-a091aee5faa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e30d78e6-856e-4010-b49e-8c2f9bdfdb52', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:56:06 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e7510eb0-5e0a-4a80-9af0-fd9e27fb9efc tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8efb50be-e23c-4873-b074-3caae7b457a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:56:06 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-e7510eb0-5e0a-4a80-9af0-fd9e27fb9efc tempest-ProjectMemberTests-1092548551 None] Volume volume-e30d78e6-856e-4010-b49e-8c2f9bdfdb52 (e30d78e6-856e-4010-b49e-8c2f9bdfdb52): created successfully
Jul 09 14:56:06 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e7510eb0-5e0a-4a80-9af0-fd9e27fb9efc tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8efb50be-e23c-4873-b074-3caae7b457a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:56:06 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e7510eb0-5e0a-4a80-9af0-fd9e27fb9efc tempest-ProjectMemberTests-1092548551 None] Flow 'volume_create_manager' (d6777f95-9c48-40aa-9e2b-70bfb9c7e92c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:56:06 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-e7510eb0-5e0a-4a80-9af0-fd9e27fb9efc tempest-ProjectMemberTests-1092548551 None] Created volume successfully.
Jul 09 14:56:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d2ec6993-0aa7-4586-b234-fe46245bb714 tempest-ProjectMemberTests-1092548551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:56:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d2ec6993-0aa7-4586-b234-fe46245bb714 tempest-ProjectMemberTests-1092548551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:56:06 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-d2ec6993-0aa7-4586-b234-fe46245bb714 tempest-ProjectMemberTests-1092548551 None] Creating offline snapshot c27e65fa-6090-41d5-8129-657131bfa2db of volume e30d78e6-856e-4010-b49e-8c2f9bdfdb52 {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 14:56:06 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[e78cf17d-2e36-4170-8e00-d3b1c58e84bd]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:56:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d2ec6993-0aa7-4586-b234-fe46245bb714 tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e30d78e6-856e-4010-b49e-8c2f9bdfdb52 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:56:06 devstack sudo[108323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e30d78e6-856e-4010-b49e-8c2f9bdfdb52
Jul 09 14:56:06 devstack sudo[108323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:56:07 devstack sudo[108323]: pam_unix(sudo:session): session closed for user root
Jul 09 14:56:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d2ec6993-0aa7-4586-b234-fe46245bb714 tempest-ProjectMemberTests-1092548551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e30d78e6-856e-4010-b49e-8c2f9bdfdb52" returned: 0 in 0.768s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:56:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d2ec6993-0aa7-4586-b234-fe46245bb714 tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e30d78e6-856e-4010-b49e-8c2f9bdfdb52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e30d78e6-856e-4010-b49e-8c2f9bdfdb52.c27e65fa-6090-41d5-8129-657131bfa2db 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:56:07 devstack sudo[108328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e30d78e6-856e-4010-b49e-8c2f9bdfdb52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e30d78e6-856e-4010-b49e-8c2f9bdfdb52.c27e65fa-6090-41d5-8129-657131bfa2db 1G
Jul 09 14:56:07 devstack sudo[108328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:56:08 devstack sudo[108328]: pam_unix(sudo:session): session closed for user root
Jul 09 14:56:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d2ec6993-0aa7-4586-b234-fe46245bb714 tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e30d78e6-856e-4010-b49e-8c2f9bdfdb52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e30d78e6-856e-4010-b49e-8c2f9bdfdb52.c27e65fa-6090-41d5-8129-657131bfa2db 1G" returned: 0 in 0.815s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:56:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d2ec6993-0aa7-4586-b234-fe46245bb714 tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e30d78e6-856e-4010-b49e-8c2f9bdfdb52 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e30d78e6-856e-4010-b49e-8c2f9bdfdb52.c27e65fa-6090-41d5-8129-657131bfa2db {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:56:08 devstack sudo[108334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e30d78e6-856e-4010-b49e-8c2f9bdfdb52 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e30d78e6-856e-4010-b49e-8c2f9bdfdb52.c27e65fa-6090-41d5-8129-657131bfa2db
Jul 09 14:56:08 devstack sudo[108334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:56:09 devstack sudo[108334]: pam_unix(sudo:session): session closed for user root
Jul 09 14:56:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d2ec6993-0aa7-4586-b234-fe46245bb714 tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e30d78e6-856e-4010-b49e-8c2f9bdfdb52 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e30d78e6-856e-4010-b49e-8c2f9bdfdb52.c27e65fa-6090-41d5-8129-657131bfa2db" returned: 0 in 0.687s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:56:09 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-d2ec6993-0aa7-4586-b234-fe46245bb714 tempest-ProjectMemberTests-1092548551 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e30d78e6-856e-4010-b49e-8c2f9bdfdb52.c27e65fa-6090-41d5-8129-657131bfa2db is being set with open permissions: ugo+rw
Jul 09 14:56:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d2ec6993-0aa7-4586-b234-fe46245bb714 tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e30d78e6-856e-4010-b49e-8c2f9bdfdb52.c27e65fa-6090-41d5-8129-657131bfa2db {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:56:09 devstack sudo[108339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e30d78e6-856e-4010-b49e-8c2f9bdfdb52.c27e65fa-6090-41d5-8129-657131bfa2db
Jul 09 14:56:09 devstack sudo[108339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:56:09 devstack sudo[108339]: pam_unix(sudo:session): session closed for user root
Jul 09 14:56:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d2ec6993-0aa7-4586-b234-fe46245bb714 tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e30d78e6-856e-4010-b49e-8c2f9bdfdb52.c27e65fa-6090-41d5-8129-657131bfa2db" returned: 0 in 0.650s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:56:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d2ec6993-0aa7-4586-b234-fe46245bb714 tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e30d78e6-856e-4010-b49e-8c2f9bdfdb52.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:56:09 devstack sudo[108342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e30d78e6-856e-4010-b49e-8c2f9bdfdb52.info
Jul 09 14:56:09 devstack sudo[108342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:56:10 devstack sudo[108342]: pam_unix(sudo:session): session closed for user root
Jul 09 14:56:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d2ec6993-0aa7-4586-b234-fe46245bb714 tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e30d78e6-856e-4010-b49e-8c2f9bdfdb52.info" returned: 0 in 0.667s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:56:10 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-d2ec6993-0aa7-4586-b234-fe46245bb714 tempest-ProjectMemberTests-1092548551 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e30d78e6-856e-4010-b49e-8c2f9bdfdb52.info is being set with open permissions: ugo+rw
Jul 09 14:56:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d2ec6993-0aa7-4586-b234-fe46245bb714 tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e30d78e6-856e-4010-b49e-8c2f9bdfdb52.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:56:10 devstack sudo[108346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e30d78e6-856e-4010-b49e-8c2f9bdfdb52.info
Jul 09 14:56:10 devstack sudo[108346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:56:11 devstack sudo[108346]: pam_unix(sudo:session): session closed for user root
Jul 09 14:56:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d2ec6993-0aa7-4586-b234-fe46245bb714 tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e30d78e6-856e-4010-b49e-8c2f9bdfdb52.info" returned: 0 in 0.638s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:56:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d2ec6993-0aa7-4586-b234-fe46245bb714 tempest-ProjectMemberTests-1092548551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.310s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:56:11 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-d2ec6993-0aa7-4586-b234-fe46245bb714 tempest-ProjectMemberTests-1092548551 None] Create snapshot completed successfully
Jul 09 14:56:12 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f0e80885-c853-4eb4-91fd-9df570cf94d3 tempest-ProjectMemberTests-1092548551 None] Acquiring lock "cinder-c27e65fa-6090-41d5-8129-657131bfa2db-delete_snapshot" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:56:12 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f0e80885-c853-4eb4-91fd-9df570cf94d3 tempest-ProjectMemberTests-1092548551 None] Lock "cinder-c27e65fa-6090-41d5-8129-657131bfa2db-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:56:12 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f0e80885-c853-4eb4-91fd-9df570cf94d3 tempest-ProjectMemberTests-1092548551 None] Acquiring lock "cinder-quobyte-e30d78e6-856e-4010-b49e-8c2f9bdfdb52" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:56:12 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f0e80885-c853-4eb4-91fd-9df570cf94d3 tempest-ProjectMemberTests-1092548551 None] Lock "cinder-quobyte-e30d78e6-856e-4010-b49e-8c2f9bdfdb52" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:56:12 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f0e80885-c853-4eb4-91fd-9df570cf94d3 tempest-ProjectMemberTests-1092548551 None] Acquiring lock "cinder-quobyte-c27e65fa-6090-41d5-8129-657131bfa2db" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:56:12 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f0e80885-c853-4eb4-91fd-9df570cf94d3 tempest-ProjectMemberTests-1092548551 None] Lock "cinder-quobyte-c27e65fa-6090-41d5-8129-657131bfa2db" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:56:12 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-f0e80885-c853-4eb4-91fd-9df570cf94d3 tempest-ProjectMemberTests-1092548551 None] Deleting offline snapshot c27e65fa-6090-41d5-8129-657131bfa2db of volume e30d78e6-856e-4010-b49e-8c2f9bdfdb52 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 14:56:12 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-f0e80885-c853-4eb4-91fd-9df570cf94d3 tempest-ProjectMemberTests-1092548551 None] snapshot_file for this snap is: volume-e30d78e6-856e-4010-b49e-8c2f9bdfdb52.c27e65fa-6090-41d5-8129-657131bfa2db {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 14:56:12 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[7421e588-1909-403c-a637-2ac99bbb1663]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:56:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f0e80885-c853-4eb4-91fd-9df570cf94d3 tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e30d78e6-856e-4010-b49e-8c2f9bdfdb52.c27e65fa-6090-41d5-8129-657131bfa2db {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:56:12 devstack sudo[108350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e30d78e6-856e-4010-b49e-8c2f9bdfdb52.c27e65fa-6090-41d5-8129-657131bfa2db
Jul 09 14:56:12 devstack sudo[108350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:56:12 devstack sudo[108350]: pam_unix(sudo:session): session closed for user root
Jul 09 14:56:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f0e80885-c853-4eb4-91fd-9df570cf94d3 tempest-ProjectMemberTests-1092548551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e30d78e6-856e-4010-b49e-8c2f9bdfdb52.c27e65fa-6090-41d5-8129-657131bfa2db" returned: 0 in 0.777s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:56:12 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-f0e80885-c853-4eb4-91fd-9df570cf94d3 tempest-ProjectMemberTests-1092548551 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e30d78e6-856e-4010-b49e-8c2f9bdfdb52(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 14:56:12 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac1718ab-f6de-4941-bae4-1e356335ff3d]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:56:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f0e80885-c853-4eb4-91fd-9df570cf94d3 tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e30d78e6-856e-4010-b49e-8c2f9bdfdb52 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:56:13 devstack sudo[108355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e30d78e6-856e-4010-b49e-8c2f9bdfdb52
Jul 09 14:56:13 devstack sudo[108355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:56:13 devstack sudo[108355]: pam_unix(sudo:session): session closed for user root
Jul 09 14:56:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f0e80885-c853-4eb4-91fd-9df570cf94d3 tempest-ProjectMemberTests-1092548551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e30d78e6-856e-4010-b49e-8c2f9bdfdb52" returned: 0 in 0.756s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:56:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f0e80885-c853-4eb4-91fd-9df570cf94d3 tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e30d78e6-856e-4010-b49e-8c2f9bdfdb52.c27e65fa-6090-41d5-8129-657131bfa2db {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:56:13 devstack sudo[108360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e30d78e6-856e-4010-b49e-8c2f9bdfdb52.c27e65fa-6090-41d5-8129-657131bfa2db
Jul 09 14:56:13 devstack sudo[108360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:56:14 devstack sudo[108360]: pam_unix(sudo:session): session closed for user root
Jul 09 14:56:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f0e80885-c853-4eb4-91fd-9df570cf94d3 tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e30d78e6-856e-4010-b49e-8c2f9bdfdb52.c27e65fa-6090-41d5-8129-657131bfa2db" returned: 0 in 0.733s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:56:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f0e80885-c853-4eb4-91fd-9df570cf94d3 tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e30d78e6-856e-4010-b49e-8c2f9bdfdb52.c27e65fa-6090-41d5-8129-657131bfa2db {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:56:14 devstack sudo[108366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e30d78e6-856e-4010-b49e-8c2f9bdfdb52.c27e65fa-6090-41d5-8129-657131bfa2db
Jul 09 14:56:14 devstack sudo[108366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:56:15 devstack sudo[108366]: pam_unix(sudo:session): session closed for user root
Jul 09 14:56:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f0e80885-c853-4eb4-91fd-9df570cf94d3 tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e30d78e6-856e-4010-b49e-8c2f9bdfdb52.c27e65fa-6090-41d5-8129-657131bfa2db" returned: 0 in 0.641s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:56:15 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f0e80885-c853-4eb4-91fd-9df570cf94d3 tempest-ProjectMemberTests-1092548551 None] Lock "cinder-quobyte-c27e65fa-6090-41d5-8129-657131bfa2db" released by "_delete_snapshot" :: held 3.002s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:56:15 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f0e80885-c853-4eb4-91fd-9df570cf94d3 tempest-ProjectMemberTests-1092548551 None] Lock "cinder-quobyte-e30d78e6-856e-4010-b49e-8c2f9bdfdb52" released by "delete_snapshot" :: held 3.024s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:56:15 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-f0e80885-c853-4eb4-91fd-9df570cf94d3 tempest-ProjectMemberTests-1092548551 None] Created reservations ['79eab67b-27e7-4909-8d10-70e28824ef50', 'ade43eab-24a9-49ee-aa61-4091d57d2c95', 'd70ef7e4-a2da-40ff-8dd5-e5f0aaca9c78', '577dc244-e853-49f9-bbd9-dd897ed63ac1'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:56:15 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-f0e80885-c853-4eb4-91fd-9df570cf94d3 tempest-ProjectMemberTests-1092548551 None] Delete snapshot completed successfully.
Jul 09 14:56:15 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f0e80885-c853-4eb4-91fd-9df570cf94d3 tempest-ProjectMemberTests-1092548551 None] Lock "cinder-c27e65fa-6090-41d5-8129-657131bfa2db-delete_snapshot" released by "delete_snapshot" :: held 3.154s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:56:16 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-fbe73ff6-a476-46ec-acf8-bfb4e70d094d tempest-ProjectMemberTests-1092548551 None] Acquiring lock "cinder-e30d78e6-856e-4010-b49e-8c2f9bdfdb52-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:56:16 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-fbe73ff6-a476-46ec-acf8-bfb4e70d094d tempest-ProjectMemberTests-1092548551 None] Lock "cinder-e30d78e6-856e-4010-b49e-8c2f9bdfdb52-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:56:16 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-fbe73ff6-a476-46ec-acf8-bfb4e70d094d tempest-ProjectMemberTests-1092548551 None] Acquiring lock "cinder-quobyte-e30d78e6-856e-4010-b49e-8c2f9bdfdb52" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:56:16 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-fbe73ff6-a476-46ec-acf8-bfb4e70d094d tempest-ProjectMemberTests-1092548551 None] Lock "cinder-quobyte-e30d78e6-856e-4010-b49e-8c2f9bdfdb52" acquired by "delete_volume" :: waited 0.016s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:56:16 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[4507d248-f1ce-4490-abf1-a3a82db32106]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:56:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fbe73ff6-a476-46ec-acf8-bfb4e70d094d tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e30d78e6-856e-4010-b49e-8c2f9bdfdb52 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:56:16 devstack sudo[108369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e30d78e6-856e-4010-b49e-8c2f9bdfdb52
Jul 09 14:56:16 devstack sudo[108369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:56:17 devstack sudo[108369]: pam_unix(sudo:session): session closed for user root
Jul 09 14:56:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fbe73ff6-a476-46ec-acf8-bfb4e70d094d tempest-ProjectMemberTests-1092548551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e30d78e6-856e-4010-b49e-8c2f9bdfdb52" returned: 0 in 0.772s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:56:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fbe73ff6-a476-46ec-acf8-bfb4e70d094d tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e30d78e6-856e-4010-b49e-8c2f9bdfdb52 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:56:17 devstack sudo[108374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e30d78e6-856e-4010-b49e-8c2f9bdfdb52
Jul 09 14:56:17 devstack sudo[108374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:56:17 devstack sudo[108374]: pam_unix(sudo:session): session closed for user root
Jul 09 14:56:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fbe73ff6-a476-46ec-acf8-bfb4e70d094d tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-e30d78e6-856e-4010-b49e-8c2f9bdfdb52" returned: 0 in 0.633s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:56:17 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-fbe73ff6-a476-46ec-acf8-bfb4e70d094d tempest-ProjectMemberTests-1092548551 None] Lock "cinder-quobyte-e30d78e6-856e-4010-b49e-8c2f9bdfdb52" released by "delete_volume" :: held 1.469s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:56:17 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-fbe73ff6-a476-46ec-acf8-bfb4e70d094d tempest-ProjectMemberTests-1092548551 None] Created reservations ['e47d314a-1877-4661-b7c9-02714ae0556e', '896109e2-f9f1-4fd6-bf42-54b8d43f1739', '0d1db4c1-a3ef-4e96-ab0f-324823527e57', 'f46c383a-79e4-4407-946e-9254ebb10ee1'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:56:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-fbe73ff6-a476-46ec-acf8-bfb4e70d094d tempest-ProjectMemberTests-1092548551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:56:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-fbe73ff6-a476-46ec-acf8-bfb4e70d094d tempest-ProjectMemberTests-1092548551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:56:17 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-fbe73ff6-a476-46ec-acf8-bfb4e70d094d tempest-ProjectMemberTests-1092548551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:56:17 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-fbe73ff6-a476-46ec-acf8-bfb4e70d094d tempest-ProjectMemberTests-1092548551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:56:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-fbe73ff6-a476-46ec-acf8-bfb4e70d094d tempest-ProjectMemberTests-1092548551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:56:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fbe73ff6-a476-46ec-acf8-bfb4e70d094d tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:56:17 devstack sudo[108377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:56:17 devstack sudo[108377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:56:18 devstack sudo[108377]: pam_unix(sudo:session): session closed for user root
Jul 09 14:56:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fbe73ff6-a476-46ec-acf8-bfb4e70d094d tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.662s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:56:18 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-fbe73ff6-a476-46ec-acf8-bfb4e70d094d tempest-ProjectMemberTests-1092548551 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:56:18 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-fbe73ff6-a476-46ec-acf8-bfb4e70d094d tempest-ProjectMemberTests-1092548551 None] Deleted volume successfully.
Jul 09 14:56:18 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-fbe73ff6-a476-46ec-acf8-bfb4e70d094d tempest-ProjectMemberTests-1092548551 None] Lock "cinder-e30d78e6-856e-4010-b49e-8c2f9bdfdb52-delete_volume" released by "delete_volume" :: held 2.329s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:56:18 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb8c526f-bf0c-4a8f-ba5b-2a327f327f22 tempest-ProjectMemberTests-1092548551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:56:18 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-bb8c526f-bf0c-4a8f-ba5b-2a327f327f22 tempest-ProjectMemberTests-1092548551 None] Flow 'volume_create_manager' (d15635c7-9de8-4a11-b4a6-1726eb92fe1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:56:18 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-bb8c526f-bf0c-4a8f-ba5b-2a327f327f22 tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9428d966-208f-43c5-a9db-ab6e87c2fbbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:56:18 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-bb8c526f-bf0c-4a8f-ba5b-2a327f327f22 tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9428d966-208f-43c5-a9db-ab6e87c2fbbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:56:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-427692394',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=862abdbd-cda7-403c-b22e-481228d23062,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53e3a7b509634eeda7e218e1577efd89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:56:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:56:19Z,use_quota=True,user_id='6f31a0c3fe3e49ccabfa9bdf47df92af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:56:18 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-bb8c526f-bf0c-4a8f-ba5b-2a327f327f22 tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30f068eb-25b7-4282-b370-3fe76b60148a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:56:18 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-bb8c526f-bf0c-4a8f-ba5b-2a327f327f22 tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30f068eb-25b7-4282-b370-3fe76b60148a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:56:18 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-bb8c526f-bf0c-4a8f-ba5b-2a327f327f22 tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5cdb47c-9eab-43fb-a81f-60b81dab2d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:56:18 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-bb8c526f-bf0c-4a8f-ba5b-2a327f327f22 tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5cdb47c-9eab-43fb-a81f-60b81dab2d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '862abdbd-cda7-403c-b22e-481228d23062', 'volume_name': 'volume-862abdbd-cda7-403c-b22e-481228d23062', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:56:18 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-bb8c526f-bf0c-4a8f-ba5b-2a327f327f22 tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (640cebb1-b136-46dc-a46b-b00b7ccec763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:56:18 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-bb8c526f-bf0c-4a8f-ba5b-2a327f327f22 tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (640cebb1-b136-46dc-a46b-b00b7ccec763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:56:18 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-bb8c526f-bf0c-4a8f-ba5b-2a327f327f22 tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99b8d0a4-0482-4fa3-9efc-b3897781a1a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:56:18 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-bb8c526f-bf0c-4a8f-ba5b-2a327f327f22 tempest-ProjectMemberTests-1092548551 None] Volume 862abdbd-cda7-403c-b22e-481228d23062: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-862abdbd-cda7-403c-b22e-481228d23062', 'volume_size': 1}
Jul 09 14:56:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-bb8c526f-bf0c-4a8f-ba5b-2a327f327f22 tempest-ProjectMemberTests-1092548551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:56:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-bb8c526f-bf0c-4a8f-ba5b-2a327f327f22 tempest-ProjectMemberTests-1092548551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:56:18 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-bb8c526f-bf0c-4a8f-ba5b-2a327f327f22 tempest-ProjectMemberTests-1092548551 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:56:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-427692394',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=862abdbd-cda7-403c-b22e-481228d23062,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53e3a7b509634eeda7e218e1577efd89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:56:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:56:19Z,use_quota=True,user_id='6f31a0c3fe3e49ccabfa9bdf47df92af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:56:18 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-bb8c526f-bf0c-4a8f-ba5b-2a327f327f22 tempest-ProjectMemberTests-1092548551 None] Creating volume 862abdbd-cda7-403c-b22e-481228d23062 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:56:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-bb8c526f-bf0c-4a8f-ba5b-2a327f327f22 tempest-ProjectMemberTests-1092548551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:56:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-bb8c526f-bf0c-4a8f-ba5b-2a327f327f22 tempest-ProjectMemberTests-1092548551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:56:18 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-bb8c526f-bf0c-4a8f-ba5b-2a327f327f22 tempest-ProjectMemberTests-1092548551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:56:18 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-bb8c526f-bf0c-4a8f-ba5b-2a327f327f22 tempest-ProjectMemberTests-1092548551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:56:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-bb8c526f-bf0c-4a8f-ba5b-2a327f327f22 tempest-ProjectMemberTests-1092548551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:56:18 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-bb8c526f-bf0c-4a8f-ba5b-2a327f327f22 tempest-ProjectMemberTests-1092548551 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:56:18 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-bb8c526f-bf0c-4a8f-ba5b-2a327f327f22 tempest-ProjectMemberTests-1092548551 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:56:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-bb8c526f-bf0c-4a8f-ba5b-2a327f327f22 tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-862abdbd-cda7-403c-b22e-481228d23062 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:56:19 devstack sudo[108380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-862abdbd-cda7-403c-b22e-481228d23062 1073741824
Jul 09 14:56:19 devstack sudo[108380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:56:19 devstack sudo[108380]: pam_unix(sudo:session): session closed for user root
Jul 09 14:56:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-bb8c526f-bf0c-4a8f-ba5b-2a327f327f22 tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-862abdbd-cda7-403c-b22e-481228d23062 1073741824" returned: 0 in 0.800s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:56:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-bb8c526f-bf0c-4a8f-ba5b-2a327f327f22 tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-862abdbd-cda7-403c-b22e-481228d23062 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:56:19 devstack sudo[108387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-862abdbd-cda7-403c-b22e-481228d23062
Jul 09 14:56:19 devstack sudo[108387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:56:20 devstack sudo[108387]: pam_unix(sudo:session): session closed for user root
Jul 09 14:56:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-bb8c526f-bf0c-4a8f-ba5b-2a327f327f22 tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-862abdbd-cda7-403c-b22e-481228d23062" returned: 0 in 0.620s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:56:20 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-bb8c526f-bf0c-4a8f-ba5b-2a327f327f22 tempest-ProjectMemberTests-1092548551 None] <== create_volume: return (1464ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:56:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-bb8c526f-bf0c-4a8f-ba5b-2a327f327f22 tempest-ProjectMemberTests-1092548551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.466s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:56:20 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-bb8c526f-bf0c-4a8f-ba5b-2a327f327f22 tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99b8d0a4-0482-4fa3-9efc-b3897781a1a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-862abdbd-cda7-403c-b22e-481228d23062', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:56:20 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-bb8c526f-bf0c-4a8f-ba5b-2a327f327f22 tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5622fdb-ab8f-4f21-8b17-da980e3b4a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:56:20 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-bb8c526f-bf0c-4a8f-ba5b-2a327f327f22 tempest-ProjectMemberTests-1092548551 None] Volume volume-862abdbd-cda7-403c-b22e-481228d23062 (862abdbd-cda7-403c-b22e-481228d23062): created successfully
Jul 09 14:56:20 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-bb8c526f-bf0c-4a8f-ba5b-2a327f327f22 tempest-ProjectMemberTests-1092548551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5622fdb-ab8f-4f21-8b17-da980e3b4a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:56:20 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-bb8c526f-bf0c-4a8f-ba5b-2a327f327f22 tempest-ProjectMemberTests-1092548551 None] Flow 'volume_create_manager' (d15635c7-9de8-4a11-b4a6-1726eb92fe1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:56:20 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-bb8c526f-bf0c-4a8f-ba5b-2a327f327f22 tempest-ProjectMemberTests-1092548551 None] Created volume successfully.
Jul 09 14:56:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5714f44a-994b-48b6-8dbe-6efdebf46fb2 tempest-ProjectMemberTests-1092548551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:56:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5714f44a-994b-48b6-8dbe-6efdebf46fb2 tempest-ProjectMemberTests-1092548551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:56:21 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-5714f44a-994b-48b6-8dbe-6efdebf46fb2 tempest-ProjectMemberTests-1092548551 None] Creating offline snapshot e107482f-6892-4194-9c91-9f026f72e4c0 of volume 862abdbd-cda7-403c-b22e-481228d23062 {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 14:56:21 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c230dc-8bac-4d60-ab94-c8dd589a6c61]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:56:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5714f44a-994b-48b6-8dbe-6efdebf46fb2 tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-862abdbd-cda7-403c-b22e-481228d23062 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:56:21 devstack sudo[108391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-862abdbd-cda7-403c-b22e-481228d23062
Jul 09 14:56:21 devstack sudo[108391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:56:21 devstack sudo[108391]: pam_unix(sudo:session): session closed for user root
Jul 09 14:56:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5714f44a-994b-48b6-8dbe-6efdebf46fb2 tempest-ProjectMemberTests-1092548551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-862abdbd-cda7-403c-b22e-481228d23062" returned: 0 in 0.760s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:56:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5714f44a-994b-48b6-8dbe-6efdebf46fb2 tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-862abdbd-cda7-403c-b22e-481228d23062,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-862abdbd-cda7-403c-b22e-481228d23062.e107482f-6892-4194-9c91-9f026f72e4c0 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:56:21 devstack sudo[108398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-862abdbd-cda7-403c-b22e-481228d23062,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-862abdbd-cda7-403c-b22e-481228d23062.e107482f-6892-4194-9c91-9f026f72e4c0 1G
Jul 09 14:56:21 devstack sudo[108398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:56:22 devstack sudo[108398]: pam_unix(sudo:session): session closed for user root
Jul 09 14:56:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5714f44a-994b-48b6-8dbe-6efdebf46fb2 tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-862abdbd-cda7-403c-b22e-481228d23062,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-862abdbd-cda7-403c-b22e-481228d23062.e107482f-6892-4194-9c91-9f026f72e4c0 1G" returned: 0 in 0.769s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:56:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5714f44a-994b-48b6-8dbe-6efdebf46fb2 tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-862abdbd-cda7-403c-b22e-481228d23062 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-862abdbd-cda7-403c-b22e-481228d23062.e107482f-6892-4194-9c91-9f026f72e4c0 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:56:22 devstack sudo[108403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-862abdbd-cda7-403c-b22e-481228d23062 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-862abdbd-cda7-403c-b22e-481228d23062.e107482f-6892-4194-9c91-9f026f72e4c0
Jul 09 14:56:22 devstack sudo[108403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:56:23 devstack sudo[108403]: pam_unix(sudo:session): session closed for user root
Jul 09 14:56:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5714f44a-994b-48b6-8dbe-6efdebf46fb2 tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-862abdbd-cda7-403c-b22e-481228d23062 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-862abdbd-cda7-403c-b22e-481228d23062.e107482f-6892-4194-9c91-9f026f72e4c0" returned: 0 in 0.676s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:56:23 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-5714f44a-994b-48b6-8dbe-6efdebf46fb2 tempest-ProjectMemberTests-1092548551 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-862abdbd-cda7-403c-b22e-481228d23062.e107482f-6892-4194-9c91-9f026f72e4c0 is being set with open permissions: ugo+rw
Jul 09 14:56:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5714f44a-994b-48b6-8dbe-6efdebf46fb2 tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-862abdbd-cda7-403c-b22e-481228d23062.e107482f-6892-4194-9c91-9f026f72e4c0 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:56:23 devstack sudo[108408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-862abdbd-cda7-403c-b22e-481228d23062.e107482f-6892-4194-9c91-9f026f72e4c0
Jul 09 14:56:23 devstack sudo[108408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:56:23 devstack sudo[108408]: pam_unix(sudo:session): session closed for user root
Jul 09 14:56:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5714f44a-994b-48b6-8dbe-6efdebf46fb2 tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-862abdbd-cda7-403c-b22e-481228d23062.e107482f-6892-4194-9c91-9f026f72e4c0" returned: 0 in 0.615s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:56:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5714f44a-994b-48b6-8dbe-6efdebf46fb2 tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-862abdbd-cda7-403c-b22e-481228d23062.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:56:23 devstack sudo[108411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-862abdbd-cda7-403c-b22e-481228d23062.info
Jul 09 14:56:23 devstack sudo[108411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:56:24 devstack sudo[108411]: pam_unix(sudo:session): session closed for user root
Jul 09 14:56:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5714f44a-994b-48b6-8dbe-6efdebf46fb2 tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-862abdbd-cda7-403c-b22e-481228d23062.info" returned: 0 in 0.643s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:56:24 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-5714f44a-994b-48b6-8dbe-6efdebf46fb2 tempest-ProjectMemberTests-1092548551 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-862abdbd-cda7-403c-b22e-481228d23062.info is being set with open permissions: ugo+rw
Jul 09 14:56:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5714f44a-994b-48b6-8dbe-6efdebf46fb2 tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-862abdbd-cda7-403c-b22e-481228d23062.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:56:24 devstack sudo[108414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-862abdbd-cda7-403c-b22e-481228d23062.info
Jul 09 14:56:24 devstack sudo[108414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:56:25 devstack sudo[108414]: pam_unix(sudo:session): session closed for user root
Jul 09 14:56:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5714f44a-994b-48b6-8dbe-6efdebf46fb2 tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-862abdbd-cda7-403c-b22e-481228d23062.info" returned: 0 in 0.649s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:56:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5714f44a-994b-48b6-8dbe-6efdebf46fb2 tempest-ProjectMemberTests-1092548551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.186s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:56:25 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-5714f44a-994b-48b6-8dbe-6efdebf46fb2 tempest-ProjectMemberTests-1092548551 None] Create snapshot completed successfully
Jul 09 14:56:26 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-728cb924-d08b-4657-a58a-9face7915006 tempest-ProjectMemberTests-1092548551 None] Acquiring lock "cinder-e107482f-6892-4194-9c91-9f026f72e4c0-delete_snapshot" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:56:26 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-728cb924-d08b-4657-a58a-9face7915006 tempest-ProjectMemberTests-1092548551 None] Lock "cinder-e107482f-6892-4194-9c91-9f026f72e4c0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:56:26 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-728cb924-d08b-4657-a58a-9face7915006 tempest-ProjectMemberTests-1092548551 None] Acquiring lock "cinder-quobyte-862abdbd-cda7-403c-b22e-481228d23062" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:56:26 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-728cb924-d08b-4657-a58a-9face7915006 tempest-ProjectMemberTests-1092548551 None] Lock "cinder-quobyte-862abdbd-cda7-403c-b22e-481228d23062" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:56:26 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-728cb924-d08b-4657-a58a-9face7915006 tempest-ProjectMemberTests-1092548551 None] Acquiring lock "cinder-quobyte-e107482f-6892-4194-9c91-9f026f72e4c0" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:56:26 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-728cb924-d08b-4657-a58a-9face7915006 tempest-ProjectMemberTests-1092548551 None] Lock "cinder-quobyte-e107482f-6892-4194-9c91-9f026f72e4c0" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:56:26 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-728cb924-d08b-4657-a58a-9face7915006 tempest-ProjectMemberTests-1092548551 None] Deleting offline snapshot e107482f-6892-4194-9c91-9f026f72e4c0 of volume 862abdbd-cda7-403c-b22e-481228d23062 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 14:56:26 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-728cb924-d08b-4657-a58a-9face7915006 tempest-ProjectMemberTests-1092548551 None] snapshot_file for this snap is: volume-862abdbd-cda7-403c-b22e-481228d23062.e107482f-6892-4194-9c91-9f026f72e4c0 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 14:56:26 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[308e2078-1223-47bf-8ac4-50ad67e1d4a6]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:56:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-728cb924-d08b-4657-a58a-9face7915006 tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-862abdbd-cda7-403c-b22e-481228d23062.e107482f-6892-4194-9c91-9f026f72e4c0 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:56:26 devstack sudo[108417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-862abdbd-cda7-403c-b22e-481228d23062.e107482f-6892-4194-9c91-9f026f72e4c0
Jul 09 14:56:26 devstack sudo[108417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:56:27 devstack sudo[108417]: pam_unix(sudo:session): session closed for user root
Jul 09 14:56:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-728cb924-d08b-4657-a58a-9face7915006 tempest-ProjectMemberTests-1092548551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-862abdbd-cda7-403c-b22e-481228d23062.e107482f-6892-4194-9c91-9f026f72e4c0" returned: 0 in 0.729s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:56:27 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-728cb924-d08b-4657-a58a-9face7915006 tempest-ProjectMemberTests-1092548551 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-862abdbd-cda7-403c-b22e-481228d23062(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 14:56:27 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d55e6f6-5d9c-4c06-9273-00c90167909d]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:56:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-728cb924-d08b-4657-a58a-9face7915006 tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-862abdbd-cda7-403c-b22e-481228d23062 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:56:27 devstack sudo[108422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-862abdbd-cda7-403c-b22e-481228d23062
Jul 09 14:56:27 devstack sudo[108422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:56:27 devstack sudo[108422]: pam_unix(sudo:session): session closed for user root
Jul 09 14:56:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-728cb924-d08b-4657-a58a-9face7915006 tempest-ProjectMemberTests-1092548551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-862abdbd-cda7-403c-b22e-481228d23062" returned: 0 in 0.722s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:56:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-728cb924-d08b-4657-a58a-9face7915006 tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-862abdbd-cda7-403c-b22e-481228d23062.e107482f-6892-4194-9c91-9f026f72e4c0 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:56:27 devstack sudo[108427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-862abdbd-cda7-403c-b22e-481228d23062.e107482f-6892-4194-9c91-9f026f72e4c0
Jul 09 14:56:27 devstack sudo[108427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:56:28 devstack sudo[108427]: pam_unix(sudo:session): session closed for user root
Jul 09 14:56:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-728cb924-d08b-4657-a58a-9face7915006 tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-862abdbd-cda7-403c-b22e-481228d23062.e107482f-6892-4194-9c91-9f026f72e4c0" returned: 0 in 0.711s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:56:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-728cb924-d08b-4657-a58a-9face7915006 tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-862abdbd-cda7-403c-b22e-481228d23062.e107482f-6892-4194-9c91-9f026f72e4c0 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:56:28 devstack sudo[108432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-862abdbd-cda7-403c-b22e-481228d23062.e107482f-6892-4194-9c91-9f026f72e4c0
Jul 09 14:56:28 devstack sudo[108432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:56:29 devstack sudo[108432]: pam_unix(sudo:session): session closed for user root
Jul 09 14:56:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-728cb924-d08b-4657-a58a-9face7915006 tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-862abdbd-cda7-403c-b22e-481228d23062.e107482f-6892-4194-9c91-9f026f72e4c0" returned: 0 in 0.613s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:56:29 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-728cb924-d08b-4657-a58a-9face7915006 tempest-ProjectMemberTests-1092548551 None] Lock "cinder-quobyte-e107482f-6892-4194-9c91-9f026f72e4c0" released by "_delete_snapshot" :: held 2.858s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:56:29 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-728cb924-d08b-4657-a58a-9face7915006 tempest-ProjectMemberTests-1092548551 None] Lock "cinder-quobyte-862abdbd-cda7-403c-b22e-481228d23062" released by "delete_snapshot" :: held 2.880s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:56:29 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-728cb924-d08b-4657-a58a-9face7915006 tempest-ProjectMemberTests-1092548551 None] Created reservations ['8dd0fbab-9cec-4453-b03e-0c4013477bdc', '95cab96b-9671-41ba-aee3-6ead2d89ce1e', 'dc4906b2-e802-4d20-b89f-bab41ac37374', 'da5d6d61-0b07-4bc6-9f42-fad9c4e1da59'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:56:29 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-728cb924-d08b-4657-a58a-9face7915006 tempest-ProjectMemberTests-1092548551 None] Delete snapshot completed successfully.
Jul 09 14:56:29 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-728cb924-d08b-4657-a58a-9face7915006 tempest-ProjectMemberTests-1092548551 None] Lock "cinder-e107482f-6892-4194-9c91-9f026f72e4c0-delete_snapshot" released by "delete_snapshot" :: held 3.003s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:56:29 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-634a6299-8dac-4af7-90e8-fa2fc0e4968d tempest-ProjectMemberTests-1092548551 None] Acquiring lock "cinder-862abdbd-cda7-403c-b22e-481228d23062-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:56:29 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-634a6299-8dac-4af7-90e8-fa2fc0e4968d tempest-ProjectMemberTests-1092548551 None] Lock "cinder-862abdbd-cda7-403c-b22e-481228d23062-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:56:29 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-634a6299-8dac-4af7-90e8-fa2fc0e4968d tempest-ProjectMemberTests-1092548551 None] Acquiring lock "cinder-quobyte-862abdbd-cda7-403c-b22e-481228d23062" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:56:29 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-634a6299-8dac-4af7-90e8-fa2fc0e4968d tempest-ProjectMemberTests-1092548551 None] Lock "cinder-quobyte-862abdbd-cda7-403c-b22e-481228d23062" acquired by "delete_volume" :: waited 0.017s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:56:29 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[010df937-1865-4a28-8e5e-18a95fec477a]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:56:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-634a6299-8dac-4af7-90e8-fa2fc0e4968d tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-862abdbd-cda7-403c-b22e-481228d23062 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:56:29 devstack sudo[108435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-862abdbd-cda7-403c-b22e-481228d23062
Jul 09 14:56:29 devstack sudo[108435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:56:30 devstack sudo[108435]: pam_unix(sudo:session): session closed for user root
Jul 09 14:56:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-634a6299-8dac-4af7-90e8-fa2fc0e4968d tempest-ProjectMemberTests-1092548551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-862abdbd-cda7-403c-b22e-481228d23062" returned: 0 in 0.722s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:56:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-634a6299-8dac-4af7-90e8-fa2fc0e4968d tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-862abdbd-cda7-403c-b22e-481228d23062 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:56:30 devstack sudo[108440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-862abdbd-cda7-403c-b22e-481228d23062
Jul 09 14:56:30 devstack sudo[108440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:56:31 devstack sudo[108440]: pam_unix(sudo:session): session closed for user root
Jul 09 14:56:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-634a6299-8dac-4af7-90e8-fa2fc0e4968d tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-862abdbd-cda7-403c-b22e-481228d23062" returned: 0 in 0.662s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:56:31 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-634a6299-8dac-4af7-90e8-fa2fc0e4968d tempest-ProjectMemberTests-1092548551 None] Lock "cinder-quobyte-862abdbd-cda7-403c-b22e-481228d23062" released by "delete_volume" :: held 1.438s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:56:31 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-634a6299-8dac-4af7-90e8-fa2fc0e4968d tempest-ProjectMemberTests-1092548551 None] Created reservations ['790607ad-1740-4a40-813e-4c8211f2473b', 'db69e958-d992-46ca-8e30-a47452594b24', 'fadf58bb-2f4d-429b-bcee-8fcff794980c', 'bdf4f502-0069-439d-9869-999af3b94c7a'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:56:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-634a6299-8dac-4af7-90e8-fa2fc0e4968d tempest-ProjectMemberTests-1092548551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:56:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-634a6299-8dac-4af7-90e8-fa2fc0e4968d tempest-ProjectMemberTests-1092548551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:56:31 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-634a6299-8dac-4af7-90e8-fa2fc0e4968d tempest-ProjectMemberTests-1092548551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:56:31 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-634a6299-8dac-4af7-90e8-fa2fc0e4968d tempest-ProjectMemberTests-1092548551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:56:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-634a6299-8dac-4af7-90e8-fa2fc0e4968d tempest-ProjectMemberTests-1092548551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:56:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-634a6299-8dac-4af7-90e8-fa2fc0e4968d tempest-ProjectMemberTests-1092548551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:56:31 devstack sudo[108444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:56:31 devstack sudo[108444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:56:31 devstack sudo[108444]: pam_unix(sudo:session): session closed for user root
Jul 09 14:56:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-634a6299-8dac-4af7-90e8-fa2fc0e4968d tempest-ProjectMemberTests-1092548551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.647s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:56:31 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-634a6299-8dac-4af7-90e8-fa2fc0e4968d tempest-ProjectMemberTests-1092548551 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:56:31 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-634a6299-8dac-4af7-90e8-fa2fc0e4968d tempest-ProjectMemberTests-1092548551 None] Deleted volume successfully.
Jul 09 14:56:31 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-634a6299-8dac-4af7-90e8-fa2fc0e4968d tempest-ProjectMemberTests-1092548551 None] Lock "cinder-862abdbd-cda7-403c-b22e-481228d23062-delete_volume" released by "delete_volume" :: held 2.277s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:56:35 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ea727a8-6c26-4af4-b1fb-169a3c94cce6 tempest-ProjectReaderTests-723103240 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:56:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6ea727a8-6c26-4af4-b1fb-169a3c94cce6 tempest-ProjectReaderTests-723103240 None] Flow 'volume_create_manager' (8db470a8-d3b6-450c-953c-60770890ae18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:56:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6ea727a8-6c26-4af4-b1fb-169a3c94cce6 tempest-ProjectReaderTests-723103240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0efe753-e0af-450a-8dfe-6ae5180e13fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:56:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6ea727a8-6c26-4af4-b1fb-169a3c94cce6 tempest-ProjectReaderTests-723103240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0efe753-e0af-450a-8dfe-6ae5180e13fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:56:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-425324898',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=648ef354-4c17-40df-8da7-7df477b306a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='400e539b7b7f4ec085bd527aa1dbb013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:56:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:56:35Z,use_quota=True,user_id='f58e953150ce44af8e9370248f01e679',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:56:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6ea727a8-6c26-4af4-b1fb-169a3c94cce6 tempest-ProjectReaderTests-723103240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a450560c-9cba-4b40-bce2-27a4d89dae47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:56:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6ea727a8-6c26-4af4-b1fb-169a3c94cce6 tempest-ProjectReaderTests-723103240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a450560c-9cba-4b40-bce2-27a4d89dae47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:56:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6ea727a8-6c26-4af4-b1fb-169a3c94cce6 tempest-ProjectReaderTests-723103240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9a50b84-f6b0-4ef1-885b-252a91076845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:56:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6ea727a8-6c26-4af4-b1fb-169a3c94cce6 tempest-ProjectReaderTests-723103240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9a50b84-f6b0-4ef1-885b-252a91076845) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '648ef354-4c17-40df-8da7-7df477b306a7', 'volume_name': 'volume-648ef354-4c17-40df-8da7-7df477b306a7', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:56:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6ea727a8-6c26-4af4-b1fb-169a3c94cce6 tempest-ProjectReaderTests-723103240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9088092e-4fa0-45df-8e02-5ed27514ed6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:56:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6ea727a8-6c26-4af4-b1fb-169a3c94cce6 tempest-ProjectReaderTests-723103240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9088092e-4fa0-45df-8e02-5ed27514ed6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:56:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6ea727a8-6c26-4af4-b1fb-169a3c94cce6 tempest-ProjectReaderTests-723103240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c977996-52ac-47da-abee-a8cee8ad084f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:56:35 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-6ea727a8-6c26-4af4-b1fb-169a3c94cce6 tempest-ProjectReaderTests-723103240 None] Volume 648ef354-4c17-40df-8da7-7df477b306a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-648ef354-4c17-40df-8da7-7df477b306a7', 'volume_size': 1}
Jul 09 14:56:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6ea727a8-6c26-4af4-b1fb-169a3c94cce6 tempest-ProjectReaderTests-723103240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:56:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6ea727a8-6c26-4af4-b1fb-169a3c94cce6 tempest-ProjectReaderTests-723103240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:56:35 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-6ea727a8-6c26-4af4-b1fb-169a3c94cce6 tempest-ProjectReaderTests-723103240 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:56:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-425324898',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=648ef354-4c17-40df-8da7-7df477b306a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='400e539b7b7f4ec085bd527aa1dbb013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:56:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:56:35Z,use_quota=True,user_id='f58e953150ce44af8e9370248f01e679',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:56:35 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-6ea727a8-6c26-4af4-b1fb-169a3c94cce6 tempest-ProjectReaderTests-723103240 None] Creating volume 648ef354-4c17-40df-8da7-7df477b306a7 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:56:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6ea727a8-6c26-4af4-b1fb-169a3c94cce6 tempest-ProjectReaderTests-723103240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:56:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6ea727a8-6c26-4af4-b1fb-169a3c94cce6 tempest-ProjectReaderTests-723103240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:56:35 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-6ea727a8-6c26-4af4-b1fb-169a3c94cce6 tempest-ProjectReaderTests-723103240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:56:35 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-6ea727a8-6c26-4af4-b1fb-169a3c94cce6 tempest-ProjectReaderTests-723103240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:56:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6ea727a8-6c26-4af4-b1fb-169a3c94cce6 tempest-ProjectReaderTests-723103240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:56:35 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-6ea727a8-6c26-4af4-b1fb-169a3c94cce6 tempest-ProjectReaderTests-723103240 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:56:35 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-6ea727a8-6c26-4af4-b1fb-169a3c94cce6 tempest-ProjectReaderTests-723103240 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:56:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6ea727a8-6c26-4af4-b1fb-169a3c94cce6 tempest-ProjectReaderTests-723103240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-648ef354-4c17-40df-8da7-7df477b306a7 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:56:35 devstack sudo[108447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-648ef354-4c17-40df-8da7-7df477b306a7 1073741824
Jul 09 14:56:35 devstack sudo[108447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:56:36 devstack sudo[108447]: pam_unix(sudo:session): session closed for user root
Jul 09 14:56:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6ea727a8-6c26-4af4-b1fb-169a3c94cce6 tempest-ProjectReaderTests-723103240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-648ef354-4c17-40df-8da7-7df477b306a7 1073741824" returned: 0 in 0.815s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:56:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6ea727a8-6c26-4af4-b1fb-169a3c94cce6 tempest-ProjectReaderTests-723103240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-648ef354-4c17-40df-8da7-7df477b306a7 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:56:36 devstack sudo[108453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-648ef354-4c17-40df-8da7-7df477b306a7
Jul 09 14:56:36 devstack sudo[108453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:56:37 devstack sudo[108453]: pam_unix(sudo:session): session closed for user root
Jul 09 14:56:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6ea727a8-6c26-4af4-b1fb-169a3c94cce6 tempest-ProjectReaderTests-723103240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-648ef354-4c17-40df-8da7-7df477b306a7" returned: 0 in 0.665s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:56:37 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-6ea727a8-6c26-4af4-b1fb-169a3c94cce6 tempest-ProjectReaderTests-723103240 None] <== create_volume: return (1525ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:56:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6ea727a8-6c26-4af4-b1fb-169a3c94cce6 tempest-ProjectReaderTests-723103240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.527s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:56:37 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6ea727a8-6c26-4af4-b1fb-169a3c94cce6 tempest-ProjectReaderTests-723103240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c977996-52ac-47da-abee-a8cee8ad084f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-648ef354-4c17-40df-8da7-7df477b306a7', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:56:37 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6ea727a8-6c26-4af4-b1fb-169a3c94cce6 tempest-ProjectReaderTests-723103240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b5a4e66-c1a4-4a8c-bb21-46d7145fd79c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:56:37 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-6ea727a8-6c26-4af4-b1fb-169a3c94cce6 tempest-ProjectReaderTests-723103240 None] Volume volume-648ef354-4c17-40df-8da7-7df477b306a7 (648ef354-4c17-40df-8da7-7df477b306a7): created successfully
Jul 09 14:56:37 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6ea727a8-6c26-4af4-b1fb-169a3c94cce6 tempest-ProjectReaderTests-723103240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b5a4e66-c1a4-4a8c-bb21-46d7145fd79c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:56:37 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6ea727a8-6c26-4af4-b1fb-169a3c94cce6 tempest-ProjectReaderTests-723103240 None] Flow 'volume_create_manager' (8db470a8-d3b6-450c-953c-60770890ae18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:56:37 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-6ea727a8-6c26-4af4-b1fb-169a3c94cce6 tempest-ProjectReaderTests-723103240 None] Created volume successfully.
Jul 09 14:56:37 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-12c39dab-1d55-4219-981b-62e57833de51 tempest-ProjectReaderTests-723103240 None] Acquiring lock "cinder-648ef354-4c17-40df-8da7-7df477b306a7-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:56:37 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-12c39dab-1d55-4219-981b-62e57833de51 tempest-ProjectReaderTests-723103240 None] Lock "cinder-648ef354-4c17-40df-8da7-7df477b306a7-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:56:37 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-12c39dab-1d55-4219-981b-62e57833de51 tempest-ProjectReaderTests-723103240 None] Acquiring lock "cinder-quobyte-648ef354-4c17-40df-8da7-7df477b306a7" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:56:37 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-12c39dab-1d55-4219-981b-62e57833de51 tempest-ProjectReaderTests-723103240 None] Lock "cinder-quobyte-648ef354-4c17-40df-8da7-7df477b306a7" acquired by "delete_volume" :: waited 0.013s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:56:37 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e741ff2-8a2c-4534-a31c-4d6d646b478f]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:56:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-12c39dab-1d55-4219-981b-62e57833de51 tempest-ProjectReaderTests-723103240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-648ef354-4c17-40df-8da7-7df477b306a7 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:56:37 devstack sudo[108456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-648ef354-4c17-40df-8da7-7df477b306a7
Jul 09 14:56:37 devstack sudo[108456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:56:38 devstack sudo[108456]: pam_unix(sudo:session): session closed for user root
Jul 09 14:56:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-12c39dab-1d55-4219-981b-62e57833de51 tempest-ProjectReaderTests-723103240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-648ef354-4c17-40df-8da7-7df477b306a7" returned: 0 in 0.765s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:56:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-12c39dab-1d55-4219-981b-62e57833de51 tempest-ProjectReaderTests-723103240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-648ef354-4c17-40df-8da7-7df477b306a7 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:56:38 devstack sudo[108461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-648ef354-4c17-40df-8da7-7df477b306a7
Jul 09 14:56:38 devstack sudo[108461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:56:39 devstack sudo[108461]: pam_unix(sudo:session): session closed for user root
Jul 09 14:56:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-12c39dab-1d55-4219-981b-62e57833de51 tempest-ProjectReaderTests-723103240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-648ef354-4c17-40df-8da7-7df477b306a7" returned: 0 in 0.709s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:56:39 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-12c39dab-1d55-4219-981b-62e57833de51 tempest-ProjectReaderTests-723103240 None] Lock "cinder-quobyte-648ef354-4c17-40df-8da7-7df477b306a7" released by "delete_volume" :: held 1.515s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:56:39 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-12c39dab-1d55-4219-981b-62e57833de51 tempest-ProjectReaderTests-723103240 None] Created reservations ['eba11d63-859c-4060-baeb-576f9cf617ab', 'a0a7c610-ac8b-444d-aa53-7024534b4474', '0057f5ee-1a02-45c2-b2d1-9d38236539ca', 'cd5e1b4f-6e79-4b85-8b79-69fc0c25d5c0'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:56:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-12c39dab-1d55-4219-981b-62e57833de51 tempest-ProjectReaderTests-723103240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:56:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-12c39dab-1d55-4219-981b-62e57833de51 tempest-ProjectReaderTests-723103240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:56:39 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-12c39dab-1d55-4219-981b-62e57833de51 tempest-ProjectReaderTests-723103240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:56:39 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-12c39dab-1d55-4219-981b-62e57833de51 tempest-ProjectReaderTests-723103240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:56:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-12c39dab-1d55-4219-981b-62e57833de51 tempest-ProjectReaderTests-723103240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:56:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-12c39dab-1d55-4219-981b-62e57833de51 tempest-ProjectReaderTests-723103240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:56:39 devstack sudo[108464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:56:39 devstack sudo[108464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:56:39 devstack sudo[108464]: pam_unix(sudo:session): session closed for user root
Jul 09 14:56:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-12c39dab-1d55-4219-981b-62e57833de51 tempest-ProjectReaderTests-723103240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.655s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:56:39 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-12c39dab-1d55-4219-981b-62e57833de51 tempest-ProjectReaderTests-723103240 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:56:39 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-12c39dab-1d55-4219-981b-62e57833de51 tempest-ProjectReaderTests-723103240 None] Deleted volume successfully.
Jul 09 14:56:40 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-12c39dab-1d55-4219-981b-62e57833de51 tempest-ProjectReaderTests-723103240 None] Lock "cinder-648ef354-4c17-40df-8da7-7df477b306a7-delete_volume" released by "delete_volume" :: held 2.381s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:56:40 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a157c60-275e-43f9-b722-36e278ec7366 tempest-ProjectReaderTests-723103240 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:56:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3a157c60-275e-43f9-b722-36e278ec7366 tempest-ProjectReaderTests-723103240 None] Flow 'volume_create_manager' (c4bf2768-7f1e-4bd5-88e7-aaad12b90815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:56:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3a157c60-275e-43f9-b722-36e278ec7366 tempest-ProjectReaderTests-723103240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aca416d5-20ab-4f5a-aef2-ace6a9a206e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:56:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3a157c60-275e-43f9-b722-36e278ec7366 tempest-ProjectReaderTests-723103240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aca416d5-20ab-4f5a-aef2-ace6a9a206e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:56:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1309206536',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbb1b824-7323-4a74-b228-8c051c49f712,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='400e539b7b7f4ec085bd527aa1dbb013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:56:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:56:40Z,use_quota=True,user_id='f58e953150ce44af8e9370248f01e679',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:56:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3a157c60-275e-43f9-b722-36e278ec7366 tempest-ProjectReaderTests-723103240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65d25a92-ad1c-4b12-a7f5-bc5b13f66321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:56:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3a157c60-275e-43f9-b722-36e278ec7366 tempest-ProjectReaderTests-723103240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65d25a92-ad1c-4b12-a7f5-bc5b13f66321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:56:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3a157c60-275e-43f9-b722-36e278ec7366 tempest-ProjectReaderTests-723103240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7db1723b-d7dc-4e22-a88c-c5be7feff837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:56:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3a157c60-275e-43f9-b722-36e278ec7366 tempest-ProjectReaderTests-723103240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7db1723b-d7dc-4e22-a88c-c5be7feff837) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbb1b824-7323-4a74-b228-8c051c49f712', 'volume_name': 'volume-bbb1b824-7323-4a74-b228-8c051c49f712', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:56:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3a157c60-275e-43f9-b722-36e278ec7366 tempest-ProjectReaderTests-723103240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4cd4ae5-7951-420a-b3f7-058928dfd7a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:56:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3a157c60-275e-43f9-b722-36e278ec7366 tempest-ProjectReaderTests-723103240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4cd4ae5-7951-420a-b3f7-058928dfd7a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:56:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3a157c60-275e-43f9-b722-36e278ec7366 tempest-ProjectReaderTests-723103240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fedca94f-5456-4c80-8f82-e7bbf29db4f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:56:40 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-3a157c60-275e-43f9-b722-36e278ec7366 tempest-ProjectReaderTests-723103240 None] Volume bbb1b824-7323-4a74-b228-8c051c49f712: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbb1b824-7323-4a74-b228-8c051c49f712', 'volume_size': 1}
Jul 09 14:56:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3a157c60-275e-43f9-b722-36e278ec7366 tempest-ProjectReaderTests-723103240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:56:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3a157c60-275e-43f9-b722-36e278ec7366 tempest-ProjectReaderTests-723103240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:56:40 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3a157c60-275e-43f9-b722-36e278ec7366 tempest-ProjectReaderTests-723103240 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:56:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1309206536',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbb1b824-7323-4a74-b228-8c051c49f712,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='400e539b7b7f4ec085bd527aa1dbb013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:56:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:56:40Z,use_quota=True,user_id='f58e953150ce44af8e9370248f01e679',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:56:40 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-3a157c60-275e-43f9-b722-36e278ec7366 tempest-ProjectReaderTests-723103240 None] Creating volume bbb1b824-7323-4a74-b228-8c051c49f712 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:56:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3a157c60-275e-43f9-b722-36e278ec7366 tempest-ProjectReaderTests-723103240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:56:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3a157c60-275e-43f9-b722-36e278ec7366 tempest-ProjectReaderTests-723103240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:56:40 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3a157c60-275e-43f9-b722-36e278ec7366 tempest-ProjectReaderTests-723103240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:56:40 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3a157c60-275e-43f9-b722-36e278ec7366 tempest-ProjectReaderTests-723103240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:56:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3a157c60-275e-43f9-b722-36e278ec7366 tempest-ProjectReaderTests-723103240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:56:40 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3a157c60-275e-43f9-b722-36e278ec7366 tempest-ProjectReaderTests-723103240 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:56:40 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-3a157c60-275e-43f9-b722-36e278ec7366 tempest-ProjectReaderTests-723103240 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:56:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3a157c60-275e-43f9-b722-36e278ec7366 tempest-ProjectReaderTests-723103240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bbb1b824-7323-4a74-b228-8c051c49f712 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:56:40 devstack sudo[108467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bbb1b824-7323-4a74-b228-8c051c49f712 1073741824
Jul 09 14:56:40 devstack sudo[108467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:56:41 devstack sudo[108467]: pam_unix(sudo:session): session closed for user root
Jul 09 14:56:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3a157c60-275e-43f9-b722-36e278ec7366 tempest-ProjectReaderTests-723103240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bbb1b824-7323-4a74-b228-8c051c49f712 1073741824" returned: 0 in 0.810s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:56:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3a157c60-275e-43f9-b722-36e278ec7366 tempest-ProjectReaderTests-723103240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bbb1b824-7323-4a74-b228-8c051c49f712 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:56:41 devstack sudo[108474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bbb1b824-7323-4a74-b228-8c051c49f712
Jul 09 14:56:41 devstack sudo[108474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:56:41 devstack sudo[108474]: pam_unix(sudo:session): session closed for user root
Jul 09 14:56:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3a157c60-275e-43f9-b722-36e278ec7366 tempest-ProjectReaderTests-723103240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bbb1b824-7323-4a74-b228-8c051c49f712" returned: 0 in 0.646s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:56:41 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3a157c60-275e-43f9-b722-36e278ec7366 tempest-ProjectReaderTests-723103240 None] <== create_volume: return (1503ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:56:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3a157c60-275e-43f9-b722-36e278ec7366 tempest-ProjectReaderTests-723103240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.506s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:56:41 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3a157c60-275e-43f9-b722-36e278ec7366 tempest-ProjectReaderTests-723103240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fedca94f-5456-4c80-8f82-e7bbf29db4f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbb1b824-7323-4a74-b228-8c051c49f712', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:56:41 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3a157c60-275e-43f9-b722-36e278ec7366 tempest-ProjectReaderTests-723103240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0266a723-d20c-4c4c-99d5-f1051ff07e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:56:41 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-3a157c60-275e-43f9-b722-36e278ec7366 tempest-ProjectReaderTests-723103240 None] Volume volume-bbb1b824-7323-4a74-b228-8c051c49f712 (bbb1b824-7323-4a74-b228-8c051c49f712): created successfully
Jul 09 14:56:41 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3a157c60-275e-43f9-b722-36e278ec7366 tempest-ProjectReaderTests-723103240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0266a723-d20c-4c4c-99d5-f1051ff07e96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:56:41 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3a157c60-275e-43f9-b722-36e278ec7366 tempest-ProjectReaderTests-723103240 None] Flow 'volume_create_manager' (c4bf2768-7f1e-4bd5-88e7-aaad12b90815) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:56:41 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-3a157c60-275e-43f9-b722-36e278ec7366 tempest-ProjectReaderTests-723103240 None] Created volume successfully.
Jul 09 14:56:42 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-26f157a2-5771-483f-b2f3-31b50a1c2ffc tempest-ProjectReaderTests-723103240 None] Acquiring lock "cinder-bbb1b824-7323-4a74-b228-8c051c49f712-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:56:42 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-26f157a2-5771-483f-b2f3-31b50a1c2ffc tempest-ProjectReaderTests-723103240 None] Lock "cinder-bbb1b824-7323-4a74-b228-8c051c49f712-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:56:42 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-26f157a2-5771-483f-b2f3-31b50a1c2ffc tempest-ProjectReaderTests-723103240 None] Acquiring lock "cinder-quobyte-bbb1b824-7323-4a74-b228-8c051c49f712" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:56:42 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-26f157a2-5771-483f-b2f3-31b50a1c2ffc tempest-ProjectReaderTests-723103240 None] Lock "cinder-quobyte-bbb1b824-7323-4a74-b228-8c051c49f712" acquired by "delete_volume" :: waited 0.015s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:56:42 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f055573-4b0c-4f85-ae85-8b4220209b36]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:56:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-26f157a2-5771-483f-b2f3-31b50a1c2ffc tempest-ProjectReaderTests-723103240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bbb1b824-7323-4a74-b228-8c051c49f712 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:56:42 devstack sudo[108477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bbb1b824-7323-4a74-b228-8c051c49f712
Jul 09 14:56:42 devstack sudo[108477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:56:43 devstack sudo[108477]: pam_unix(sudo:session): session closed for user root
Jul 09 14:56:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-26f157a2-5771-483f-b2f3-31b50a1c2ffc tempest-ProjectReaderTests-723103240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bbb1b824-7323-4a74-b228-8c051c49f712" returned: 0 in 0.780s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:56:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-26f157a2-5771-483f-b2f3-31b50a1c2ffc tempest-ProjectReaderTests-723103240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bbb1b824-7323-4a74-b228-8c051c49f712 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:56:43 devstack sudo[108482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bbb1b824-7323-4a74-b228-8c051c49f712
Jul 09 14:56:43 devstack sudo[108482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:56:43 devstack sudo[108482]: pam_unix(sudo:session): session closed for user root
Jul 09 14:56:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-26f157a2-5771-483f-b2f3-31b50a1c2ffc tempest-ProjectReaderTests-723103240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-bbb1b824-7323-4a74-b228-8c051c49f712" returned: 0 in 0.638s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:56:43 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-26f157a2-5771-483f-b2f3-31b50a1c2ffc tempest-ProjectReaderTests-723103240 None] Lock "cinder-quobyte-bbb1b824-7323-4a74-b228-8c051c49f712" released by "delete_volume" :: held 1.460s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:56:43 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-26f157a2-5771-483f-b2f3-31b50a1c2ffc tempest-ProjectReaderTests-723103240 None] Created reservations ['56a38a7e-b6eb-45ce-9178-2c68ced3d01d', '48a3426c-e49e-42a0-b2c6-636115ca7a47', '25bac05f-54f5-4390-b1eb-45c930d3eb8c', '55d4545c-e69c-4df1-875d-938ec99b86ac'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:56:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-26f157a2-5771-483f-b2f3-31b50a1c2ffc tempest-ProjectReaderTests-723103240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:56:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-26f157a2-5771-483f-b2f3-31b50a1c2ffc tempest-ProjectReaderTests-723103240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:56:44 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-26f157a2-5771-483f-b2f3-31b50a1c2ffc tempest-ProjectReaderTests-723103240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:56:44 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-26f157a2-5771-483f-b2f3-31b50a1c2ffc tempest-ProjectReaderTests-723103240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:56:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-26f157a2-5771-483f-b2f3-31b50a1c2ffc tempest-ProjectReaderTests-723103240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:56:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-26f157a2-5771-483f-b2f3-31b50a1c2ffc tempest-ProjectReaderTests-723103240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:56:44 devstack sudo[108485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:56:44 devstack sudo[108485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:56:44 devstack sudo[108485]: pam_unix(sudo:session): session closed for user root
Jul 09 14:56:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-26f157a2-5771-483f-b2f3-31b50a1c2ffc tempest-ProjectReaderTests-723103240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.661s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:56:44 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-26f157a2-5771-483f-b2f3-31b50a1c2ffc tempest-ProjectReaderTests-723103240 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:56:44 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-26f157a2-5771-483f-b2f3-31b50a1c2ffc tempest-ProjectReaderTests-723103240 None] Deleted volume successfully.
Jul 09 14:56:44 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-26f157a2-5771-483f-b2f3-31b50a1c2ffc tempest-ProjectReaderTests-723103240 None] Lock "cinder-bbb1b824-7323-4a74-b228-8c051c49f712-delete_volume" released by "delete_volume" :: held 2.312s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:56:52 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 14:56:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:56:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:56:52 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:56:52 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:56:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:56:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:56:52 devstack sudo[108525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:56:52 devstack sudo[108525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:56:53 devstack sudo[108525]: pam_unix(sudo:session): session closed for user root
Jul 09 14:56:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.742s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:56:53 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:56:53 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Running periodic task VolumeManager._thread_info {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 14:56:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] thread count: 28 {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 09 14:56:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] thread info: [<_MainThread(MainThread, started 125388812103808)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125388713797504)>, <Thread(Thread-3 (stat_writer), started daemon 125388699995392)>, <Thread(Rabbit-heartbeat, started daemon 125388700522560)>, <Thread(Thread-5 (_runner), started daemon 125388698545216)>, <Thread(Thread-7 (_runner), started daemon 125388698611264)>, <Thread(fd_logger, started daemon 125388703020672)>, <Thread(privsep_reader, started daemon 125388696441088)>, <Thread(tpool_thread_0, started daemon 125388687943360)>, <Thread(tpool_thread_1, started daemon 125388679550656)>, <Thread(tpool_thread_2, started daemon 125388671141568)>, <Thread(tpool_thread_3, started daemon 125388662732480)>, <Thread(tpool_thread_4, started daemon 125388654323392)>, <Thread(tpool_thread_5, started daemon 125388645914304)>, <Thread(tpool_thread_6, started daemon 125388637505216)>, <Thread(tpool_thread_7, started daemon 125388629096128)>, <Thread(tpool_thread_8, started daemon 125388620687040)>, <Thread(tpool_thread_9, started daemon 125388612277952)>, <Thread(tpool_thread_10, started daemon 125388603868864)>, <Thread(tpool_thread_11, started daemon 125388595459776)>, <Thread(tpool_thread_12, started daemon 125388587050688)>, <Thread(tpool_thread_13, started daemon 125388578641600)>, <Thread(tpool_thread_14, started daemon 125388570232512)>, <Thread(tpool_thread_15, started daemon 125388561823424)>, <Thread(tpool_thread_16, started daemon 125388553414336)>, <Thread(tpool_thread_17, started daemon 125388545005248)>, <Thread(tpool_thread_18, started daemon 125388536596160)>, <Thread(tpool_thread_19, started daemon 125388528187072)>] {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 09 14:56:53 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=51,cinder:INSERT=21,cinder:UPDATE=71,cinder:DELETE=5 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 14:56:54 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=50,cinder:INSERT=17,cinder:UPDATE=72,cinder:DELETE=6 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 14:57:05 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a0d5904-a7a8-47c5-849d-b153a5501850 tempest-SnapshotDependencyTests-475794630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:57:05 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1a0d5904-a7a8-47c5-849d-b153a5501850 tempest-SnapshotDependencyTests-475794630 None] Flow 'volume_create_manager' (10949c52-4a22-44b6-87ab-53316dc1d85e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:57:05 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1a0d5904-a7a8-47c5-849d-b153a5501850 tempest-SnapshotDependencyTests-475794630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a45c0654-ec9c-45d8-91b3-c563b5318d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:57:05 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1a0d5904-a7a8-47c5-849d-b153a5501850 tempest-SnapshotDependencyTests-475794630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a45c0654-ec9c-45d8-91b3-c563b5318d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:57:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1500211541',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10bc915f-14f2-41eb-8613-2a2f70f1e9b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2231e9217ac04cb0baeb373613f51641',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:57:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:57:06Z,use_quota=True,user_id='c67edf347ea14771a3010e33b4a65dbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:57:05 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1a0d5904-a7a8-47c5-849d-b153a5501850 tempest-SnapshotDependencyTests-475794630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dae27290-2691-4d94-98fe-1d9fe43752a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:57:05 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1a0d5904-a7a8-47c5-849d-b153a5501850 tempest-SnapshotDependencyTests-475794630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dae27290-2691-4d94-98fe-1d9fe43752a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:57:05 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1a0d5904-a7a8-47c5-849d-b153a5501850 tempest-SnapshotDependencyTests-475794630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65fd40b1-064c-44c1-ab96-ffe70a862873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:57:05 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1a0d5904-a7a8-47c5-849d-b153a5501850 tempest-SnapshotDependencyTests-475794630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65fd40b1-064c-44c1-ab96-ffe70a862873) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10bc915f-14f2-41eb-8613-2a2f70f1e9b1', 'volume_name': 'volume-10bc915f-14f2-41eb-8613-2a2f70f1e9b1', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:57:05 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1a0d5904-a7a8-47c5-849d-b153a5501850 tempest-SnapshotDependencyTests-475794630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc10eec3-d535-490b-99bc-2c5d407f8a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:57:05 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1a0d5904-a7a8-47c5-849d-b153a5501850 tempest-SnapshotDependencyTests-475794630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc10eec3-d535-490b-99bc-2c5d407f8a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:57:05 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1a0d5904-a7a8-47c5-849d-b153a5501850 tempest-SnapshotDependencyTests-475794630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffe323c1-a4e2-44a0-ad83-20766f92fccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:57:05 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-1a0d5904-a7a8-47c5-849d-b153a5501850 tempest-SnapshotDependencyTests-475794630 None] Volume 10bc915f-14f2-41eb-8613-2a2f70f1e9b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10bc915f-14f2-41eb-8613-2a2f70f1e9b1', 'volume_size': 1}
Jul 09 14:57:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1a0d5904-a7a8-47c5-849d-b153a5501850 tempest-SnapshotDependencyTests-475794630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:57:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1a0d5904-a7a8-47c5-849d-b153a5501850 tempest-SnapshotDependencyTests-475794630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:57:05 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-1a0d5904-a7a8-47c5-849d-b153a5501850 tempest-SnapshotDependencyTests-475794630 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x720a551475c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:57:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1500211541',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10bc915f-14f2-41eb-8613-2a2f70f1e9b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2231e9217ac04cb0baeb373613f51641',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:57:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:57:06Z,use_quota=True,user_id='c67edf347ea14771a3010e33b4a65dbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 14:57:05 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-1a0d5904-a7a8-47c5-849d-b153a5501850 tempest-SnapshotDependencyTests-475794630 None] Creating volume 10bc915f-14f2-41eb-8613-2a2f70f1e9b1 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 14:57:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1a0d5904-a7a8-47c5-849d-b153a5501850 tempest-SnapshotDependencyTests-475794630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:57:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1a0d5904-a7a8-47c5-849d-b153a5501850 tempest-SnapshotDependencyTests-475794630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:57:05 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-1a0d5904-a7a8-47c5-849d-b153a5501850 tempest-SnapshotDependencyTests-475794630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:57:05 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-1a0d5904-a7a8-47c5-849d-b153a5501850 tempest-SnapshotDependencyTests-475794630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:57:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1a0d5904-a7a8-47c5-849d-b153a5501850 tempest-SnapshotDependencyTests-475794630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:57:05 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-1a0d5904-a7a8-47c5-849d-b153a5501850 tempest-SnapshotDependencyTests-475794630 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:57:05 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-1a0d5904-a7a8-47c5-849d-b153a5501850 tempest-SnapshotDependencyTests-475794630 None] casted to osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653
Jul 09 14:57:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1a0d5904-a7a8-47c5-849d-b153a5501850 tempest-SnapshotDependencyTests-475794630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-10bc915f-14f2-41eb-8613-2a2f70f1e9b1 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:57:05 devstack sudo[108537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-10bc915f-14f2-41eb-8613-2a2f70f1e9b1 1073741824
Jul 09 14:57:05 devstack sudo[108537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:57:06 devstack sudo[108537]: pam_unix(sudo:session): session closed for user root
Jul 09 14:57:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1a0d5904-a7a8-47c5-849d-b153a5501850 tempest-SnapshotDependencyTests-475794630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-10bc915f-14f2-41eb-8613-2a2f70f1e9b1 1073741824" returned: 0 in 0.807s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:57:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1a0d5904-a7a8-47c5-849d-b153a5501850 tempest-SnapshotDependencyTests-475794630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-10bc915f-14f2-41eb-8613-2a2f70f1e9b1 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:57:06 devstack sudo[108542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-10bc915f-14f2-41eb-8613-2a2f70f1e9b1
Jul 09 14:57:06 devstack sudo[108542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:57:07 devstack sudo[108542]: pam_unix(sudo:session): session closed for user root
Jul 09 14:57:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1a0d5904-a7a8-47c5-849d-b153a5501850 tempest-SnapshotDependencyTests-475794630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-10bc915f-14f2-41eb-8613-2a2f70f1e9b1" returned: 0 in 0.655s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:57:07 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-1a0d5904-a7a8-47c5-849d-b153a5501850 tempest-SnapshotDependencyTests-475794630 None] <== create_volume: return (1511ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 14:57:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1a0d5904-a7a8-47c5-849d-b153a5501850 tempest-SnapshotDependencyTests-475794630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.515s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:57:07 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1a0d5904-a7a8-47c5-849d-b153a5501850 tempest-SnapshotDependencyTests-475794630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffe323c1-a4e2-44a0-ad83-20766f92fccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10bc915f-14f2-41eb-8613-2a2f70f1e9b1', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:57:07 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1a0d5904-a7a8-47c5-849d-b153a5501850 tempest-SnapshotDependencyTests-475794630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b98577cc-fe2a-4398-811d-19cda87d6ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:57:07 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-1a0d5904-a7a8-47c5-849d-b153a5501850 tempest-SnapshotDependencyTests-475794630 None] Volume volume-10bc915f-14f2-41eb-8613-2a2f70f1e9b1 (10bc915f-14f2-41eb-8613-2a2f70f1e9b1): created successfully
Jul 09 14:57:07 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1a0d5904-a7a8-47c5-849d-b153a5501850 tempest-SnapshotDependencyTests-475794630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b98577cc-fe2a-4398-811d-19cda87d6ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:57:07 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1a0d5904-a7a8-47c5-849d-b153a5501850 tempest-SnapshotDependencyTests-475794630 None] Flow 'volume_create_manager' (10949c52-4a22-44b6-87ab-53316dc1d85e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:57:07 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-1a0d5904-a7a8-47c5-849d-b153a5501850 tempest-SnapshotDependencyTests-475794630 None] Created volume successfully.
Jul 09 14:57:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e68c134f-5811-4af7-9b66-361b28e2f1f5 tempest-SnapshotDependencyTests-475794630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:57:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e68c134f-5811-4af7-9b66-361b28e2f1f5 tempest-SnapshotDependencyTests-475794630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:57:08 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-e68c134f-5811-4af7-9b66-361b28e2f1f5 tempest-SnapshotDependencyTests-475794630 None] Creating offline snapshot 11526ce4-a15f-469f-ba73-58d4b39db206 of volume 10bc915f-14f2-41eb-8613-2a2f70f1e9b1 {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 14:57:08 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8830da9-7f6b-4873-8e6b-d2b12ff97463]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:57:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e68c134f-5811-4af7-9b66-361b28e2f1f5 tempest-SnapshotDependencyTests-475794630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-10bc915f-14f2-41eb-8613-2a2f70f1e9b1 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:57:08 devstack sudo[108545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-10bc915f-14f2-41eb-8613-2a2f70f1e9b1
Jul 09 14:57:08 devstack sudo[108545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:57:08 devstack sudo[108545]: pam_unix(sudo:session): session closed for user root
Jul 09 14:57:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e68c134f-5811-4af7-9b66-361b28e2f1f5 tempest-SnapshotDependencyTests-475794630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-10bc915f-14f2-41eb-8613-2a2f70f1e9b1" returned: 0 in 0.768s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:57:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e68c134f-5811-4af7-9b66-361b28e2f1f5 tempest-SnapshotDependencyTests-475794630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-10bc915f-14f2-41eb-8613-2a2f70f1e9b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-10bc915f-14f2-41eb-8613-2a2f70f1e9b1.11526ce4-a15f-469f-ba73-58d4b39db206 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:57:08 devstack sudo[108550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-10bc915f-14f2-41eb-8613-2a2f70f1e9b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-10bc915f-14f2-41eb-8613-2a2f70f1e9b1.11526ce4-a15f-469f-ba73-58d4b39db206 1G
Jul 09 14:57:08 devstack sudo[108550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:57:09 devstack sudo[108550]: pam_unix(sudo:session): session closed for user root
Jul 09 14:57:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e68c134f-5811-4af7-9b66-361b28e2f1f5 tempest-SnapshotDependencyTests-475794630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-10bc915f-14f2-41eb-8613-2a2f70f1e9b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-10bc915f-14f2-41eb-8613-2a2f70f1e9b1.11526ce4-a15f-469f-ba73-58d4b39db206 1G" returned: 0 in 0.774s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:57:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e68c134f-5811-4af7-9b66-361b28e2f1f5 tempest-SnapshotDependencyTests-475794630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10bc915f-14f2-41eb-8613-2a2f70f1e9b1 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-10bc915f-14f2-41eb-8613-2a2f70f1e9b1.11526ce4-a15f-469f-ba73-58d4b39db206 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:57:09 devstack sudo[108556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10bc915f-14f2-41eb-8613-2a2f70f1e9b1 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-10bc915f-14f2-41eb-8613-2a2f70f1e9b1.11526ce4-a15f-469f-ba73-58d4b39db206
Jul 09 14:57:09 devstack sudo[108556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:57:10 devstack sudo[108556]: pam_unix(sudo:session): session closed for user root
Jul 09 14:57:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e68c134f-5811-4af7-9b66-361b28e2f1f5 tempest-SnapshotDependencyTests-475794630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10bc915f-14f2-41eb-8613-2a2f70f1e9b1 -F qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-10bc915f-14f2-41eb-8613-2a2f70f1e9b1.11526ce4-a15f-469f-ba73-58d4b39db206" returned: 0 in 0.676s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:57:10 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-e68c134f-5811-4af7-9b66-361b28e2f1f5 tempest-SnapshotDependencyTests-475794630 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-10bc915f-14f2-41eb-8613-2a2f70f1e9b1.11526ce4-a15f-469f-ba73-58d4b39db206 is being set with open permissions: ugo+rw
Jul 09 14:57:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e68c134f-5811-4af7-9b66-361b28e2f1f5 tempest-SnapshotDependencyTests-475794630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-10bc915f-14f2-41eb-8613-2a2f70f1e9b1.11526ce4-a15f-469f-ba73-58d4b39db206 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:57:10 devstack sudo[108562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-10bc915f-14f2-41eb-8613-2a2f70f1e9b1.11526ce4-a15f-469f-ba73-58d4b39db206
Jul 09 14:57:10 devstack sudo[108562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:57:10 devstack sudo[108562]: pam_unix(sudo:session): session closed for user root
Jul 09 14:57:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e68c134f-5811-4af7-9b66-361b28e2f1f5 tempest-SnapshotDependencyTests-475794630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-10bc915f-14f2-41eb-8613-2a2f70f1e9b1.11526ce4-a15f-469f-ba73-58d4b39db206" returned: 0 in 0.679s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:57:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e68c134f-5811-4af7-9b66-361b28e2f1f5 tempest-SnapshotDependencyTests-475794630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-10bc915f-14f2-41eb-8613-2a2f70f1e9b1.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:57:11 devstack sudo[108565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-10bc915f-14f2-41eb-8613-2a2f70f1e9b1.info
Jul 09 14:57:11 devstack sudo[108565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:57:11 devstack sudo[108565]: pam_unix(sudo:session): session closed for user root
Jul 09 14:57:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e68c134f-5811-4af7-9b66-361b28e2f1f5 tempest-SnapshotDependencyTests-475794630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-10bc915f-14f2-41eb-8613-2a2f70f1e9b1.info" returned: 0 in 0.625s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:57:11 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-e68c134f-5811-4af7-9b66-361b28e2f1f5 tempest-SnapshotDependencyTests-475794630 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-10bc915f-14f2-41eb-8613-2a2f70f1e9b1.info is being set with open permissions: ugo+rw
Jul 09 14:57:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e68c134f-5811-4af7-9b66-361b28e2f1f5 tempest-SnapshotDependencyTests-475794630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-10bc915f-14f2-41eb-8613-2a2f70f1e9b1.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:57:11 devstack sudo[108569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-10bc915f-14f2-41eb-8613-2a2f70f1e9b1.info
Jul 09 14:57:11 devstack sudo[108569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:57:12 devstack sudo[108569]: pam_unix(sudo:session): session closed for user root
Jul 09 14:57:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e68c134f-5811-4af7-9b66-361b28e2f1f5 tempest-SnapshotDependencyTests-475794630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-10bc915f-14f2-41eb-8613-2a2f70f1e9b1.info" returned: 0 in 0.669s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:57:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e68c134f-5811-4af7-9b66-361b28e2f1f5 tempest-SnapshotDependencyTests-475794630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.274s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:57:12 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-e68c134f-5811-4af7-9b66-361b28e2f1f5 tempest-SnapshotDependencyTests-475794630 None] Create snapshot completed successfully
Jul 09 14:57:13 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-6712b5e7-acb5-4cea-8017-4af5eef291ae tempest-SnapshotDependencyTests-475794630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 14:57:13 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6712b5e7-acb5-4cea-8017-4af5eef291ae tempest-SnapshotDependencyTests-475794630 None] Flow 'volume_create_manager' (69fa155c-0163-4108-afb7-a59614490a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:57:13 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6712b5e7-acb5-4cea-8017-4af5eef291ae tempest-SnapshotDependencyTests-475794630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82a8d183-1949-45bc-a125-164e26477e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:57:13 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6712b5e7-acb5-4cea-8017-4af5eef291ae tempest-SnapshotDependencyTests-475794630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82a8d183-1949-45bc-a125-164e26477e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T12:57:13Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88b974ab-ee66-4004-8526-d8e5a9033bc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2231e9217ac04cb0baeb373613f51641',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:57:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=11526ce4-a15f-469f-ba73-58d4b39db206,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:57:14Z,use_quota=True,user_id='c67edf347ea14771a3010e33b4a65dbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(685d5e0a-cf54-4297-93e8-0e2bacbf66f6),volume_type_id=685d5e0a-cf54-4297-93e8-0e2bacbf66f6)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:57:13 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6712b5e7-acb5-4cea-8017-4af5eef291ae tempest-SnapshotDependencyTests-475794630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95b41af0-f642-4d6e-8adb-3a66dbaf9d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:57:13 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6712b5e7-acb5-4cea-8017-4af5eef291ae tempest-SnapshotDependencyTests-475794630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95b41af0-f642-4d6e-8adb-3a66dbaf9d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:57:13 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6712b5e7-acb5-4cea-8017-4af5eef291ae tempest-SnapshotDependencyTests-475794630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d260b2d-bf54-40fa-a55d-2b25b6a3e2ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:57:13 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6712b5e7-acb5-4cea-8017-4af5eef291ae tempest-SnapshotDependencyTests-475794630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d260b2d-bf54-40fa-a55d-2b25b6a3e2ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '88b974ab-ee66-4004-8526-d8e5a9033bc4', 'volume_name': 'volume-88b974ab-ee66-4004-8526-d8e5a9033bc4', 'volume_size': 1, 'snapshot_id': '11526ce4-a15f-469f-ba73-58d4b39db206'}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:57:13 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6712b5e7-acb5-4cea-8017-4af5eef291ae tempest-SnapshotDependencyTests-475794630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1d54a01-2e21-4104-a2e7-fe263fb0a0cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:57:13 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6712b5e7-acb5-4cea-8017-4af5eef291ae tempest-SnapshotDependencyTests-475794630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1d54a01-2e21-4104-a2e7-fe263fb0a0cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:57:13 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6712b5e7-acb5-4cea-8017-4af5eef291ae tempest-SnapshotDependencyTests-475794630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8581d639-9f69-4e48-9795-2759b928410d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:57:13 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-6712b5e7-acb5-4cea-8017-4af5eef291ae tempest-SnapshotDependencyTests-475794630 None] Volume 88b974ab-ee66-4004-8526-d8e5a9033bc4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-88b974ab-ee66-4004-8526-d8e5a9033bc4', 'volume_size': 1, 'snapshot_id': '11526ce4-a15f-469f-ba73-58d4b39db206'}
Jul 09 14:57:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6712b5e7-acb5-4cea-8017-4af5eef291ae tempest-SnapshotDependencyTests-475794630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:57:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6712b5e7-acb5-4cea-8017-4af5eef291ae tempest-SnapshotDependencyTests-475794630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:57:13 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-6712b5e7-acb5-4cea-8017-4af5eef291ae tempest-SnapshotDependencyTests-475794630 None] Acquiring lock "cinder-quobyte-11526ce4-a15f-469f-ba73-58d4b39db206-88b974ab-ee66-4004-8526-d8e5a9033bc4" by "_create_volume_from_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:57:13 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-6712b5e7-acb5-4cea-8017-4af5eef291ae tempest-SnapshotDependencyTests-475794630 None] Lock "cinder-quobyte-11526ce4-a15f-469f-ba73-58d4b39db206-88b974ab-ee66-4004-8526-d8e5a9033bc4" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:57:13 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-6712b5e7-acb5-4cea-8017-4af5eef291ae tempest-SnapshotDependencyTests-475794630 None] Creating volume 88b974ab-ee66-4004-8526-d8e5a9033bc4 from snapshot 11526ce4-a15f-469f-ba73-58d4b39db206 {{(pid=87230) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 09 14:57:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6712b5e7-acb5-4cea-8017-4af5eef291ae tempest-SnapshotDependencyTests-475794630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:57:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6712b5e7-acb5-4cea-8017-4af5eef291ae tempest-SnapshotDependencyTests-475794630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:57:13 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-6712b5e7-acb5-4cea-8017-4af5eef291ae tempest-SnapshotDependencyTests-475794630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:57:13 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-6712b5e7-acb5-4cea-8017-4af5eef291ae tempest-SnapshotDependencyTests-475794630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:57:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6712b5e7-acb5-4cea-8017-4af5eef291ae tempest-SnapshotDependencyTests-475794630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:57:13 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-6712b5e7-acb5-4cea-8017-4af5eef291ae tempest-SnapshotDependencyTests-475794630 None] Selected osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 14:57:13 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-6712b5e7-acb5-4cea-8017-4af5eef291ae tempest-SnapshotDependencyTests-475794630 None] Acquiring lock "cinder-quobyte-88b974ab-ee66-4004-8526-d8e5a9033bc4" by "_copy_volume_from_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:57:13 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-6712b5e7-acb5-4cea-8017-4af5eef291ae tempest-SnapshotDependencyTests-475794630 None] Lock "cinder-quobyte-88b974ab-ee66-4004-8526-d8e5a9033bc4" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:57:13 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-6712b5e7-acb5-4cea-8017-4af5eef291ae tempest-SnapshotDependencyTests-475794630 None] snapshot: 11526ce4-a15f-469f-ba73-58d4b39db206, volume: 88b974ab-ee66-4004-8526-d8e5a9033bc4,  {{(pid=87230) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 09 14:57:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6712b5e7-acb5-4cea-8017-4af5eef291ae tempest-SnapshotDependencyTests-475794630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:57:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6712b5e7-acb5-4cea-8017-4af5eef291ae tempest-SnapshotDependencyTests-475794630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:57:13 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-6712b5e7-acb5-4cea-8017-4af5eef291ae tempest-SnapshotDependencyTests-475794630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:57:13 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-6712b5e7-acb5-4cea-8017-4af5eef291ae tempest-SnapshotDependencyTests-475794630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:57:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6712b5e7-acb5-4cea-8017-4af5eef291ae tempest-SnapshotDependencyTests-475794630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:57:13 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7b2ec81-500d-4d9c-8b8c-0fae7224b9d5]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:57:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6712b5e7-acb5-4cea-8017-4af5eef291ae tempest-SnapshotDependencyTests-475794630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-10bc915f-14f2-41eb-8613-2a2f70f1e9b1.11526ce4-a15f-469f-ba73-58d4b39db206 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:57:14 devstack sudo[108573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-10bc915f-14f2-41eb-8613-2a2f70f1e9b1.11526ce4-a15f-469f-ba73-58d4b39db206
Jul 09 14:57:14 devstack sudo[108573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:57:14 devstack sudo[108573]: pam_unix(sudo:session): session closed for user root
Jul 09 14:57:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6712b5e7-acb5-4cea-8017-4af5eef291ae tempest-SnapshotDependencyTests-475794630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-10bc915f-14f2-41eb-8613-2a2f70f1e9b1.11526ce4-a15f-469f-ba73-58d4b39db206" returned: 0 in 0.759s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:57:14 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-6712b5e7-acb5-4cea-8017-4af5eef291ae tempest-SnapshotDependencyTests-475794630 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10bc915f-14f2-41eb-8613-2a2f70f1e9b1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 14:57:14 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-6712b5e7-acb5-4cea-8017-4af5eef291ae tempest-SnapshotDependencyTests-475794630 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-10bc915f-14f2-41eb-8613-2a2f70f1e9b1 {{(pid=87230) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 09 14:57:14 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-6712b5e7-acb5-4cea-8017-4af5eef291ae tempest-SnapshotDependencyTests-475794630 None] Creating direct copy from snapshot {{(pid=87230) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 09 14:57:14 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4bf503c-ec3e-4253-b750-26721fbec77d]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:57:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6712b5e7-acb5-4cea-8017-4af5eef291ae tempest-SnapshotDependencyTests-475794630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-10bc915f-14f2-41eb-8613-2a2f70f1e9b1 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:57:14 devstack sudo[108578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-10bc915f-14f2-41eb-8613-2a2f70f1e9b1
Jul 09 14:57:14 devstack sudo[108578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:57:15 devstack sudo[108578]: pam_unix(sudo:session): session closed for user root
Jul 09 14:57:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6712b5e7-acb5-4cea-8017-4af5eef291ae tempest-SnapshotDependencyTests-475794630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-10bc915f-14f2-41eb-8613-2a2f70f1e9b1" returned: 0 in 0.757s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:57:15 devstack cinder-volume[87230]: DEBUG cinder.utils [None req-6712b5e7-acb5-4cea-8017-4af5eef291ae tempest-SnapshotDependencyTests-475794630 None] Path /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-88b974ab-ee66-4004-8526-d8e5a9033bc4 not found in is_blk_device check {{(pid=87230) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 09 14:57:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6712b5e7-acb5-4cea-8017-4af5eef291ae tempest-SnapshotDependencyTests-475794630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-10bc915f-14f2-41eb-8613-2a2f70f1e9b1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-88b974ab-ee66-4004-8526-d8e5a9033bc4 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:57:15 devstack sudo[108583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-10bc915f-14f2-41eb-8613-2a2f70f1e9b1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-88b974ab-ee66-4004-8526-d8e5a9033bc4
Jul 09 14:57:15 devstack sudo[108583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:57:19 devstack sudo[108583]: pam_unix(sudo:session): session closed for user root
Jul 09 14:57:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6712b5e7-acb5-4cea-8017-4af5eef291ae tempest-SnapshotDependencyTests-475794630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-10bc915f-14f2-41eb-8613-2a2f70f1e9b1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-88b974ab-ee66-4004-8526-d8e5a9033bc4" returned: 0 in 4.387s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:57:19 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a0ac70-8500-4314-a49a-e798877db188]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:57:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6712b5e7-acb5-4cea-8017-4af5eef291ae tempest-SnapshotDependencyTests-475794630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-10bc915f-14f2-41eb-8613-2a2f70f1e9b1 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:57:20 devstack sudo[108597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-10bc915f-14f2-41eb-8613-2a2f70f1e9b1
Jul 09 14:57:20 devstack sudo[108597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:57:20 devstack sudo[108597]: pam_unix(sudo:session): session closed for user root
Jul 09 14:57:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6712b5e7-acb5-4cea-8017-4af5eef291ae tempest-SnapshotDependencyTests-475794630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-10bc915f-14f2-41eb-8613-2a2f70f1e9b1" returned: 0 in 0.895s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:57:20 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-6712b5e7-acb5-4cea-8017-4af5eef291ae tempest-SnapshotDependencyTests-475794630 None] Image conversion details: src /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-10bc915f-14f2-41eb-8613-2a2f70f1e9b1, size 1024.00 MB, duration 4.39 sec, destination /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-88b974ab-ee66-4004-8526-d8e5a9033bc4 {{(pid=87230) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 09 14:57:20 devstack cinder-volume[87230]: INFO cinder.image.image_utils [None req-6712b5e7-acb5-4cea-8017-4af5eef291ae tempest-SnapshotDependencyTests-475794630 None] Converted 1024.00 MB image at 233.35 MB/s
Jul 09 14:57:20 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-6712b5e7-acb5-4cea-8017-4af5eef291ae tempest-SnapshotDependencyTests-475794630 None] /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-88b974ab-ee66-4004-8526-d8e5a9033bc4 is being set with open permissions: ugo+rw
Jul 09 14:57:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6712b5e7-acb5-4cea-8017-4af5eef291ae tempest-SnapshotDependencyTests-475794630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-88b974ab-ee66-4004-8526-d8e5a9033bc4 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:57:20 devstack sudo[108602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-88b974ab-ee66-4004-8526-d8e5a9033bc4
Jul 09 14:57:20 devstack sudo[108602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:57:21 devstack sudo[108602]: pam_unix(sudo:session): session closed for user root
Jul 09 14:57:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6712b5e7-acb5-4cea-8017-4af5eef291ae tempest-SnapshotDependencyTests-475794630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-88b974ab-ee66-4004-8526-d8e5a9033bc4" returned: 0 in 0.618s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:57:21 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-6712b5e7-acb5-4cea-8017-4af5eef291ae tempest-SnapshotDependencyTests-475794630 None] Lock "cinder-quobyte-88b974ab-ee66-4004-8526-d8e5a9033bc4" released by "_copy_volume_from_snapshot" :: held 7.505s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:57:21 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-6712b5e7-acb5-4cea-8017-4af5eef291ae tempest-SnapshotDependencyTests-475794630 None] Lock "cinder-quobyte-11526ce4-a15f-469f-ba73-58d4b39db206-88b974ab-ee66-4004-8526-d8e5a9033bc4" released by "_create_volume_from_snapshot" :: held 7.536s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:57:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6712b5e7-acb5-4cea-8017-4af5eef291ae tempest-SnapshotDependencyTests-475794630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.552s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:57:21 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6712b5e7-acb5-4cea-8017-4af5eef291ae tempest-SnapshotDependencyTests-475794630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8581d639-9f69-4e48-9795-2759b928410d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88b974ab-ee66-4004-8526-d8e5a9033bc4', 'volume_size': 1, 'snapshot_id': '11526ce4-a15f-469f-ba73-58d4b39db206'}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:57:21 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6712b5e7-acb5-4cea-8017-4af5eef291ae tempest-SnapshotDependencyTests-475794630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (512001e1-8201-4f09-a748-db675f1fd4c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 14:57:21 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-6712b5e7-acb5-4cea-8017-4af5eef291ae tempest-SnapshotDependencyTests-475794630 None] Volume volume-88b974ab-ee66-4004-8526-d8e5a9033bc4 (88b974ab-ee66-4004-8526-d8e5a9033bc4): created successfully
Jul 09 14:57:21 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6712b5e7-acb5-4cea-8017-4af5eef291ae tempest-SnapshotDependencyTests-475794630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (512001e1-8201-4f09-a748-db675f1fd4c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 14:57:21 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6712b5e7-acb5-4cea-8017-4af5eef291ae tempest-SnapshotDependencyTests-475794630 None] Flow 'volume_create_manager' (69fa155c-0163-4108-afb7-a59614490a34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 14:57:21 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-6712b5e7-acb5-4cea-8017-4af5eef291ae tempest-SnapshotDependencyTests-475794630 None] Created volume successfully.
Jul 09 14:57:22 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-0ee2e3d4-efbe-4d17-b149-9d94802a3eaf tempest-SnapshotDependencyTests-475794630 None] Acquiring lock "cinder-11526ce4-a15f-469f-ba73-58d4b39db206-delete_snapshot" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:57:22 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-0ee2e3d4-efbe-4d17-b149-9d94802a3eaf tempest-SnapshotDependencyTests-475794630 None] Lock "cinder-11526ce4-a15f-469f-ba73-58d4b39db206-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:57:22 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-0ee2e3d4-efbe-4d17-b149-9d94802a3eaf tempest-SnapshotDependencyTests-475794630 None] Acquiring lock "cinder-quobyte-10bc915f-14f2-41eb-8613-2a2f70f1e9b1" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:57:22 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-0ee2e3d4-efbe-4d17-b149-9d94802a3eaf tempest-SnapshotDependencyTests-475794630 None] Lock "cinder-quobyte-10bc915f-14f2-41eb-8613-2a2f70f1e9b1" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:57:22 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-0ee2e3d4-efbe-4d17-b149-9d94802a3eaf tempest-SnapshotDependencyTests-475794630 None] Acquiring lock "cinder-quobyte-11526ce4-a15f-469f-ba73-58d4b39db206" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:57:22 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-0ee2e3d4-efbe-4d17-b149-9d94802a3eaf tempest-SnapshotDependencyTests-475794630 None] Lock "cinder-quobyte-11526ce4-a15f-469f-ba73-58d4b39db206" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:57:22 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-0ee2e3d4-efbe-4d17-b149-9d94802a3eaf tempest-SnapshotDependencyTests-475794630 None] Deleting offline snapshot 11526ce4-a15f-469f-ba73-58d4b39db206 of volume 10bc915f-14f2-41eb-8613-2a2f70f1e9b1 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 14:57:22 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-0ee2e3d4-efbe-4d17-b149-9d94802a3eaf tempest-SnapshotDependencyTests-475794630 None] snapshot_file for this snap is: volume-10bc915f-14f2-41eb-8613-2a2f70f1e9b1.11526ce4-a15f-469f-ba73-58d4b39db206 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 14:57:22 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a3d300-dc27-4060-b7ea-8c5d9f3322ef]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:57:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0ee2e3d4-efbe-4d17-b149-9d94802a3eaf tempest-SnapshotDependencyTests-475794630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-10bc915f-14f2-41eb-8613-2a2f70f1e9b1.11526ce4-a15f-469f-ba73-58d4b39db206 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:57:22 devstack sudo[108608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-10bc915f-14f2-41eb-8613-2a2f70f1e9b1.11526ce4-a15f-469f-ba73-58d4b39db206
Jul 09 14:57:22 devstack sudo[108608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:57:23 devstack sudo[108608]: pam_unix(sudo:session): session closed for user root
Jul 09 14:57:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0ee2e3d4-efbe-4d17-b149-9d94802a3eaf tempest-SnapshotDependencyTests-475794630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-10bc915f-14f2-41eb-8613-2a2f70f1e9b1.11526ce4-a15f-469f-ba73-58d4b39db206" returned: 0 in 0.715s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:57:23 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-0ee2e3d4-efbe-4d17-b149-9d94802a3eaf tempest-SnapshotDependencyTests-475794630 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10bc915f-14f2-41eb-8613-2a2f70f1e9b1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 14:57:23 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[08368877-6aa9-4d98-a3e0-d807e11bc1a8]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:57:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0ee2e3d4-efbe-4d17-b149-9d94802a3eaf tempest-SnapshotDependencyTests-475794630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-10bc915f-14f2-41eb-8613-2a2f70f1e9b1 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:57:23 devstack sudo[108613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-10bc915f-14f2-41eb-8613-2a2f70f1e9b1
Jul 09 14:57:23 devstack sudo[108613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:57:24 devstack sudo[108613]: pam_unix(sudo:session): session closed for user root
Jul 09 14:57:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0ee2e3d4-efbe-4d17-b149-9d94802a3eaf tempest-SnapshotDependencyTests-475794630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-10bc915f-14f2-41eb-8613-2a2f70f1e9b1" returned: 0 in 0.735s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:57:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0ee2e3d4-efbe-4d17-b149-9d94802a3eaf tempest-SnapshotDependencyTests-475794630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-10bc915f-14f2-41eb-8613-2a2f70f1e9b1.11526ce4-a15f-469f-ba73-58d4b39db206 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:57:24 devstack sudo[108618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-10bc915f-14f2-41eb-8613-2a2f70f1e9b1.11526ce4-a15f-469f-ba73-58d4b39db206
Jul 09 14:57:24 devstack sudo[108618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:57:24 devstack sudo[108618]: pam_unix(sudo:session): session closed for user root
Jul 09 14:57:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0ee2e3d4-efbe-4d17-b149-9d94802a3eaf tempest-SnapshotDependencyTests-475794630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-10bc915f-14f2-41eb-8613-2a2f70f1e9b1.11526ce4-a15f-469f-ba73-58d4b39db206" returned: 0 in 0.733s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:57:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0ee2e3d4-efbe-4d17-b149-9d94802a3eaf tempest-SnapshotDependencyTests-475794630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-10bc915f-14f2-41eb-8613-2a2f70f1e9b1.11526ce4-a15f-469f-ba73-58d4b39db206 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:57:24 devstack sudo[108623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-10bc915f-14f2-41eb-8613-2a2f70f1e9b1.11526ce4-a15f-469f-ba73-58d4b39db206
Jul 09 14:57:24 devstack sudo[108623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:57:25 devstack sudo[108623]: pam_unix(sudo:session): session closed for user root
Jul 09 14:57:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0ee2e3d4-efbe-4d17-b149-9d94802a3eaf tempest-SnapshotDependencyTests-475794630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-10bc915f-14f2-41eb-8613-2a2f70f1e9b1.11526ce4-a15f-469f-ba73-58d4b39db206" returned: 0 in 0.626s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:57:25 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-0ee2e3d4-efbe-4d17-b149-9d94802a3eaf tempest-SnapshotDependencyTests-475794630 None] Lock "cinder-quobyte-11526ce4-a15f-469f-ba73-58d4b39db206" released by "_delete_snapshot" :: held 2.900s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:57:25 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-0ee2e3d4-efbe-4d17-b149-9d94802a3eaf tempest-SnapshotDependencyTests-475794630 None] Lock "cinder-quobyte-10bc915f-14f2-41eb-8613-2a2f70f1e9b1" released by "delete_snapshot" :: held 2.920s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:57:25 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-0ee2e3d4-efbe-4d17-b149-9d94802a3eaf tempest-SnapshotDependencyTests-475794630 None] Created reservations ['77f577f2-be32-463d-9314-2d9709e2dc10', 'fa528a23-6e51-409a-a2ae-f1c7e4b42fe5', '0b2798c8-ad6e-4d12-9bc2-6715b9311434', '87f3de3f-9db5-4f28-82a9-36814ad3622e'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:57:25 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-0ee2e3d4-efbe-4d17-b149-9d94802a3eaf tempest-SnapshotDependencyTests-475794630 None] Delete snapshot completed successfully.
Jul 09 14:57:25 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-0ee2e3d4-efbe-4d17-b149-9d94802a3eaf tempest-SnapshotDependencyTests-475794630 None] Lock "cinder-11526ce4-a15f-469f-ba73-58d4b39db206-delete_snapshot" released by "delete_snapshot" :: held 3.046s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:57:25 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-be27e729-106a-4d57-8a2b-3fe1400717d9 tempest-SnapshotDependencyTests-475794630 None] Acquiring lock "cinder-10bc915f-14f2-41eb-8613-2a2f70f1e9b1-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:57:25 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-be27e729-106a-4d57-8a2b-3fe1400717d9 tempest-SnapshotDependencyTests-475794630 None] Lock "cinder-10bc915f-14f2-41eb-8613-2a2f70f1e9b1-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:57:25 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-be27e729-106a-4d57-8a2b-3fe1400717d9 tempest-SnapshotDependencyTests-475794630 None] Acquiring lock "cinder-quobyte-10bc915f-14f2-41eb-8613-2a2f70f1e9b1" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:57:25 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-be27e729-106a-4d57-8a2b-3fe1400717d9 tempest-SnapshotDependencyTests-475794630 None] Lock "cinder-quobyte-10bc915f-14f2-41eb-8613-2a2f70f1e9b1" acquired by "delete_volume" :: waited 0.014s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:57:25 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[d001b5d3-5b3c-4268-aedc-8d5372640b1f]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:57:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-be27e729-106a-4d57-8a2b-3fe1400717d9 tempest-SnapshotDependencyTests-475794630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-10bc915f-14f2-41eb-8613-2a2f70f1e9b1 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:57:25 devstack sudo[108626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-10bc915f-14f2-41eb-8613-2a2f70f1e9b1
Jul 09 14:57:25 devstack sudo[108626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:57:26 devstack sudo[108626]: pam_unix(sudo:session): session closed for user root
Jul 09 14:57:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-be27e729-106a-4d57-8a2b-3fe1400717d9 tempest-SnapshotDependencyTests-475794630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-10bc915f-14f2-41eb-8613-2a2f70f1e9b1" returned: 0 in 0.722s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:57:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-be27e729-106a-4d57-8a2b-3fe1400717d9 tempest-SnapshotDependencyTests-475794630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-10bc915f-14f2-41eb-8613-2a2f70f1e9b1 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:57:26 devstack sudo[108631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-10bc915f-14f2-41eb-8613-2a2f70f1e9b1
Jul 09 14:57:26 devstack sudo[108631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:57:27 devstack sudo[108631]: pam_unix(sudo:session): session closed for user root
Jul 09 14:57:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-be27e729-106a-4d57-8a2b-3fe1400717d9 tempest-SnapshotDependencyTests-475794630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-10bc915f-14f2-41eb-8613-2a2f70f1e9b1" returned: 0 in 0.656s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:57:27 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-be27e729-106a-4d57-8a2b-3fe1400717d9 tempest-SnapshotDependencyTests-475794630 None] Lock "cinder-quobyte-10bc915f-14f2-41eb-8613-2a2f70f1e9b1" released by "delete_volume" :: held 1.435s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:57:27 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-be27e729-106a-4d57-8a2b-3fe1400717d9 tempest-SnapshotDependencyTests-475794630 None] Created reservations ['8521d2ac-4a61-4a6c-bfa8-f4ea9e8105e9', '961a8972-b054-41ec-89a2-b6e392b00e94', 'aa6b4b3b-fe68-4c89-aa6f-998d5f6709c1', '7614f394-bd29-43db-90b0-39e94f7068d6'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:57:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-be27e729-106a-4d57-8a2b-3fe1400717d9 tempest-SnapshotDependencyTests-475794630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:57:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-be27e729-106a-4d57-8a2b-3fe1400717d9 tempest-SnapshotDependencyTests-475794630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:57:27 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-be27e729-106a-4d57-8a2b-3fe1400717d9 tempest-SnapshotDependencyTests-475794630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:57:27 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-be27e729-106a-4d57-8a2b-3fe1400717d9 tempest-SnapshotDependencyTests-475794630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:57:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-be27e729-106a-4d57-8a2b-3fe1400717d9 tempest-SnapshotDependencyTests-475794630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:57:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-be27e729-106a-4d57-8a2b-3fe1400717d9 tempest-SnapshotDependencyTests-475794630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:57:27 devstack sudo[108634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:57:27 devstack sudo[108634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:57:27 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-75d2fe15-984e-4672-91e0-d517ca0c15b9 tempest-SnapshotDependencyTests-475794630 None] Acquiring lock "cinder-88b974ab-ee66-4004-8526-d8e5a9033bc4-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:57:27 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-75d2fe15-984e-4672-91e0-d517ca0c15b9 tempest-SnapshotDependencyTests-475794630 None] Lock "cinder-88b974ab-ee66-4004-8526-d8e5a9033bc4-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:57:27 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-75d2fe15-984e-4672-91e0-d517ca0c15b9 tempest-SnapshotDependencyTests-475794630 None] Acquiring lock "cinder-quobyte-88b974ab-ee66-4004-8526-d8e5a9033bc4" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 14:57:27 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-75d2fe15-984e-4672-91e0-d517ca0c15b9 tempest-SnapshotDependencyTests-475794630 None] Lock "cinder-quobyte-88b974ab-ee66-4004-8526-d8e5a9033bc4" acquired by "delete_volume" :: waited 0.018s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 14:57:27 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ceed98-70b3-4edf-9fb7-57aacba73752]: (4, 'qcow2') {{(pid=88541) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 14:57:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-75d2fe15-984e-4672-91e0-d517ca0c15b9 tempest-SnapshotDependencyTests-475794630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-88b974ab-ee66-4004-8526-d8e5a9033bc4 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:57:28 devstack sudo[108634]: pam_unix(sudo:session): session closed for user root
Jul 09 14:57:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-be27e729-106a-4d57-8a2b-3fe1400717d9 tempest-SnapshotDependencyTests-475794630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.747s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:57:28 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-be27e729-106a-4d57-8a2b-3fe1400717d9 tempest-SnapshotDependencyTests-475794630 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:57:28 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-be27e729-106a-4d57-8a2b-3fe1400717d9 tempest-SnapshotDependencyTests-475794630 None] Deleted volume successfully.
Jul 09 14:57:28 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-be27e729-106a-4d57-8a2b-3fe1400717d9 tempest-SnapshotDependencyTests-475794630 None] Lock "cinder-10bc915f-14f2-41eb-8613-2a2f70f1e9b1-delete_volume" released by "delete_volume" :: held 2.374s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:57:28 devstack sudo[108637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-88b974ab-ee66-4004-8526-d8e5a9033bc4
Jul 09 14:57:28 devstack sudo[108637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:57:28 devstack sudo[108637]: pam_unix(sudo:session): session closed for user root
Jul 09 14:57:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-75d2fe15-984e-4672-91e0-d517ca0c15b9 tempest-SnapshotDependencyTests-475794630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-88b974ab-ee66-4004-8526-d8e5a9033bc4" returned: 0 in 0.818s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:57:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-75d2fe15-984e-4672-91e0-d517ca0c15b9 tempest-SnapshotDependencyTests-475794630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-88b974ab-ee66-4004-8526-d8e5a9033bc4 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:57:28 devstack sudo[108642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-88b974ab-ee66-4004-8526-d8e5a9033bc4
Jul 09 14:57:28 devstack sudo[108642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:57:29 devstack sudo[108642]: pam_unix(sudo:session): session closed for user root
Jul 09 14:57:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-75d2fe15-984e-4672-91e0-d517ca0c15b9 tempest-SnapshotDependencyTests-475794630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd/volume-88b974ab-ee66-4004-8526-d8e5a9033bc4" returned: 0 in 0.640s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:57:29 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-75d2fe15-984e-4672-91e0-d517ca0c15b9 tempest-SnapshotDependencyTests-475794630 None] Lock "cinder-quobyte-88b974ab-ee66-4004-8526-d8e5a9033bc4" released by "delete_volume" :: held 1.500s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:57:29 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-75d2fe15-984e-4672-91e0-d517ca0c15b9 tempest-SnapshotDependencyTests-475794630 None] Created reservations ['d0e06380-ae4b-432b-a5fd-ff19f05b0789', 'bb1f23ed-913c-46fb-9af8-bfb73c3e634d', 'fa1aa1ea-3ab6-454a-b8bd-2a2187f08dc6', '4053b41f-4098-40c1-afc7-42468f407829'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 14:57:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-75d2fe15-984e-4672-91e0-d517ca0c15b9 tempest-SnapshotDependencyTests-475794630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:57:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-75d2fe15-984e-4672-91e0-d517ca0c15b9 tempest-SnapshotDependencyTests-475794630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:57:29 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-75d2fe15-984e-4672-91e0-d517ca0c15b9 tempest-SnapshotDependencyTests-475794630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:57:29 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-75d2fe15-984e-4672-91e0-d517ca0c15b9 tempest-SnapshotDependencyTests-475794630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:57:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-75d2fe15-984e-4672-91e0-d517ca0c15b9 tempest-SnapshotDependencyTests-475794630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:57:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-75d2fe15-984e-4672-91e0-d517ca0c15b9 tempest-SnapshotDependencyTests-475794630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:57:29 devstack sudo[108645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:57:29 devstack sudo[108645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:57:30 devstack sudo[108645]: pam_unix(sudo:session): session closed for user root
Jul 09 14:57:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-75d2fe15-984e-4672-91e0-d517ca0c15b9 tempest-SnapshotDependencyTests-475794630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.685s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:57:30 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-75d2fe15-984e-4672-91e0-d517ca0c15b9 tempest-SnapshotDependencyTests-475794630 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:57:30 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-75d2fe15-984e-4672-91e0-d517ca0c15b9 tempest-SnapshotDependencyTests-475794630 None] Deleted volume successfully.
Jul 09 14:57:30 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-75d2fe15-984e-4672-91e0-d517ca0c15b9 tempest-SnapshotDependencyTests-475794630 None] Lock "cinder-88b974ab-ee66-4004-8526-d8e5a9033bc4-delete_volume" released by "delete_volume" :: held 2.392s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 14:57:39 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=27,cinder:UPDATE=28,cinder:DELETE=2,cinder:INSERT=8 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 14:57:40 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=20,cinder:INSERT=6,cinder:UPDATE=28,cinder:DELETE=3 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 14:57:52 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 14:57:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 14:57:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 14:57:52 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 14:57:52 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6862a67e-7e12-4a83-8fba-9a2727fa9653'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 14:57:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 14:57:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 14:57:52 devstack sudo[108942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd
Jul 09 14:57:52 devstack sudo[108942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 14:57:53 devstack sudo[108942]: pam_unix(sudo:session): session closed for user root
Jul 09 14:57:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c28b2cc80067aef318bd8e897c99b6fd" returned: 0 in 0.670s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 14:57:53 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 14:57:53 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] Running periodic task VolumeManager._thread_info {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 14:57:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] thread count: 28 {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 09 14:57:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9c8c2d35-5f2d-4718-a476-b7f7fdabfab9 None None] thread info: [<_MainThread(MainThread, started 125388812103808)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125388713797504)>, <Thread(Thread-3 (stat_writer), started daemon 125388699995392)>, <Thread(Rabbit-heartbeat, started daemon 125388700522560)>, <Thread(Thread-5 (_runner), started daemon 125388698545216)>, <Thread(Thread-7 (_runner), started daemon 125388698611264)>, <Thread(fd_logger, started daemon 125388703020672)>, <Thread(privsep_reader, started daemon 125388696441088)>, <Thread(tpool_thread_0, started daemon 125388687943360)>, <Thread(tpool_thread_1, started daemon 125388679550656)>, <Thread(tpool_thread_2, started daemon 125388671141568)>, <Thread(tpool_thread_3, started daemon 125388662732480)>, <Thread(tpool_thread_4, started daemon 125388654323392)>, <Thread(tpool_thread_5, started daemon 125388645914304)>, <Thread(tpool_thread_6, started daemon 125388637505216)>, <Thread(tpool_thread_7, started daemon 125388629096128)>, <Thread(tpool_thread_8, started daemon 125388620687040)>, <Thread(tpool_thread_9, started daemon 125388612277952)>, <Thread(tpool_thread_10, started daemon 125388603868864)>, <Thread(tpool_thread_11, started daemon 125388595459776)>, <Thread(tpool_thread_12, started daemon 125388587050688)>, <Thread(tpool_thread_13, started daemon 125388578641600)>, <Thread(tpool_thread_14, started daemon 125388570232512)>, <Thread(tpool_thread_15, started daemon 125388561823424)>, <Thread(tpool_thread_16, started daemon 125388553414336)>, <Thread(tpool_thread_17, started daemon 125388545005248)>, <Thread(tpool_thread_18, started daemon 125388536596160)>, <Thread(tpool_thread_19, started daemon 125388528187072)>] {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}